Skip to content

changes to fix new image for vllm, embedding and reranker for cpu - #1438

Merged
manalilatkar merged 13 commits into
IBM:mainfrom
manalilatkar:vll_cpu_new_image
Sep 13, 2026
Merged

manalilatkar merged 13 commits into
IBM:mainfrom
manalilatkar:vll_cpu_new_image

Conversation

@manalilatkar

Copy link
Copy Markdown
Member

No description provided.

Comment thread ai-services/assets/components/embedding/vllm-cpu/podman/values.yaml Outdated
Comment thread ai-services/assets/components/llm/vllm-cpu/podman/templates/vllm-server.yaml.tmpl Outdated
Comment thread ai-services/assets/components/llm/vllm-cpu/podman/values.yaml
Comment thread services/chatbot/backend_utils.py Outdated

@dharaneeshvrd dharaneeshvrd left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ibm-granite/granite-4.1-8b-fp8 is only supported on spyre.
ibm-granite/granite-4.1-8b is only for cpu.

@manalilatkar

Copy link
Copy Markdown
Member Author

@dharaneeshvrd validating whether all the changes you pointed out are required.

Comment thread ai-services/assets/applications/rag-dev/openshift/values.yaml
Comment thread ai-services/assets/applications/rag-cpu/podman/values.yaml Outdated
Comment thread ai-services/assets/applications/rag-dev/podman/values.yaml
Comment thread ai-services/assets/applications/rag/openshift/values.yaml
Comment thread ai-services/assets/applications/rag/openshift/values.yaml
Comment thread ai-services/assets/components/llm/vllm-spyre/openshift/values.schema.json Outdated
Comment thread services/chatbot/backend_utils.py Outdated
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
…cessary changes

Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>

# Conflicts:
#	ai-services/Makefile
#	ai-services/assets/catalog/openshift/values.yaml
#	ai-services/assets/catalog/podman/values.yaml
#	ai-services/assets/worker/openshift/values.yaml
#	ai-services/assets/worker/podman/values.yaml
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
…and limits changed to 6

Signed-off-by: Manali Latkar <manali.latkar@ibm.com>

# Conflicts:
#	ai-services/Makefile
#	ai-services/assets/catalog/openshift/values.yaml
#	ai-services/assets/catalog/podman/values.yaml
#	ai-services/assets/worker/openshift/values.yaml
#	ai-services/assets/worker/podman/values.yaml
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Comment thread ai-services/assets/components/llm/vllm-cpu/openshift/values.schema.json Outdated
@dharaneeshvrd

Copy link
Copy Markdown
Member

Let's keep only podman changes!

…or openshift

Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
@manalilatkar
manalilatkar merged commit 1134e0c into IBM:main Sep 13, 2026
10 checks passed
nava-dba pushed a commit to nava-dba/embedding-services that referenced this pull request Sep 15, 2026
…cpu (IBM#1438)

Signed-off-by: Manali Latkar <manali.latkar@ibm.com>
Signed-off-by: Naved Afroz <naved.afroz1@ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants