diff --git a/docs/intro.mdx b/docs/intro.mdx index 85340041a..b2db78b69 100644 --- a/docs/intro.mdx +++ b/docs/intro.mdx @@ -46,10 +46,10 @@ KServe eliminates the complexity of productionizing AI models. Whether you're a | **LLM Multi-framework** | Deploy LLMs from Hugging Face, vLLM, and custom generative models | | **OpenAI-Compatible APIs** | Chat completion, streaming, and embedding endpoints out of the box | | **LocalModelCache** | Reduce LLM startup time from 15–20 minutes to ~1 minute | -| **KV Cache Offloading** | Optimized memory management for long conversations and large contexts | -| **Multi-node Inference** | Distributed LLM serving across multiple nodes | +| **KV Cache Offloading** | Optimized memory management for long conversations and large contexts | +| **Multi-node Inference** | Distributed LLM serving across multiple nodes | | **Envoy AI Gateway** | Enterprise-grade API management and routing for AI workloads | -| **Metric-based Autoscaling** | Scale on token throughput, queue depth, and GPU utilization | +| **Metric-based Autoscaling** | Scale on token throughput, queue depth, and GPU utilization | | **Canary Deployments** | A/B testing and canary rollouts for LLM experiments | → Full Generative AI docs diff --git a/versioned_docs/version-0.18/intro.mdx b/versioned_docs/version-0.18/intro.mdx index 85340041a..df5b5e580 100644 --- a/versioned_docs/version-0.18/intro.mdx +++ b/versioned_docs/version-0.18/intro.mdx @@ -46,10 +46,10 @@ KServe eliminates the complexity of productionizing AI models. Whether you're a | **LLM Multi-framework** | Deploy LLMs from Hugging Face, vLLM, and custom generative models | | **OpenAI-Compatible APIs** | Chat completion, streaming, and embedding endpoints out of the box | | **LocalModelCache** | Reduce LLM startup time from 15–20 minutes to ~1 minute | -| **KV Cache Offloading** | Optimized memory management for long conversations and large contexts | -| **Multi-node Inference** | Distributed LLM serving across multiple nodes | +| **KV Cache Offloading** | Optimized memory management for long conversations and large contexts | +| **Multi-node Inference** | Distributed LLM serving across multiple nodes | | **Envoy AI Gateway** | Enterprise-grade API management and routing for AI workloads | -| **Metric-based Autoscaling** | Scale on token throughput, queue depth, and GPU utilization | +| **Metric-based Autoscaling** | Scale on token throughput, queue depth, and GPU utilization | | **Canary Deployments** | A/B testing and canary rollouts for LLM experiments | → Full Generative AI docs