Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.1k 19.3k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.2k 7.1k

3. ucloud/orderwise-agent ucloud/orderwise-agent Public

   OrderWise-Agent: An Intelligent Multi-Platform Food Delivery Price Comparison Agent

   Python 30 6

4. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python

5. speculators speculators Public

   Forked from vllm-project/speculators

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python