Skip to content

@llm-d-incubation llm-d incubation

Change the repository type filter

All

    Repositories list

    14 repositories

    • llm-d-fast-model-actuation

      Public
      Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping
      llm-d
      llm-d
      Go
      •
      Apache License 2.0
      •14•11•37•9•Updated Apr 21, 2026Apr 21, 2026

    • llm-d-async

      Public
      Asynchronous Processor for Inference Gateway. Orchestrator of queues
      Go
      •
      Apache License 2.0
      •10•8•14•8•Updated Apr 21, 2026Apr 21, 2026

    • batch-gateway

      Public
      The batch gateway is an llm-d implementation of the OpenAI batch inference API
      Go
      •
      Apache License 2.0
      •15•8•23•7•Updated Apr 20, 2026Apr 20, 2026

    • llm-d-skills

      Public
      Apache License 2.0
      •5•2•1•5•Updated Apr 20, 2026Apr 20, 2026

    • secure-inference

      Public
      Go
      •
      Apache License 2.0
      •3•3•10•3•Updated Apr 18, 2026Apr 18, 2026

    • llm-d-rl

      Public
      Python
      •2•0•1•1•Updated Apr 17, 2026Apr 17, 2026

    • hermes

      Public
      Hermes is a cluster configuration scanning and self-test generation tool for llm-d inference workloads
      Rust
      •4•0•7•2•Updated Apr 17, 2026Apr 17, 2026

    • weight-propagation-interface

      Public
      Python
      •
      Apache License 2.0
      •0•3•0•0•Updated Apr 16, 2026Apr 16, 2026

    • llm-d-planner

      Public
      Python
      •
      Apache License 2.0
      •9•14•26•5•Updated Apr 16, 2026Apr 16, 2026

    • py-inference-scheduler

      Public
      Python based inference-scheduler for Reinforcement Learning
      Python
      •
      Apache License 2.0
      •4•8•5•0•Updated Apr 16, 2026Apr 16, 2026

    • llm-d-infra

      Public
      llm-d helm charts and deployment examples
      Go Template
      •
      Apache License 2.0
      •56•55•13•11•Updated Apr 16, 2026Apr 16, 2026

    • llm-d-modelservice

      Public
      helm charts for deploying models with llm-d
      Go Template
      •
      Apache License 2.0
      •58•30•15•7•Updated Apr 12, 2026Apr 12, 2026

    • ig-wva

      Public
      Workload Variant Autoscaler is a service to compute the cost-optimal provisioning of heterogeneous accelerators for inference workloads with varying request lat…
      Jupyter Notebook
      •2•2•33•0•Updated Mar 10, 2026Mar 10, 2026

    • llm-d-ci

      Public
      Shell
      •2•2•9•0•Updated Mar 10, 2026Mar 10, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.