Skip to content
Change the repository type filter

All

    Repositories list

    • llm-d-workload-variant-autoscaler

      Public
      Variant optimization autoscaler for distributed inference workloads
      Go
      Apache License 2.0
      483810439Updated Apr 14, 2026Apr 14, 2026
    • llm-d-benchmark

      Public
      llm-d benchmark scripts and tooling
      Python
      Apache License 2.0
      67556317Updated Apr 14, 2026Apr 14, 2026
    • llm-d-kv-cache

      Public
      Distributed KV cache scheduling & offloading libraries
      Go
      Apache License 2.0
      1091276033Updated Apr 14, 2026Apr 14, 2026
    • llm-d-inference-sim

      Public
      A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
      Go
      Apache License 2.0
      72113316Updated Apr 14, 2026Apr 14, 2026
    • llm-d-inference-scheduler

      Public
      Inference scheduler for llm-d
      Go
      Apache License 2.0
      1601656023Updated Apr 14, 2026Apr 14, 2026
    • llm-d.github.io

      Public
      Website for llm-d: This repository builds the website seen at llm-d.ai
      JavaScript
      Apache License 2.0
      25111211Updated Apr 14, 2026Apr 14, 2026
    • llm-d

      Public
      Achieve state of the art inference performance with modern accelerators on Kubernetes
      Shell
      Apache License 2.0
      4083k16775Updated Apr 14, 2026Apr 14, 2026
    • llm-d-prism

      Public
      Performance analysis for distributed inference systems
      JavaScript
      Apache License 2.0
      5210Updated Apr 14, 2026Apr 14, 2026
    • llm-d-latency-predictor

      Public
      Makefile
      Apache License 2.0
      0006Updated Apr 13, 2026Apr 13, 2026
    • llm-d-infra

      Public
      repo for CI and infrastructure required to maintain llm-d org member repos
      Shell
      Apache License 2.0
      50352Updated Apr 9, 2026Apr 9, 2026
    • llm-d-go-template

      Public template
      Go microservice template for llm-d repos. Use 'Use this template' to create a new Go project with standard CI, linting, Prow, and governance.
      Makefile
      Apache License 2.0
      3013Updated Apr 1, 2026Apr 1, 2026
    • llm-d-python-template

      Public template
      Python project template for llm-d repos. Use 'Use this template' to create a new Python project with standard CI, linting, Prow, and governance.
      Makefile
      Apache License 2.0
      2112Updated Mar 26, 2026Mar 26, 2026
    • Makefile
      65115Updated Mar 10, 2026Mar 10, 2026
    • .github

      Public
      2010Updated Mar 5, 2026Mar 5, 2026
    • llm-d-routing-sidecar

      Public archive
      Incubating P/D sidecar for llm-d
      Go
      Apache License 2.0
      291701Updated Nov 13, 2025Nov 13, 2025
    • llm-d-deployer

      Public archive
      Helm charts for llm-d
      Shell
      Apache License 2.0
      57523417Updated Jul 22, 2025Jul 22, 2025
    • llm-d-model-service

      Public archive
      Simplified model deployment on llm-d
      Go
      Apache License 2.0
      1528296Updated Jul 2, 2025Jul 2, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.