Repositories list

• llm-d-workload-variant-autoscaler

  Public

  llm-d/llm-d-workload-variant-autoscaler’s past year of commit activity
  Variant optimization autoscaler for distributed inference workloads

  Go

  •

  Apache License 2.0

  •4848 forks•3838 stars•104104 issues•3939 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-benchmark

  Public

  llm-d/llm-d-benchmark’s past year of commit activity
  llm-d benchmark scripts and tooling

  incubating

  incubating

  Python

  •

  Apache License 2.0

  •6767 forks•5555 stars•6363 issues•1717 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-kv-cache

  Public

  llm-d/llm-d-kv-cache’s past year of commit activity
  Distributed KV cache scheduling & offloading libraries

  aiincubating

  aiincubating

  Go

  •

  Apache License 2.0

  •109109 forks•127127 stars•6060 issues•3333 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-inference-sim

  Public

  llm-d/llm-d-inference-sim’s past year of commit activity
  A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •7272 forks•113113 stars•3131 issues•66 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-inference-scheduler

  Public

  llm-d/llm-d-inference-scheduler’s past year of commit activity
  Inference scheduler for llm-d

  kubernetesainetworking+ 2

  kubernetesainetworkinginferencegateway-api

  Go

  •

  Apache License 2.0

  •160160 forks•165165 stars•6060 issues•2323 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d.github.io

  Public

  llm-d/llm-d.github.io’s past year of commit activity
  Website for llm-d: This repository builds the website seen at llm-d.ai

  documentationopensourceai+ 1

  documentationopensourceaidocusaurus

  JavaScript

  •

  Apache License 2.0

  •2525 forks•1111 stars•1212 issues•1111 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d

  Public

  llm-d/llm-d’s past year of commit activity
  Achieve state of the art inference performance with modern accelerators on Kubernetes

  Shell

  •

  Apache License 2.0

  •408408 forks•3k3k stars•167167 issues•7575 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-prism

  Public

  llm-d/llm-d-prism’s past year of commit activity
  Performance analysis for distributed inference systems

  JavaScript

  •

  Apache License 2.0

  •55 forks•22 stars•11 issue•00 pull requests•Updated Apr 14, 2026Apr 14, 2026

• llm-d-latency-predictor

  Public

  llm-d/llm-d-latency-predictor’s past year of commit activity
  Makefile

  •

  Apache License 2.0

  •00 forks•00 stars•00 issues•66 pull requests•Updated Apr 13, 2026Apr 13, 2026

• llm-d-infra

  Public

  llm-d/llm-d-infra’s past year of commit activity
  repo for CI and infrastructure required to maintain llm-d org member repos

  Shell

  •

  Apache License 2.0

  •55 forks•00 stars•3535 issues•22 pull requests•Updated Apr 9, 2026Apr 9, 2026

• llm-d-go-template

  Public template
  Go microservice template for llm-d repos. Use 'Use this template' to create a new Go project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •33 forks•00 stars•11 issue•33 pull requests•Updated Apr 1, 2026Apr 1, 2026

• llm-d-python-template

  Public template
  Python project template for llm-d repos. Use 'Use this template' to create a new Python project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •22 forks•11 star•11 issue•22 pull requests•Updated Mar 26, 2026Mar 26, 2026

• llm-d-pd-utils

  Public
  Makefile

  •66 forks•55 stars•1111 issues•55 pull requests•Updated Mar 10, 2026Mar 10, 2026

• .github

  Public
  22 forks•00 stars•11 issue•00 pull requests•Updated Mar 5, 2026Mar 5, 2026

• llm-d-routing-sidecar

  Public archive
  Incubating P/D sidecar for llm-d

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •2929 forks•1717 stars•00 issues•11 pull request•Updated Nov 13, 2025Nov 13, 2025

• llm-d-deployer

  Public archive
  Helm charts for llm-d

  helmhelm-chartllm-d

  helmhelm-chartllm-d

  Shell

  •

  Apache License 2.0

  •5757 forks•5252 stars•3434 issues•1717 pull requests•Updated Jul 22, 2025Jul 22, 2025

• llm-d-model-service

  Public archive
  Simplified model deployment on llm-d

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •1515 forks•2828 stars•2929 issues•66 pull requests•Updated Jul 2, 2025Jul 2, 2025