cloud-native · since 2025
llm-d
llm-d community
An open-source, Kubernetes-native stack for distributed large-language-model inference, combining engines including vLLM and SGLang with routing, caching, autoscaling and deployment recipes across accelerators.
AILLM inferenceKubernetesvLLMmodel serving
desk notes
Verified 2026-09-03 from the project site, repository license and GitHub release metadata. Latest stable release: v0.9.0 (published 2026-08-17). The homepage still displays v0.8.1, so release metadata is taken from the project's release page.