llm-d-inference-scheduler

Architecture snapshot: 2026-04-29 (2026-04-29)

Repository: llm-d/llm-d-inference-scheduler
Analyzer: arch-analyzer 0.2.0
Extracted: 2026-04-29T11:06:26Z

Summary

Metric	Count
CRDs	0
Deployments	10
Services	7
Secrets	3
Cluster Roles	0
Controller Watches	4

Component Architecture

CRDs, controllers, and owned Kubernetes resources.

graph LR
    %% Component architecture for llm-d-inference-scheduler

    classDef crd fill:#e74c3c,stroke:#c0392b,color:#fff
    classDef controller fill:#3498db,stroke:#2980b9,color:#fff
    classDef owned fill:#2ecc71,stroke:#27ae60,color:#fff
    classDef external fill:#95a5a6,stroke:#7f8c8d,color:#fff
    classDef dep fill:#f39c12,stroke:#e67e22,color:#fff

    subgraph controller["llm-d-inference-scheduler Controller"]
        dep_1["${EPP_NAME}"]
        class dep_1 controller
        dep_2["${MODEL_NAME_SAFE}-vllm-sim"]
        class dep_2 controller
        dep_3["0"]
        class dep_3 controller
        dep_4["e2e-epp"]
        class dep_4 controller
        dep_5["istiod-llm-d-gateway"]
        class dep_5 controller
        dep_6["vllm-sim-d"]
        class dep_6 controller
        dep_7["vllm-sim-d"]
        class dep_7 controller
        dep_8["vllm-sim-e"]
        class dep_8 controller
        dep_9["vllm-sim-p"]
        class dep_9 controller
        dep_10["vllm-sim-p"]
        class dep_10 controller
    end

CRDs

No CRDs defined.

Dependencies

Key External Dependencies

Module	Version
github.com/go-logr/logr	v1.4.3
github.com/prometheus/client_golang	v1.23.2
github.com/prometheus/client_model	v0.6.2
github.com/prometheus/common	v0.67.5
github.com/prometheus/prometheus	v0.310.0
google.golang.org/grpc	v1.80.0
k8s.io/api	v0.35.4
k8s.io/apiextensions-apiserver	v0.35.4
k8s.io/apimachinery	v0.35.4
k8s.io/client-go	v0.35.4
sigs.k8s.io/controller-runtime	v0.23.3