Skip to content

llm-d-kv-cache: Dataflow

Controller Watches

Kubernetes resources this controller monitors for changes. Each watch triggers reconciliation when the watched resource is created, updated, or deleted.

Type GVK Source
For /v1/Pod examples/kv_events/pod_reconciler/pod_reconciler.go:180

Reconciliation Flow

How the controller interacts with the Kubernetes API during reconciliation.

sequenceDiagram
    %% Static dataflow for llm-d-kv-cache

    participant KubernetesAPI as Kubernetes API
    participant n_0 as 0

    KubernetesAPI->>+n_0: Watch Pod (reconcile)

HTTP Endpoints

Method Path Source
* /metrics examples/kv_events/online/main.go:243
* /score_chat_completions examples/kv_events/online/main.go:273
* /score_completions examples/kv_events/online/main.go:247

Configuration

ConfigMaps and Helm values that control this component's runtime behavior.

Helm

Chart: pvc-evictor v0.1.0