Skip to content

workload-variant-autoscaler: Dataflow

Controller Watches

Kubernetes resources this controller monitors for changes. Each watch triggers reconciliation when the watched resource is created, updated, or deleted.

Type GVK Source
For /v1/ConfigMap internal/controller/configmap_reconciler.go:101
For /v1/Pod .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/pod_controller.go:420
For /v1/Pod .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/pod_controller.go:420
For /v1/Pod .gomod-cache/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/pod_reconciler.go:86
For /v1/Pod .gopath-loader/pkg/mod/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/pod_reconciler.go:86
For api/v1/InferencePool .gomod-cache/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferencepool_reconciler.go:105
For api/v1/InferencePool internal/controller/inferencepool_reconciler.go:113
For api/v1/InferencePool .gopath-loader/pkg/mod/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferencepool_reconciler.go:105
For api/v1alpha1/VariantAutoscaling internal/controller/variantautoscaling_controller.go:378
For apix/v1alpha2/InferenceObjective .gomod-cache/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferenceobjective_reconciler.go:73
For apix/v1alpha2/InferenceObjective .gopath-loader/pkg/mod/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferenceobjective_reconciler.go:73
For apix/v1alpha2/InferencePool .gopath-loader/pkg/mod/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferencepool_reconciler.go:101
For apix/v1alpha2/InferencePool .gomod-cache/sigs.k8s.io/gateway-api-inference-extension@v1.2.1/pkg/epp/controller/inferencepool_reconciler.go:101
For apix/v1alpha2/InferencePool internal/controller/inferencepool_reconciler.go:109
For autoscaling/v2/HorizontalPodAutoscaler internal/controller/hpa_reconciler.go:67
For eventing/v1alpha1/CloudEventSource .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/eventing/cloudeventsource_controller.go:70
For eventing/v1alpha1/CloudEventSource .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/eventing/cloudeventsource_controller.go:70
For eventing/v1alpha1/ClusterCloudEventSource .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/eventing/clustercloudeventsource_controller.go:69
For eventing/v1alpha1/ClusterCloudEventSource .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/eventing/clustercloudeventsource_controller.go:69
For keda/v1alpha1/ClusterTriggerAuthentication .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/clustertriggerauthentication_controller.go:98
For keda/v1alpha1/ClusterTriggerAuthentication .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/clustertriggerauthentication_controller.go:98
For keda/v1alpha1/ScaledJob .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledjob_controller.go:91
For keda/v1alpha1/ScaledJob .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledjob_controller.go:91
For keda/v1alpha1/ScaledObject internal/controller/scaledobject_reconciler.go:68
For keda/v1alpha1/ScaledObject .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledobject_controller.go:130
For keda/v1alpha1/ScaledObject .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledobject_controller.go:130
For keda/v1alpha1/TriggerAuthentication .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/triggerauthentication_controller.go:99
For keda/v1alpha1/TriggerAuthentication .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/triggerauthentication_controller.go:99
For leaderworkerset/v1/LeaderWorkerSet .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:205
For leaderworkerset/v1/LeaderWorkerSet .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:205
Owns /v1/Service .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:207
Owns /v1/Service .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:207
Owns apps/v1/StatefulSet .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/pod_controller.go:431
Owns apps/v1/StatefulSet .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:206
Owns apps/v1/StatefulSet .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/pod_controller.go:431
Owns apps/v1/StatefulSet .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:206
Owns autoscaling/v2/HorizontalPodAutoscaler .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledobject_controller.go:144
Owns autoscaling/v2/HorizontalPodAutoscaler .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/controllers/keda/scaledobject_controller.go:144
Watches apps/v1/StatefulSet .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:208
Watches apps/v1/StatefulSet .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/controllers/leaderworkerset_controller.go:208

Programmatic Resource Operations

Verb Kind Group Condition
patch VariantAutoscaling api

Reconciliation Flow

How the controller interacts with the Kubernetes API during reconciliation.

sequenceDiagram
    %% Static dataflow for workload-variant-autoscaler

    participant KubernetesAPI as Kubernetes API
    participant controller_manager as controller-manager
    participant keda_metrics_apiserver as keda-metrics-apiserver
    participant keda_operator as keda-operator
    participant llama_deployment as llama-deployment

    KubernetesAPI->>+controller_manager: Watch ConfigMap (reconcile)
    KubernetesAPI->>+controller_manager: Watch Pod (reconcile)
    KubernetesAPI->>+controller_manager: Watch Pod (reconcile)
    KubernetesAPI->>+controller_manager: Watch Pod (reconcile)
    KubernetesAPI->>+controller_manager: Watch Pod (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch VariantAutoscaling (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferenceObjective (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferenceObjective (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch InferencePool (reconcile)
    KubernetesAPI->>+controller_manager: Watch HorizontalPodAutoscaler (reconcile)
    KubernetesAPI->>+controller_manager: Watch CloudEventSource (reconcile)
    KubernetesAPI->>+controller_manager: Watch CloudEventSource (reconcile)
    KubernetesAPI->>+controller_manager: Watch ClusterCloudEventSource (reconcile)
    KubernetesAPI->>+controller_manager: Watch ClusterCloudEventSource (reconcile)
    KubernetesAPI->>+controller_manager: Watch ClusterTriggerAuthentication (reconcile)
    KubernetesAPI->>+controller_manager: Watch ClusterTriggerAuthentication (reconcile)
    KubernetesAPI->>+controller_manager: Watch ScaledJob (reconcile)
    KubernetesAPI->>+controller_manager: Watch ScaledJob (reconcile)
    KubernetesAPI->>+controller_manager: Watch ScaledObject (reconcile)
    KubernetesAPI->>+controller_manager: Watch ScaledObject (reconcile)
    KubernetesAPI->>+controller_manager: Watch ScaledObject (reconcile)
    KubernetesAPI->>+controller_manager: Watch TriggerAuthentication (reconcile)
    KubernetesAPI->>+controller_manager: Watch TriggerAuthentication (reconcile)
    KubernetesAPI->>+controller_manager: Watch LeaderWorkerSet (reconcile)
    KubernetesAPI->>+controller_manager: Watch LeaderWorkerSet (reconcile)
    controller_manager->>KubernetesAPI: Create/Update Service
    controller_manager->>KubernetesAPI: Create/Update Service
    controller_manager->>KubernetesAPI: Create/Update StatefulSet
    controller_manager->>KubernetesAPI: Create/Update StatefulSet
    controller_manager->>KubernetesAPI: Create/Update StatefulSet
    controller_manager->>KubernetesAPI: Create/Update StatefulSet
    controller_manager->>KubernetesAPI: Create/Update HorizontalPodAutoscaler
    controller_manager->>KubernetesAPI: Create/Update HorizontalPodAutoscaler
    KubernetesAPI-->>+controller_manager: Watch StatefulSet (informer)
    KubernetesAPI-->>+controller_manager: Watch StatefulSet (informer)

    Note over controller_manager: Exposed Services
    Note right of controller_manager: keda-admission-webhooks:443/TCP [https]
    Note right of controller_manager: keda-admission-webhooks:8080/TCP [metrics]
    Note right of controller_manager: keda-admission-webhooks:443/TCP [https]
    Note right of controller_manager: keda-admission-webhooks:8080/TCP [metrics]
    Note right of controller_manager: keda-metrics-apiserver:443/TCP [https]
    Note right of controller_manager: keda-metrics-apiserver:8080/TCP [metrics]
    Note right of controller_manager: keda-metrics-apiserver:443/TCP [https]
    Note right of controller_manager: keda-metrics-apiserver:8080/TCP [metrics]
    Note right of controller_manager: keda-operator:9666/TCP [metricsservice]
    Note right of controller_manager: keda-operator:8080/TCP [metrics]
    Note right of controller_manager: keda-operator:9666/TCP [metricsservice]
    Note right of controller_manager: keda-operator:8080/TCP [metrics]
    Note right of controller_manager: uvicorn-server:8000/TCP []
    Note right of controller_manager: webhook-service:443/TCP []
    Note right of controller_manager: webhook-service:443/TCP []

    Note over KubernetesAPI: Defined CRDs
    Note right of KubernetesAPI: VariantAutoscaling (llmd.ai/v1alpha1)

Webhooks

Name Type Path Failure Policy Service Overlays Enable Condition Sources
mleaderworkerset.kb.io mutating /mutate-leaderworkerset-x-k8s-io-v1-leaderworkerset fail .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go, .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go
mleaderworkerset.kb.io mutating /mutate-leaderworkerset-x-k8s-io-v1-leaderworkerset fail .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go, .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go
mpod.kb.io mutating /mutate--v1-pod fail .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go, .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go
mpod.kb.io mutating /mutate--v1-pod fail .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go, .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go
vleaderworkerset.kb.io validating /validate-leaderworkerset-x-k8s-io-v1-leaderworkerset fail .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go, .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go
vleaderworkerset.kb.io validating /validate-leaderworkerset-x-k8s-io-v1-leaderworkerset fail .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go, .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/leaderworkerset_webhook.go
vpod.kb.io validating /validate--v1-pod fail .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go, .gomod-cache/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go
vpod.kb.io validating /validate--v1-pod fail .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go, .gopath-loader/pkg/mod/sigs.k8s.io/lws@v0.8.0/pkg/webhooks/pod_webhook.go

HTTP Endpoints

Method Path Source
* / .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:188
* / .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:130
* / .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:130
* / .gomod-cache/github.com/google/pprof@v0.0.0-20260115054156-294ebfa9ad83/internal/driver/webui.go:214
* / .gomod-cache/golang.org/x/net@v0.49.0/webdav/litmus_test_server.go:83
* / .gomod-cache/golang.org/x/tools@v0.41.0/cmd/present/dir.go:23
* / .gomod-cache/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:47
* / .gomod-cache/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/webhook/webhook.go:220
* / .gopath-loader/pkg/mod/github.com/google/pprof@v0.0.0-20260115054156-294ebfa9ad83/internal/driver/webui.go:214
* / .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:47
* / .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/cmd/present/dir.go:23
* / .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/webdav/litmus_test_server.go:83
* / .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:188
* / .gopath-loader/pkg/mod/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/webhook/webhook.go:220
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/version.go:44
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/aggregated/wrapper.go:58
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/version.go:44
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/version.go:67
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/root.go:154
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/legacy.go:59
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/aggregated/wrapper.go:58
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/group.go:57
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/legacy.go:59
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/root.go:154
GET / .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/version.go:67
GET / .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/endpoints/discovery/group.go:57
* /abort .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:63
* /abort .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:63
* /aggregated-nonprimary-procs-report .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:60
* /aggregated-nonprimary-procs-report .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:60
* /args .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:136
* /args .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:136
* /bar .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/doc.go:67
* /bar .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/doc.go:67
* /before-suite-completed .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:57
* /before-suite-completed .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:57
* /before-suite-state .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:58
* /before-suite-state .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:58
* /block .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:210
* /block .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:210
* /chan .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:134
* /chan .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:134
* /compile .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/playground/playground.go:23
* /compile .gomod-cache/golang.org/x/tools@v0.41.0/playground/playground.go:23
* /counter .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:129
* /counter .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:129
* /counter .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:61
* /counter .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:61
* /date .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:138
* /date .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:138
* /debug/flags .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:55
* /debug/flags .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:55
* /debug/flags/ .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:56
* /debug/flags/ .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:56
* /debug/pprof .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:44
* /debug/pprof .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:44
* /debug/pprof/ .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:45
* /debug/pprof/ .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:45
* /debug/pprof/ .gomod-cache/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:316
* /debug/pprof/ .gopath-loader/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:316
* /debug/pprof/cmdline .gomod-cache/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:317
* /debug/pprof/cmdline .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:46
* /debug/pprof/cmdline .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:46
* /debug/pprof/cmdline .gopath-loader/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:317
* /debug/pprof/profile .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:47
* /debug/pprof/profile .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:47
* /debug/pprof/profile .gopath-loader/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:318
* /debug/pprof/profile .gomod-cache/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:318
* /debug/pprof/symbol .gopath-loader/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:319
* /debug/pprof/symbol .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:48
* /debug/pprof/symbol .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:48
* /debug/pprof/symbol .gomod-cache/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:319
* /debug/pprof/trace .gopath-loader/pkg/mod/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:49
* /debug/pprof/trace .gomod-cache/k8s.io/apiserver@v0.34.3/pkg/server/routes/debugsocket.go:49
* /debug/pprof/trace .gomod-cache/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:320
* /debug/pprof/trace .gopath-loader/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/manager/internal.go:320
* /debug/vars .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/expvar/expvar.go:382
* /debug/vars .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/expvar/expvar.go:382
* /did-run .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:49
* /did-run .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:49
* /emit-output .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:51
* /emit-output .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:51
* /flags .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:135
* /flags .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:135
* /foo .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/doc.go:65
* /foo .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/doc.go:65
* /go/ .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:132
* /go/ .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:132
* /go/hello .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:137
* /go/hello .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/net/http/triv.go:137
* /goroutine .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:203
* /goroutine .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:203
* /goroutines .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:202
* /goroutines .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:202
* /have-nonprimary-procs-finished .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:59
* /have-nonprimary-procs-finished .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:59
* /health .gopath-loader/pkg/mod/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/injection/health_check.go:55
* /health .gomod-cache/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/injection/health_check.go:55
* /io .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:209
* /io .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:209
* /jsontrace .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:198
* /jsontrace .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:198
* /main.css .gomod-cache/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:49
* /main.css .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:49
* /main.js .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:48
* /main.js .gomod-cache/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:48
* /metrics .gomod-cache/github.com/kedacore/keda/v2@v2.18.0/cmd/adapter/main.go:176
* /metrics .gopath-loader/pkg/mod/github.com/kedacore/keda/v2@v2.18.0/cmd/adapter/main.go:176
* /mmu .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:206
* /mmu .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:206
* /play.js .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/cmd/present/play.go:43
* /play.js .gomod-cache/golang.org/x/tools@v0.41.0/cmd/present/play.go:43
* /progress-report .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:52
* /progress-report .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:52
* /readiness .gomod-cache/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/injection/health_check.go:54
* /readiness .gopath-loader/pkg/mod/knative.dev/pkg@v0.0.0-20250326102644-9f3e60a9244c/injection/health_check.go:54
* /regionblock .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:216
* /regionblock .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:216
* /regionio .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:215
* /regionio .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:215
* /regionsched .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:218
* /regionsched .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:218
* /regionsyscall .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:217
* /regionsyscall .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:217
* /report-before-suite-completed .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:55
* /report-before-suite-completed .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:55
* /report-before-suite-state .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:56
* /report-before-suite-state .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:56
* /sched .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:212
* /sched .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:212
* /select.json .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:50
* /select.json .gomod-cache/golang.org/x/tools@v0.41.0/go/types/internal/play/play.go:50
* /socket .gomod-cache/golang.org/x/tools@v0.41.0/cmd/present/play.go:59
* /socket .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/cmd/present/play.go:59
* /static/ .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:199
* /static/ .gomod-cache/golang.org/x/tools@v0.41.0/cmd/present/main.go:98
* /static/ .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:199
* /static/ .gopath-loader/pkg/mod/golang.org/x/tools@v0.41.0/cmd/present/main.go:98
* /suite-did-end .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:50
* /suite-did-end .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:50
* /suite-will-begin .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:48
* /suite-will-begin .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:48
* /syscall .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:211
* /syscall .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:211
* /trace .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:197
* /trace .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:197
* /ui/ .gomod-cache/github.com/google/pprof@v0.0.0-20260115054156-294ebfa9ad83/internal/driver/webui.go:213
* /ui/ .gopath-loader/pkg/mod/github.com/google/pprof@v0.0.0-20260115054156-294ebfa9ad83/internal/driver/webui.go:213
* /up .gopath-loader/pkg/mod/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:62
* /up .gomod-cache/github.com/onsi/ginkgo/v2@v2.28.1/internal/parallel_support/http_server.go:62
* /userregion .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:222
* /userregion .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:222
* /userregions .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:221
* /userregions .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:221
* /usertask .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:226
* /usertask .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:226
* /usertasks .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:225
* /usertasks .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/cmd/trace/main.go:225
GET /{user-id} .gopath-loader/pkg/mod/github.com/emicklei/go-restful/v3@v3.13.0/doc.go:19
GET /{user-id} .gomod-cache/github.com/emicklei/go-restful/v3@v3.13.0/doc.go:19
GET /{user-id} .gomod-cache/github.com/emicklei/go-restful/v3@v3.13.0/doc.go:82
GET /{user-id} .gopath-loader/pkg/mod/github.com/emicklei/go-restful/v3@v3.13.0/doc.go:82
* G .gopath-loader/pkg/mod/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:102
* G .gomod-cache/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:113
* G .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:109
* G .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:203
* G .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:225
* G .gomod-cache/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:191
* G .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:97
* G .gopath-loader/pkg/mod/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:113
* G .gopath-loader/pkg/mod/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:171
* G .gopath-loader/pkg/mod/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:191
* G .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:109
* G .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:203
* G .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:225
* G .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/testing/slogtest/slogtest.go:97
* G .gomod-cache/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:102
* G .gomod-cache/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/slogtest/slogtest.go:171
* GET /debug/vars .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/expvar/expvar.go:384
* GET /debug/vars .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/expvar/expvar.go:384
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/trace/v1/trace_service.pb.gw.go:74
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/logs/v1/logs_service.pb.gw.go:74
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/logs/v1/logs_service.pb.gw.go:140
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/trace/v1/trace_service.pb.gw.go:140
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/trace/v1/trace_service.pb.gw.go:140
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/metrics/v1/metrics_service.pb.gw.go:140
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/metrics/v1/metrics_service.pb.gw.go:74
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/logs/v1/logs_service.pb.gw.go:140
* POST .gopath-loader/pkg/mod/go.opentelemetry.io/proto/otlp@v1.7.1/collector/logs/v1/logs_service.pb.gw.go:74
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/metrics/v1/metrics_service.pb.gw.go:74
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/metrics/v1/metrics_service.pb.gw.go:140
* POST .gomod-cache/go.opentelemetry.io/proto/otlp@v1.7.1/collector/trace/v1/trace_service.pb.gw.go:74
* header .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:187
* header .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:267
* header .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:165
* header .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:211
* header .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:211
* header .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:187
* header .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:267
* header .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:165
* raw .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:172
* raw .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:217
* raw .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:193
* raw .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:193
* raw .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:172
* raw .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:217
* request .gomod-cache/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/doc.go:137
* request .gopath-loader/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/log/slog/doc.go:137
* request .gomod-cache/golang.org/toolchain@v0.0.1-go1.25.0.linux-amd64/src/log/slog/doc.go:137
* request .gopath-loader/pkg/mod/golang.org/x/exp@v0.0.0-20250808145144-a408d31f581a/slog/doc.go:137
* vantage_point .gomod-cache/golang.org/x/net@v0.49.0/quic/qlog.go:96
* vantage_point .gopath-loader/pkg/mod/golang.org/x/net@v0.49.0/quic/qlog.go:96

Configuration

ConfigMaps and Helm values that control this component's runtime behavior.

ConfigMaps

Name Data Keys Source
saturation-scaling-config default config/manager/configmap-saturation-scaling.yaml
service-classes-config freemium.yaml, premium.yaml deploy/configmap-serviceclass.yaml
wva-queueing-model-config default deploy/configmap-queueing-model.yaml
wva-saturation-scaling-config default deploy/configmap-saturation-scaling.yaml
wva-variantautoscaling-config GLOBAL_OPT_INTERVAL, PROMETHEUS_BASE_URL, PROMETHEUS_METRICS_CACHE_CLEANUP_INTERVAL, PROMETHEUS_METRICS_CACHE_FETCH_INTERVAL, PROMETHEUS_METRICS_CACHE_FRESH_THRESHOLD, PROMETHEUS_METRICS_CACHE_MAX_SIZE, PROMETHEUS_METRICS_CACHE_STALE_THRESHOLD, PROMETHEUS_METRICS_CACHE_TTL, PROMETHEUS_METRICS_CACHE_UNAVAILABLE_THRESHOLD, PROMETHEUS_TLS_INSECURE_SKIP_VERIFY, WVA_LIMITED_MODE, WVA_NODE_SELECTOR, WVA_SCALE_TO_ZERO config/manager/configmap.yaml
wva-variantautoscaling-config GLOBAL_OPT_INTERVAL, PROMETHEUS_BASE_URL, PROMETHEUS_METRICS_CACHE_CLEANUP_INTERVAL, PROMETHEUS_METRICS_CACHE_FETCH_INTERVAL, PROMETHEUS_METRICS_CACHE_FRESH_THRESHOLD, PROMETHEUS_METRICS_CACHE_STALE_THRESHOLD, PROMETHEUS_METRICS_CACHE_TTL, PROMETHEUS_METRICS_CACHE_UNAVAILABLE_THRESHOLD, PROMETHEUS_TLS_INSECURE_SKIP_VERIFY config/openshift/configmap-patch.yaml

Helm

Chart: inference-perf v0.2.0