trustyai-service-operator: Dataflow¶

Controller Watches¶

Kubernetes resources this controller monitors for changes. Each watch triggers reconciliation when the watched resource is created, updated, or deleted.

Type	GVK	Source
For	batch/v1/Job	`controllers/evalhub/evaluation_job_failure_reconciler.go:185`
For	evalhub/v1alpha1/EvalHub	`controllers/evalhub/evalhub_controller.go:250`
For	gorch/v1alpha1/GuardrailsOrchestrator	`controllers/gorch/guardrailsorchestrator_controller.go:410`
For	kueue/v1beta1/Workload	`controllers/evalhub/evaluation_failed_kueue_workloads_reconciler.go:76`
For	lmes/v1alpha1/LMEvalJob	`controllers/lmes/lmevaljob_controller.go:299`
For	nemo_guardrails/v1alpha1/NemoGuardrails	`controllers/nemo_guardrails/nemoguardrail_controller.go:215`
For	tas/v1alpha1/TrustyAIService	`controllers/tas/trustyaiservice_controller.go:279`
Owns	/v1/ConfigMap	`controllers/evalhub/evalhub_controller.go:253`
Owns	/v1/Service	`controllers/evalhub/evalhub_controller.go:252`
Owns	apps/v1/Deployment	`controllers/gorch/guardrailsorchestrator_controller.go:411`
Owns	apps/v1/Deployment	`controllers/tas/trustyaiservice_controller.go:280`
Owns	apps/v1/Deployment	`controllers/evalhub/evalhub_controller.go:251`
Watches	/v1/Namespace	`controllers/evalhub/evalhub_controller.go:254`
Watches	serving/v1beta1/InferenceService	`controllers/tas/trustyaiservice_controller.go:281`

Reconciliation Flow¶

How the controller interacts with the Kubernetes API during reconciliation.

sequenceDiagram
    %% Static dataflow for trustyai-service-operator

    participant KubernetesAPI as Kubernetes API
    participant trustyai_service_operator_controller_manager as trustyai-service-operator-controller-manager

    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch Job (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch EvalHub (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch GuardrailsOrchestrator (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch Workload (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch LMEvalJob (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch NemoGuardrails (reconcile)
    KubernetesAPI->>+trustyai_service_operator_controller_manager: Watch TrustyAIService (reconcile)
    trustyai_service_operator_controller_manager->>KubernetesAPI: Create/Update ConfigMap
    trustyai_service_operator_controller_manager->>KubernetesAPI: Create/Update Service
    trustyai_service_operator_controller_manager->>KubernetesAPI: Create/Update Deployment
    trustyai_service_operator_controller_manager->>KubernetesAPI: Create/Update Deployment
    trustyai_service_operator_controller_manager->>KubernetesAPI: Create/Update Deployment
    KubernetesAPI-->>+trustyai_service_operator_controller_manager: Watch Namespace (informer)
    KubernetesAPI-->>+trustyai_service_operator_controller_manager: Watch InferenceService (informer)

    Note over trustyai_service_operator_controller_manager: Exposed Services
    Note right of trustyai_service_operator_controller_manager: trustyai-service-operator-controller-manager-metrics-service:8443/TCP [https]
    Note right of trustyai_service_operator_controller_manager: trustyai-service-operator-metrics-service:8080/TCP [metrics]

Configuration¶

ConfigMaps and Helm values that control this component's runtime behavior.