data-science-pipelines-operator: Dataflow¶

Controller Watches¶

Kubernetes resources this controller monitors for changes. Each watch triggers reconciliation when the watched resource is created, updated, or deleted.

Type	GVK	Source
For	api/v1/DataSciencePipelinesApplication	`controllers/dspipeline_controller.go:799`
Owns	/v1/ConfigMap	`controllers/dspipeline_controller.go:802`
Owns	/v1/PersistentVolumeClaim	`controllers/dspipeline_controller.go:805`
Owns	/v1/Secret	`controllers/dspipeline_controller.go:801`
Owns	/v1/Service	`controllers/dspipeline_controller.go:803`
Owns	/v1/ServiceAccount	`controllers/dspipeline_controller.go:804`
Owns	apps/v1/Deployment	`controllers/dspipeline_controller.go:800`
Owns	networking.k8s.io/v1/NetworkPolicy	`controllers/dspipeline_controller.go:806`
Owns	rbac.authorization.k8s.io/v1/Role	`controllers/dspipeline_controller.go:807`
Owns	rbac.authorization.k8s.io/v1/RoleBinding	`controllers/dspipeline_controller.go:808`
Owns	route/v1/Route	`controllers/dspipeline_controller.go:809`

Reconciliation Flow¶

How the controller interacts with the Kubernetes API during reconciliation.

sequenceDiagram
    %% Static dataflow for data-science-pipelines-operator

    participant KubernetesAPI as Kubernetes API
    participant controller_manager as controller-manager
    participant mariadb as mariadb
    participant minio as minio

    KubernetesAPI->>+controller_manager: Watch DataSciencePipelinesApplication (reconcile)
    controller_manager->>KubernetesAPI: Create/Update ConfigMap
    controller_manager->>KubernetesAPI: Create/Update PersistentVolumeClaim
    controller_manager->>KubernetesAPI: Create/Update Secret
    controller_manager->>KubernetesAPI: Create/Update Service
    controller_manager->>KubernetesAPI: Create/Update ServiceAccount
    controller_manager->>KubernetesAPI: Create/Update Deployment
    controller_manager->>KubernetesAPI: Create/Update NetworkPolicy
    controller_manager->>KubernetesAPI: Create/Update Role
    controller_manager->>KubernetesAPI: Create/Update RoleBinding
    controller_manager->>KubernetesAPI: Create/Update Route

    Note over controller_manager: Exposed Services
    Note right of controller_manager: mariadb:3306/TCP []
    Note right of controller_manager: minio:9000/TCP [https]
    Note right of controller_manager: minio:9001/TCP [console]
    Note right of controller_manager: pypi-server:8080/TCP [pypi-server]

    Note over KubernetesAPI: Defined CRDs
    Note right of KubernetesAPI: DataSciencePipelinesApplication (datasciencepipelinesapplications.opendatahub.io/v1)
    Note right of KubernetesAPI: ScheduledWorkflow (kubeflow.org/v1beta1)
    Note right of KubernetesAPI: Pipeline (pipelines.kubeflow.org/v2beta1)
    Note right of KubernetesAPI: PipelineVersion (pipelines.kubeflow.org/v2beta1)

Configuration¶

ConfigMaps and Helm values that control this component's runtime behavior.

ConfigMaps¶

Name	Data Keys	Source
custom-ui-configmap	viewer-pod-template.json	`config/samples/custom-configs/ui-configmap.yaml`
custom-workflow-controller-configmap	artifactRepository, executor	`config/samples/custom-workflow-controller-config/custom-workflow-controller-configmap.yaml`
ds-pipeline-server-config-testdsp0	config.json	`controllers/testdata/declarative/case_0/expected/created/configmap_server_config.yaml`
ds-pipeline-server-config-testdspa	config.json	`controllers/testdata/declarative/case_7/expected/created/configmap_server_config.yaml`
dsp-trusted-ca-testdsp5	testcabundleconfigmapkey5.crt	`controllers/testdata/declarative/case_5/expected/created/configmap_dspa_trusted_ca.yaml`
workflow-controller-configmap		`config/argo/configmap.workflow-controller-configmap.yaml`