data-science-pipelines: Dataflow¶

Controller Watches¶

Kubernetes resources this controller monitors for changes. Each watch triggers reconciliation when the watched resource is created, updated, or deleted.

No controller watches found.

Reconciliation Flow¶

How the controller interacts with the Kubernetes API during reconciliation.

sequenceDiagram
    %% Static dataflow for data-science-pipelines

    participant KubernetesAPI as Kubernetes API
    participant cache_server as cache-server
    participant kubeflow_pipelines_profile_controller as kubeflow-pipelines-profile-controller
    participant metadata_writer as metadata-writer
    participant ml_pipeline as ml-pipeline
    participant ml_pipeline_persistenceagent as ml-pipeline-persistenceagent
    participant ml_pipeline_scheduledworkflow as ml-pipeline-scheduledworkflow
    participant ml_pipeline_ui as ml-pipeline-ui
    participant ml_pipeline_viewer_crd as ml-pipeline-viewer-crd
    participant squid as squid


    Note over cache_server: Exposed Services
    Note right of cache_server: kubeflow-pipelines-profile-controller:80/TCP [http]
    Note right of cache_server: squid:3128/TCP []

    Note over KubernetesAPI: Defined CRDs
    Note right of KubernetesAPI: CompositeController (metacontroller.k8s.io/v1alpha1)
    Note right of KubernetesAPI: ControllerRevision (metacontroller.k8s.io/v1alpha1)
    Note right of KubernetesAPI: DecoratorController (metacontroller.k8s.io/v1alpha1)

HTTP Endpoints¶

Method	Path	Source
*	/apis/v1beta1/runs/{run_id}/nodes/{node_id}/artifacts/{artifact_name}:read	`backend/src/apiserver/main.go:523`
*	/apis/v2beta1/runs/{run_id}/nodes/{node_id}/artifacts/{artifact_name}:read	`backend/src/apiserver/main.go:524`
*	/metrics	`backend/src/crd/controller/scheduledworkflow/main.go:170`

Configuration¶

ConfigMaps and Helm values that control this component's runtime behavior.

ConfigMaps¶

Name	Data Keys	Source
envoy-config	envoy-config.yaml	`manifests/kustomize/env/cert-manager/platform-agnostic-standalone-tls/patches/metadata-envoy-configmap.yaml`
inverse-proxy-config		`manifests/kustomize/env/gcp/inverse-proxy/proxy-configmap.yaml`
kfp-launcher	defaultPipelineRoot	`manifests/kustomize/base/pipeline/kfp-launcher-configmap.yaml`
metadata-envoy-configmap	envoy-config.yaml	`manifests/kustomize/base/metadata/base/metadata-envoy-configmap.yaml`
metadata-grpc-configmap	METADATA_GRPC_SERVICE_HOST, METADATA_GRPC_SERVICE_PORT	`manifests/kustomize/base/metadata/base/metadata-grpc-configmap.yaml`
ml-pipeline-ui-configmap	viewer-pod-template.json	`manifests/kustomize/base/installs/multi-user/pipelines-ui/configmap-patch.yaml`
ml-pipeline-ui-configmap	viewer-pod-template.json	`manifests/kustomize/base/pipeline/ml-pipeline-ui-configmap.yaml`
workflow-controller-configmap	artifactRepository, executor	`manifests/kustomize/third-party/argo/base/workflow-controller-configmap-patch.yaml`

Helm¶

Chart: kubeflow-pipelines v1.0.0