llm-d-inference-scheduler: Network¶
Service Map¶
graph LR
classDef svc fill:#2ecc71,stroke:#27ae60,color:#fff
classDef test fill:#95a5a6,stroke:#7f8c8d,color:#fff
classDef component fill:#3498db,stroke:#2980b9,color:#fff
classDef ext fill:#e74c3c,stroke:#c0392b,color:#fff
llm_d_inference_scheduler["llm-d-inference-scheduler"]:::component
llm_d_inference_scheduler --> svc_0["${EPP_NAME}\nClusterIP: 5557/TCP,9002/TCP,9090/TCP"]:::svc
llm_d_inference_scheduler --> svc_1["inference-gateway-istio-nodeport\nNodePort: 15021/TCP,80/TCP"]:::svc
llm_d_inference_scheduler --> svc_2["istiod-llm-d-gateway\nClusterIP: 15010/TCP,15012/TCP,15014/TCP,443/TCP"]:::svc
llm_d_inference_scheduler --> svc_3["service\nClusterIP: 8080/TCP"]:::svc
llm_d_inference_scheduler --> svc_4["uvicorn-server\npython-source: 8000/TCP"]:::svc
llm_d_inference_scheduler -.-> ext_redis[["redis\ndatabase"]]:::ext
llm_d_inference_scheduler -.-> ext_grpc[["grpc\ngrpc"]]:::extServices¶
| Name | Type | Ports | Source |
|---|---|---|---|
| ${EPP_NAME} | ClusterIP | 9002/TCP, 5557/TCP, 9090/TCP | deploy/components/inference-gateway/services.yaml |
| inference-gateway-istio-nodeport | NodePort | 15021/TCP, 80/TCP | deploy/environments/dev/base-kind-istio/services.yaml |
| istiod-llm-d-gateway | ClusterIP | 15010/TCP, 15012/TCP, 443/TCP, 15014/TCP | deploy/components/istio-control-plane/services.yaml |
| service | ClusterIP | 8080/TCP | deploy/environments/kubernetes-base/common/service.yaml |
| uvicorn-server | python-source | 8000/TCP | .gomod-cache/sigs.k8s.io/gateway-api-inference-extension@v1.5.0/latencypredictor/training_server.py:2171 |
Ingress / Routing¶
No Network Policies
No NetworkPolicy resources were found in the analyzed sources. Network policies may exist in overlays, Helm values, or cluster-level configurations not captured by static analysis.