AI Bug Automation Readiness

149 repositories across 2 orgs · 2026-05-11 09:06

122/148
Code Repos Assessed
54/100
Average Score
18
Ready
47
Partially Ready
24
Needs Work
33
Not Ready

Bug Bash Shortlist #

Ready (score 80+) - 18 repos

Partially Ready (score 60-79) - can start with some gaps (47 repos)

Needs Work (score 40-59) - fix key gaps first (24 repos)

Not Ready (score <40) - significant work needed (33 repos)

Score Overview #

Score Distribution

Biggest Gaps (Lowest Avg Scores)

Bottleneck Phases

Which phase is the weakest for each repo

Bug Fix Workflow Phases #

An AI agent fixing a bug goes through these phases. Scores show ecosystem average per phase.

Understand

44/100
Can the agent understand the bug from the report and codebase context?

Navigate

72/100
Can the agent find the relevant code efficiently?

Verify

58/100
Can the agent run tests to verify the fix works?

Submit

54/100
Can the agent submit the fix following project conventions?

Repository Scores #

Repository Score Level Languages
opendatahub-operator 90 Ready Go, Shell, JavaScript
opendatahub-tests 90 Ready Python
model-metadata-collection 89 Ready Go
notebooks 87 Ready Python, Shell, TypeScript
odh-dashboard 86 Ready TypeScript, Go, JavaScript
eval-hub 86 Ready Go, Shell, Python
kube-auth-proxy 85 Ready Go, Shell, JavaScript
openclaw 84 Ready TypeScript, Kotlin, Shell
model-registry 83 Ready TypeScript, Go, Python
batch-gateway 83 Ready Go, Shell
litellm 81 Ready Python, TypeScript, JavaScript
data-science-pipelines-operator 81 Ready Go, Shell, Python
odh-ide-extensions 81 Ready Python, TypeScript, JavaScript
mlflow-operator 80 Ready Python, Go, Shell
model-registry-operator 80 Ready Go, Shell
odh-cli 80 Ready Go
ogx 80 Ready Python, TypeScript, Shell
feast 80 Ready Python, TypeScript, Go
spark-operator 79 Partially Ready Go, Shell, Python
llm-d-inference-scheduler 78 Partially Ready Go, Shell
llama-stack-provider-trustyai-garak 78 Partially Ready Python
workload-variant-autoscaler 78 Partially Ready Go, Shell, Python
pipelines-components 77 Partially Ready Python, Shell
kserve-autogluon-server 76 Partially Ready Python, Go, Shell
mlflow 76 Partially Ready Python, TypeScript, JavaScript
modelmesh-serving 75 Partially Ready Go, Shell, Python
NeMo-Guardrails 74 Partially Ready Python, JavaScript, Shell
kuberay 74 Partially Ready Go, Python, TypeScript
argo-workflows 74 Partially Ready Go, Python, TypeScript
data-science-pipelines 72 Partially Ready Python, TypeScript, Go
kubeflow 71 Partially Ready Go, Shell
odh-platform-utilities 71 Partially Ready Go
base-containers 70 Partially Ready Python, Shell
kubeflow-sdk 70 Partially Ready Python
semantic-router 70 Partially Ready Go, TypeScript, Python
ogx-k8s-operator 70 Partially Ready Go, Shell
training-operator 69 Partially Ready Go, Python, Shell
kserve 69 Partially Ready Python, Go, Shell
rhoai-mcp 69 Partially Ready Python
mod-arch-library 68 Partially Ready TypeScript, Go, JavaScript
model-registry-bf4-kf 68 Partially Ready Go, Python, Shell
odh-model-controller 67 Partially Ready Go, Shell
trainer 67 Partially Ready Python, Go, Rust
trustyai-service-operator 67 Partially Ready Go, Shell
trainer-sdk 67 Partially Ready Python, Go, Shell
rhaii-cluster-validation 66 Partially Ready Go
kagenti-operator 66 Partially Ready Go, Shell
models-as-a-service 66 Partially Ready Go, Shell, Python
llm-d-kv-cache 65 Partially Ready Go, Python, C++
modelmesh-runtime-adapter 64 Partially Ready Go, Shell
openrag 64 Partially Ready TypeScript, Python
langfuse 64 Partially Ready TypeScript, Shell, JavaScript
codeflare-operator 63 Partially Ready Go, Shell
codeflare-operator-poc 63 Partially Ready Go, Shell
training-notebooks 63 Partially Ready Python, Shell, TypeScript
kube-authkit 62 Partially Ready Python
rhoai-observability-mcp 62 Partially Ready Python
MLServer 62 Partially Ready Python, Shell, JavaScript
caikit-nlp 62 Partially Ready Python, Shell
ai-gateway-payload-processing 60 Partially Ready Go, Shell
kube-rbac-proxy 60 Partially Ready Go, Shell
opencode 60 Partially Ready TypeScript, Rust, JavaScript
trustyai-explainability 60 Partially Ready Java, Python
operator-chaos 60 Partially Ready Go, TypeScript
ai-helpers 60 Partially Ready Python, Shell
mcp-server-operator 59 Needs Work Go
elyra 58 Needs Work Python, TypeScript, JavaScript
kueue (verify gate applied) 58 Needs Work Go, JavaScript, Shell
rest-proxy 57 Needs Work Go
odh-test-gen 55 Needs Work Python
elyra-pipeline-editor 55 Needs Work TypeScript, JavaScript
mlflow-go 55 Needs Work Go
caikit-nlp-client 55 Needs Work Python
distributed-workloads (verify gate applied) 53 Needs Work Go, Python, Shell
vllm-tgis-adapter 53 Needs Work Python
llm-d-batch-gateway-operator 52 Needs Work Go
agent-eval-harness 51 Needs Work Python
llama-stack-provider-ragas 50 Needs Work Python
lm-evaluation-harness 49 Needs Work Python, Shell
modelmesh 49 Needs Work Java, Shell
openvino.genai 48 Needs Work C++, Python, TypeScript
autogluon (verify gate applied) 48 Needs Work Python, Shell
guardrails-detectors 48 Needs Work Python
fms-guardrails-orchestrator (verify gate applied) 46 Needs Work Rust, Shell
openvino (verify gate applied) 46 Needs Work C++, Python, JavaScript
llama-stack-client-python (verify gate applied) 45 Needs Work Python
data-processing 42 Needs Work Python
ogx-distribution 40 Needs Work Shell
odh-observability 40 Needs Work Go
vllm-gaudi (verify gate applied) 39 Not Ready Python, Shell, C++
openvino_model_server (verify gate applied) 38 Not Ready C++, Python, Shell
gpt-researcher (verify gate applied) 38 Not Ready Python, TypeScript, JavaScript
perf_analyzer 37 Not Ready Python
elyra-examples (verify gate applied) 37 Not Ready Python
llama-stack-provider-kfp-trainer (verify gate applied) 34 Not Ready Python, Shell
openvino_contrib (verify gate applied) 34 Not Ready C++, TypeScript, Python
architecture-context (verify gate applied) 33 Not Ready Python, Go
modelcar-base-image (verify gate applied) 32 Not Ready Python, Shell
openvino_tokenizers (verify gate applied) 29 Not Ready C++, Python, JavaScript
rag (verify gate applied) 28 Not Ready Python, Go, Shell
agentic-ci (verify gate applied) 27 Not Ready Python
client (verify gate applied) 24 Not Ready Python, Java
caikit-tgis-serving (verify gate applied) 23 Not Ready Shell
fips-compliance-checker-claude-code-plugin (verify gate applied) 23 Not Ready Python, Shell
odh-s2i-project-cds (verify gate applied) 18 Not Ready Python
ml-metadata (verify gate applied) 17 Not Ready Python, Go, Shell
vllm-orchestrator-gateway (verify gate applied) 17 Not Ready Rust
autofix-skills (verify gate applied) 16 Not Ready Python, Shell
llama-stack-provider-kft (verify gate applied) 16 Not Ready Python
llama-stack-provider-instructlab-train (verify gate applied) 14 Not Ready Python
odh-s2i-project-cookiecutter (verify gate applied) 13 Not Ready Python
agents (verify gate applied) 13 Not Ready Python, Go, Shell
odh-gitops (verify gate applied) 10 Not Ready Shell
skills-registry (verify gate applied) 10 Not Ready Python
opendatahub.io (verify gate applied) 9 Not Ready TypeScript
odh-konflux-central (verify gate applied) 7 Not Ready Shell
model-runtimes-agent (verify gate applied) 6 Not Ready Python
knowledge-skills (verify gate applied) 5 Not Ready Unknown
llm-d-playbooks (verify gate applied) 5 Not Ready Shell, Python
odh-s2i-project-simple (verify gate applied) 4 Not Ready Python
aiops-infra (verify gate applied) 4 Not Ready Shell, Python
dsp-dev-tools (verify gate applied) 4 Not Ready Python, Shell

Quick Wins (Highest Impact Actions) #

Actions that would raise the most scores across the ecosystem, sorted by estimated impact.

ActionRepos Below 40WeightHow to Fix
Bug Report Template Quality 78 repos 8% Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Test-to-Source Ratio 50 repos 15% Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
AI Context Files 72 repos 8% Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Architecture Documentation 50 repos 3% Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Coverage Configuration 65 repos 3% Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
PR Template 68 repos 2% Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
How Scoring Works #

The overall score is a weighted average of 20 checks, each scored 0-100. Checks are grouped into 4 phases of an AI bug-fixing workflow:

PhaseWeightWhat it measures
Understand24%AI Context Files (8%), Bug Report Template Quality (8%), Structured Logging / Errors (3%), Architecture Documentation (3%), Test Fixtures / Sample Data (2%)
Navigate17%Code Navigability (5%), Generated Code Ratio (2%), Build / Dependency Setup (5%), Type Safety / Static Analysis (3%), Dependency Complexity (2%)
Verify46%Test-to-Source Ratio (15%), One-Command Test Execution (11%), Coverage Configuration (3%), CI Runs Tests on PRs (10%), Test Isolation (unit vs e2e) (4%), Pre-commit / Local Hooks (3%)
Submit13%Code Ownership (CODEOWNERS) (1%), PR Template (2%), Linting / Formatting in CI (5%), Contributing / Dev Guide (5%)

Verify Phase Gate: If a repo's average Verify score is below 50, the overall score receives a smooth penalty multiplier that scales linearly from x0.4 (verify avg = 0) to x1.0 (verify avg = 50). This reflects that without test infrastructure, autonomous bug fixing is not viable.

Readiness levels: Ready (80+), Partially Ready (60-79), Needs Work (40-59), Not Ready (<40).

All Checks Ranked by Average Score #
CheckAvg ScoreWeight
Bug Report Template Quality34 8%
Architecture Documentation35 3%
AI Context Files36 8%
PR Template37 2%
Coverage Configuration38 3%
Test-to-Source Ratio47 15%
Build / Dependency Setup50 5%
Test Fixtures / Sample Data50 2%
Pre-commit / Local Hooks51 3%
Code Ownership (CODEOWNERS)52 1%
One-Command Test Execution61 11%
Contributing / Dev Guide62 5%
Structured Logging / Errors64 3%
Linting / Formatting in CI64 5%
Type Safety / Static Analysis67 3%
Code Navigability74 5%
Dependency Complexity75 2%
Test Isolation (unit vs e2e)76 4%
CI Runs Tests on PRs77 10%
Generated Code Ratio95 2%
Detailed Heatmap #

Green (80+) = ready, Yellow (40-79) = partial, Red (<40) = gap.

RepositoryScore AI Context Files Bug Report Template Quality Structured Logging / Errors Architecture Documentation Test Fixtures / Sample Data Code Navigability Generated Code Ratio Build / Dependency Setup Type Safety / Static Analysis Dependency Complexity Code Ownership (CODEOWNERS) Test-to-Source Ratio One-Command Test Execution Coverage Configuration CI Runs Tests on PRs PR Template Linting / Formatting in CI Contributing / Dev Guide Test Isolation (unit vs e2e) Pre-commit / Local Hooks
opendatahub-operator90 100 100 100 100 60 70 100 80 80 90 100 70 100 100 100 100 80 100 85 100
opendatahub-tests90 92 100 90 40 80 70 100 90 80 90 100 N/A 80 N/A 100 100 100 100 N/A 100
model-metadata-collection89 92 100 100 80 80 70 100 90 80 70 100 85 90 80 100 85 80 100 90 90
notebooks87 100 100 90 100 90 70 100 90 80 90 100 38 100 100 100 100 100 100 100 100
odh-dashboard86 100 100 20 100 60 90 100 90 80 90 100 70 80 80 100 100 100 90 90 70
eval-hub86 100 90 100 80 60 70 100 90 80 70 100 85 80 100 70 85 80 100 90 100
kube-auth-proxy85 92 100 90 70 80 90 100 100 80 90 100 85 100 80 30 85 80 100 90 100
openclaw84 100 100 20 40 90 70 100 70 90 90 100 100 60 60 100 100 80 80 90 100
model-registry83 100 100 90 40 70 70 80 90 80 90 100 38 100 100 100 100 80 100 90 90
batch-gateway83 68 100 100 40 90 70 100 80 80 90 60 70 100 80 100 85 80 60 90 100
litellm81 100 65 70 40 60 70 100 80 80 90 0 64 100 0 100 100 100 100 100 100
data-science-pipelines-operator81 100 100 100 30 90 70 100 90 80 50 100 64 100 80 100 85 80 0 85 90
odh-ide-extensions81 92 100 70 55 80 90 100 60 90 90 100 64 80 80 100 85 40 100 90 70
mlflow-operator80 80 100 100 70 80 70 100 90 80 50 100 75 90 80 100 85 80 40 90 0
model-registry-operator80 100 85 100 70 90 70 80 90 80 30 100 50 80 80 100 85 80 100 70 90
odh-cli80 100 0 90 70 60 90 100 90 80 90 100 70 90 80 100 100 80 90 90 100
ogx80 100 100 90 80 60 70 100 60 80 90 60 50 60 80 100 70 100 100 90 100
feast80 100 90 90 70 90 70 100 80 80 90 100 35 100 80 100 85 80 50 90 90
spark-operator79 80 100 100 40 90 70 60 70 80 50 60 70 90 100 100 100 80 50 70 70
llm-d-inference-scheduler78 0 70 100 80 70 70 100 80 80 90 100 85 100 100 100 70 80 100 90 0
llama-stack-provider-trustyai-garak78 100 100 100 70 60 30 100 30 80 10 60 50 90 80 100 85 80 100 90 100
workload-variant-autoscaler78 100 0 90 40 90 70 100 90 80 90 100 85 80 80 100 0 80 100 90 70
pipelines-components77 68 100 20 40 60 90 100 70 50 90 100 43 80 100 100 85 100 100 90 100
kserve-autogluon-server76 100 80 90 40 70 30 80 70 80 90 100 43 100 80 100 100 80 50 90 90
mlflow76 80 100 70 80 90 50 100 60 80 90 100 53 60 0 100 85 100 100 90 100
modelmesh-serving75 0 100 100 40 90 90 80 90 80 70 100 50 100 80 100 85 100 50 70 90
NeMo-Guardrails74 44 100 90 40 90 70 100 80 70 90 0 64 80 80 70 0 80 100 90 100
kuberay74 0 95 90 40 0 70 60 60 80 90 60 85 100 0 100 100 100 70 70 100
argo-workflows74 0 90 90 80 90 90 80 100 80 90 60 50 100 80 100 85 80 70 90 0
data-science-pipelines72 100 15 90 40 90 70 80 60 80 90 100 53 80 0 100 85 100 70 90 100
kubeflow71 100 15 100 80 0 70 100 0 80 80 100 70 100 80 100 0 80 50 70 90
odh-platform-utilities71 92 0 90 15 60 90 100 60 80 50 0 70 80 100 100 0 80 70 90 100
base-containers70 100 100 20 0 40 70 100 0 80 80 0 85 60 0 100 85 80 100 90 0
kubeflow-sdk70 100 55 20 40 80 30 100 60 50 90 100 38 80 100 100 100 80 80 90 90
semantic-router70 80 15 70 40 70 70 100 0 80 80 60 50 100 60 100 55 100 100 90 90
ogx-k8s-operator70 0 15 100 0 80 70 100 90 80 50 60 85 90 100 100 0 100 100 50 70
training-operator69 0 55 90 40 90 90 60 80 80 90 100 38 80 80 100 70 100 90 90 100
kserve69 0 80 90 40 70 30 80 70 80 90 100 43 100 100 100 100 80 60 90 90
rhoai-mcp69 100 0 20 40 60 70 100 90 80 90 0 53 100 80 100 0 80 100 90 0
mod-arch-library68 100 0 70 80 40 90 100 60 80 80 100 53 80 60 100 100 0 90 90 70
model-registry-bf4-kf68 0 85 70 15 60 70 20 90 80 50 100 38 80 100 100 85 80 100 90 90
odh-model-controller67 0 0 100 30 80 90 100 100 80 50 100 70 90 80 100 85 80 40 70 90
trainer67 0 55 90 40 90 90 80 60 80 90 100 13 100 80 100 70 100 90 100 90
trustyai-service-operator67 100 0 100 30 60 70 100 90 80 70 0 50 90 80 100 0 80 70 70 0
trainer-sdk67 0 55 90 40 60 90 80 60 80 90 100 13 100 80 100 70 100 100 90 90
rhaii-cluster-validation66 100 0 90 15 60 70 100 80 80 50 0 85 80 0 100 0 80 40 90 0
kagenti-operator66 68 0 100 15 0 70 100 0 80 80 100 85 100 0 100 0 100 50 90 70
models-as-a-service66 100 0 100 40 40 50 100 0 80 80 100 53 90 60 100 0 100 100 90 0
llm-d-kv-cache65 0 0 100 80 90 90 100 90 80 70 100 53 100 0 100 0 80 50 90 100
modelmesh-runtime-adapter64 0 0 100 40 0 90 60 90 80 50 100 70 100 0 100 40 80 50 90 90
openrag64 0 100 90 40 60 70 100 90 50 90 0 25 100 0 100 0 40 100 90 70
langfuse64 100 80 70 40 0 70 100 70 0 80 30 50 0 0 100 100 100 100 90 70
codeflare-operator63 0 0 90 0 50 70 100 90 80 10 100 64 90 80 100 0 100 100 30 90
codeflare-operator-poc63 0 0 90 0 50 70 100 90 80 10 100 64 90 80 100 0 100 100 30 90
training-notebooks63 0 80 100 40 60 70 100 60 80 90 100 25 70 0 100 0 100 90 90 100
kube-authkit62 0 0 70 15 60 70 100 60 70 90 0 100 60 80 100 0 80 90 90 0
rhoai-observability-mcp62 0 0 50 15 40 90 100 90 80 90 0 85 60 80 100 0 80 90 90 0
MLServer62 0 0 70 40 90 90 100 90 80 80 100 64 80 0 100 0 80 90 90 0
caikit-nlp62 0 100 70 15 90 70 100 10 50 90 60 53 60 0 100 0 80 90 90 90
ai-gateway-payload-processing60 0 0 100 40 40 70 100 70 80 30 100 85 100 80 100 0 40 0 90 0
kube-rbac-proxy60 0 0 90 40 90 90 100 90 80 30 100 75 100 0 100 0 80 0 70 0
opencode60 56 80 20 40 60 70 100 10 80 90 100 70 80 0 30 85 0 100 90 70
trustyai-explainability60 0 100 0 40 0 90 100 10 80 80 60 70 80 0 100 55 0 100 90 0
operator-chaos60 0 0 90 0 80 70 100 90 80 90 0 85 80 0 100 0 80 40 90 0
ai-helpers60 100 15 20 40 40 70 100 30 70 80 0 10 80 0 100 100 80 100 90 70
mcp-server-operator59 0 0 100 0 60 70 80 100 80 10 0 70 90 80 100 0 80 40 90 0
elyra58 0 15 70 40 60 70 100 60 60 90 0 38 90 80 100 0 80 50 90 70
kueue58 0 15 90 40 90 70 80 90 80 90 100 85 80 0 60 85 40 50 70 0
rest-proxy57 0 0 100 0 0 90 60 90 80 30 100 38 80 80 100 0 80 50 90 90
odh-test-gen55 0 0 20 30 40 90 100 60 70 90 0 100 60 80 100 0 0 40 90 0
elyra-pipeline-editor55 0 0 20 15 90 70 100 80 0 80 0 70 80 60 100 0 40 50 90 70
mlflow-go55 0 0 100 45 60 50 60 60 80 80 0 70 80 0 100 0 80 40 90 0
caikit-nlp-client55 0 0 70 30 90 70 100 0 50 90 0 64 60 80 100 0 80 40 90 100
distributed-workloads53 100 0 90 40 90 90 100 60 80 70 100 75 0 0 70 0 80 0 50 90
vllm-tgis-adapter53 0 0 70 15 80 90 100 0 80 90 100 38 60 80 100 0 80 40 90 90
llm-d-batch-gateway-operator52 0 0 100 0 60 70 80 90 80 10 0 85 80 0 100 0 0 40 50 0
agent-eval-harness51 100 0 20 15 40 70 100 20 50 90 0 50 90 0 100 0 0 0 90 0
llama-stack-provider-ragas50 0 0 100 15 60 90 100 70 80 50 0 38 60 60 30 0 80 90 90 100
lm-evaluation-harness49 0 0 70 40 90 90 100 0 50 90 60 10 60 0 100 0 80 100 90 100
modelmesh49 0 0 70 40 90 50 100 10 80 80 100 64 70 0 30 40 80 50 90 90
openvino.genai48 0 0 70 40 90 70 100 0 80 90 100 38 0 0 100 100 100 70 90 90
autogluon48 100 100 70 40 90 70 100 0 50 80 0 38 0 0 30 40 80 80 90 90
guardrails-detectors48 0 0 70 30 60 70 100 0 50 80 0 85 60 0 100 0 0 40 90 0
fms-guardrails-orchestrator46 0 100 0 15 60 30 100 60 80 80 60 25 0 0 100 0 80 70 90 70
openvino46 0 15 70 40 90 70 100 0 80 80 100 43 0 60 100 40 80 70 90 0
llama-stack-client-python45 0 0 20 15 60 90 100 70 80 90 60 19 60 0 30 0 80 100 90 100
data-processing42 0 0 70 40 0 70 100 0 0 80 60 25 60 0 100 0 80 0 90 90
ogx-distribution40 0 0 20 30 0 70 100 0 0 80 100 43 0 0 100 70 100 40 70 90
odh-observability40 0 0 100 0 0 70 100 90 80 10 0 50 80 80 0 0 40 0 90 0
vllm-gaudi39 0 15 70 40 90 70 100 10 80 80 60 53 60 0 30 40 80 50 90 0
openvino_model_server38 0 15 70 40 50 70 100 60 80 80 100 35 0 50 70 85 0 100 90 0
gpt-researcher38 80 100 90 40 40 90 100 10 70 90 0 13 60 0 30 0 0 70 90 0
perf_analyzer37 0 0 20 15 40 90 100 10 50 80 0 19 0 0 100 0 80 40 90 100
elyra-examples37 0 0 100 40 40 90 100 0 0 80 0 19 100 0 30 85 80 50 90 0
llama-stack-provider-kfp-trainer34 0 0 20 0 0 90 100 10 80 70 0 25 60 0 100 0 0 0 90 0
openvino_contrib34 0 15 70 40 0 90 100 0 80 80 100 25 0 0 100 0 80 60 90 0
architecture-context33 0 0 20 40 0 70 100 80 80 90 0 10 90 0 30 0 80 40 90 0
modelcar-base-image32 0 0 70 15 0 90 100 70 50 80 0 38 80 0 30 0 0 0 90 0
openvino_tokenizers29 0 15 70 15 40 70 100 60 80 90 0 19 0 0 100 0 0 40 90 0
rag28 0 0 70 40 0 70 100 0 80 80 100 19 0 0 30 0 80 90 70 90
agentic-ci27 0 0 0 0 0 70 100 0 0 80 0 13 60 0 100 0 0 0 90 0
client24 0 0 20 40 0 70 100 0 80 80 0 10 0 0 30 0 80 40 90 100
caikit-tgis-serving23 0 0 20 30 0 90 100 70 0 80 100 43 0 0 30 0 0 100 90 0
fips-compliance-checker-claude-code-plugin23 44 0 0 15 80 70 100 0 70 80 0 75 0 0 0 0 0 40 90 0
odh-s2i-project-cds18 0 0 20 0 0 90 100 0 0 90 0 13 60 0 0 0 40 40 90 0
ml-metadata17 0 0 20 15 40 30 100 0 80 80 0 38 0 0 30 0 0 50 90 0
vllm-orchestrator-gateway17 0 0 0 0 0 50 100 70 80 80 0 0 0 0 100 0 80 40 0 0
autofix-skills16 100 50 20 0 0 70 100 0 70 80 0 0 0 0 30 100 80 90 0 0
llama-stack-provider-kft16 0 0 70 0 0 90 100 70 50 50 0 0 0 0 30 0 80 0 0 90
llama-stack-provider-instructlab-train14 0 0 20 0 0 90 100 60 50 30 0 0 0 0 30 0 80 0 0 90
odh-s2i-project-cookiecutter13 0 0 0 15 0 90 100 0 0 70 0 50 0 0 0 0 0 0 90 0
agents13 56 0 70 70 90 90 100 0 80 80 0 13 0 0 0 0 0 0 50 0
odh-gitops10 0 0 0 30 0 70 100 0 0 80 0 0 0 0 30 100 80 90 0 0
skills-registry10 56 0 0 40 0 70 100 0 70 80 0 0 0 0 30 0 0 60 0 0
opendatahub.io9 0 0 0 0 0 90 100 60 90 90 0 0 0 0 30 0 0 70 0 0
odh-konflux-central7 0 0 0 30 0 70 100 0 0 80 0 0 0 0 30 0 80 0 0 0
model-runtimes-agent6 44 0 70 0 0 50 100 0 70 90 0 0 0 0 0 0 0 40 0 0
knowledge-skills5 56 0 0 0 0 90 100 0 0 80 0 0 0 0 0 0 0 0 0 0
llm-d-playbooks5 0 0 0 40 0 90 100 0 70 80 0 0 0 0 0 0 0 0 0 0
odh-s2i-project-simple4 0 0 0 0 0 90 100 0 0 70 0 0 0 0 0 0 0 40 0 0
aiops-infra4 0 0 0 0 0 70 100 0 70 80 0 0 0 0 0 0 0 0 0 0
dsp-dev-tools4 0 0 0 40 0 90 100 0 0 80 0 0 0 0 0 0 0 0 0 0
Per-Repository Details #
opendatahub-operator 90/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (16/50 sampled files)
  • Error wrapping patterns (22 files)
Architecture DocumentationUnderstand3%100
  • Architecture doc: docs/DESIGN.md
  • ADR directory: docs/adr (1 records)
  • 7 module-level READMEs
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: config/samples (4 files)
Code NavigabilityNavigate5%70
  • Average file: 216 lines (619 source files, generated excluded)
  • Files >500 lines: 62 (10%)
  • Largest: monitoring_test.go (3187L), mutating_test.go (2768L), test_context_test.go (2245L)
Generated Code RatioNavigate2%100
  • 15/634 files are generated (2%)
  • Examples: zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 127 direct dependencies / 619 source files (ratio: 0.21)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%70
  • 232 test files / 387 source files (ratio: 0.60)
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, unit-test, e2e, e2e-test, e2e-test, unit-test-cli
  • Multiple test types available
Coverage ConfigurationVerify3%100
  • Codecov configured
  • Go coverage flags in Makefile
  • Coverage in CI workflow: test-unit.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 6 CI workflow(s): test-unit-cli.yaml, test-unit.yaml, test-gateway-integration.yaml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: test-linter.yaml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%85
  • ~56% unit tests, ~44% infra-dependent (14/25 sampled)
  • Makefile separates unit and integration test targets
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
opendatahub-tests 90/100 - Ready test-repo
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%92
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in pyproject.toml
  • Some logging (12/50 sampled files)
  • Error wrapping patterns (8 files)
Architecture DocumentationUnderstand3%40
  • 12 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: tests/fixtures (6 files)
Code NavigabilityNavigate5%70
  • Average file: 178 lines (443 source files, generated excluded)
  • Files >500 lines: 34 (8%)
  • Largest: test_evalhub_jobs_mt.py (1494L), conftest.py (1255L), infra.py (1213L)
Generated Code RatioNavigate2%100
  • 0/519 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 32 direct dependencies / 519 source files (ratio: 0.06)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 9 rules
Test-to-Source RatioVerify15%N/AExcluded by profile
One-Command Test ExecutionVerify11%80
  • Makefile targets: check
  • tox.ini found
  • pytest.ini found
Coverage ConfigurationVerify3%N/AExcluded by profile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): tox-tests.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting via pre-commit.ci (ci: key in .pre-commit-config.yaml)
Contributing / Dev GuideSubmit5%100
  • Found: docs/DEVELOPER_GUIDE.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%N/AExcluded by profile
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
model-metadata-collection 89/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%92
  • CLAUDE.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (17/50 sampled files)
  • Error wrapping patterns (20 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: ARCHITECTURE.md
  • 5 module-level READMEs
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: testdata (9 files)
Code NavigabilityNavigate5%70
  • Average file: 313 lines (51 source files, generated excluded)
  • Files >500 lines: 10 (20%)
  • Largest: catalog_test.go (1396L), registry_test.go (966L), main.go (925L)
Generated Code RatioNavigate2%100
  • 0/51 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%70
  • 29 direct dependencies / 51 source files (ratio: 0.57)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 4 rules
Test-to-Source RatioVerify15%85
  • 23 test files / 28 source files (ratio: 0.82)
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, check
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): build-and-push-static-model-catalog-data.yml, ci.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~96% unit tests, ~4% infra-dependent (22/23 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
notebooks 87/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in pyproject.toml
  • Some logging (12/50 sampled files)
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%100
  • Architecture doc: ARCHITECTURE.md
  • ADR directory: docs/adr (12 records)
  • 25 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/testdata, examples (14 files)
Code NavigabilityNavigate5%70
  • Average file: 181 lines (149 source files, generated excluded)
  • Files >500 lines: 14 (9%)
  • Largest: check-params-env.sh (922L), konflux_generate_component_build_pipelines.py (876L), test_main.py (824L)
Generated Code RatioNavigate2%100
  • 0/156 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 40 direct dependencies / 156 source files (ratio: 0.26)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 28 entries
Test-to-Source RatioVerify15%38
  • 43 test files / 113 source files (ratio: 0.38)
  • Mixed test quality: 12/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-integration, unit-test, integration-test
  • Multiple test types available
  • pytest.ini found
Coverage ConfigurationVerify3%100
  • Codecov configured
  • Go coverage flags in Makefile
  • Coverage in CI workflow: test-containers.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): build-notebooks-TEMPLATE.yaml, piplock-renewal.yaml, software-versions.yaml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: sec-scan.yml, pr-notifications.yml, auto-add-issue-to-project.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%100
  • ~80% unit tests, ~20% infra-dependent (24/30 sampled)
  • Makefile separates unit and integration test targets
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
odh-dashboard 86/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (4 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%100
  • Architecture doc: docs/architecture.md
  • ADR directory: docs/adr (4 records)
  • 73 module-level READMEs
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 4/20 sampled test files
Code NavigabilityNavigate5%90
  • Average file: 131 lines (6309 source files, generated excluded)
  • Files >500 lines: 249 (4%)
  • Largest: mockPipelineSpec.ts (5220L), docs.go (3167L), modelServingDeploy.cy.ts (2885L)
Generated Code RatioNavigate2%100
  • 60/6379 files are generated (1%)
  • Examples: http_mock.go, client_mock.go, mock_factory.go, token_k8s_client_mock.go, internal_k8s_client_mock.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: npm lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 6 direct dependencies / 6319 source files (ratio: 0.00)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%70
  • 1375 test files / 4944 source files (ratio: 0.28)
  • Frontend-heavy repo (relaxed thresholds)
One-Command Test ExecutionVerify11%80
  • Makefile targets: packages/maas/test
  • npm test script defined
Coverage ConfigurationVerify3%80
  • Codecov configured
  • Coverage in CI workflow: test.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 8 CI workflow(s): test.yml, maas-bff-tests.yml, eval-hub-frontend-tests.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: eval-hub-bff-tests.yml, agentready-weekly.yml, maas-bff-tests.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~90% unit tests, ~10% infra-dependent (26/29 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
  • .husky/ directory found
eval-hub 86/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (2/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%90
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (25/50 sampled files)
  • Error wrapping patterns (17 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: ARCHITECTURE.md
  • 8 module-level READMEs
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (1 files)
Code NavigabilityNavigate5%70
  • Average file: 204 lines (187 source files, generated excluded)
  • Files >500 lines: 20 (11%)
  • Largest: step_definitions_test.go (2341L), step_definitions_test.go (1435L), evaluations_test.go (1054L)
Generated Code RatioNavigate2%100
  • 0/187 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile, npm lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%70
  • 173 direct dependencies / 187 source files (ratio: 0.93)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 8 entries
Test-to-Source RatioVerify15%85
  • 72 test files / 115 source files (ratio: 0.63)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%100
  • Codecov configured
  • Go coverage flags in Makefile
  • Coverage in CI workflow: ci.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%70
  • CI has PR triggers and test steps, but in separate workflows
  • Tests found in 1 CI workflow(s): publish-python-server.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~70% unit tests, ~30% infra-dependent (21/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kube-auth-proxy 85/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%92
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug-report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%70
  • ADR directory: docs/adr (1 records)
  • 14 module-level READMEs
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: testdata, examples (9 files)
Code NavigabilityNavigate5%90
  • Average file: 179 lines (264 source files, generated excluded)
  • Files >500 lines: 17 (6%)
  • Largest: oauthproxy_test.go (3808L), oauthproxy.go (1534L), server_test.go (1321L)
Generated Code RatioNavigate2%100
  • 6/270 files are generated (2%)
  • Examples: mock_oidc.go, mock_oidc_test.go, mock_openshift_oauth.go, mock_openshift_oauth_test.go, mock_lock.go
Build / Dependency SetupNavigate5%100
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 91 direct dependencies / 264 source files (ratio: 0.34)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 9 rules
Test-to-Source RatioVerify15%85
  • 128 test files / 136 source files (ratio: 0.94)
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-integration, kube-rbac-proxy/test, kube-rbac-proxy/test-unit, kube-rbac-proxy/test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~81% unit tests, ~19% infra-dependent (22/27 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
openclaw 84/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (8 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 29 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: test/fixtures (20 files)
Code NavigabilityNavigate5%70
  • Average file: 189 lines (7373 source files, generated excluded)
  • Files >500 lines: 628 (9%)
  • Largest: loader.test.ts (3725L), audit.test.ts (3628L), monitor.test.ts (3127L)
Generated Code RatioNavigate2%100
  • 0/7373 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: pnpm lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%90
  • Statically typed language(s): Go
  • TypeScript strict mode enabled
Dependency ComplexityNavigate2%90
  • 45 direct dependencies / 7373 source files (ratio: 0.01)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 46 rules
Test-to-Source RatioVerify15%100
  • 2808 test files / 4565 source files (ratio: 0.62)
  • Frontend-heavy repo (relaxed thresholds)
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: ci.yml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%80
  • Found: CONTRIBUTING.md
  • 3/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (29/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
model-registry 83/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (4/7 quality keywords)
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%40
  • 21 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%70
  • Test manifests in overlay/config dirs (5 files)
Code NavigabilityNavigate5%70
  • Average file: 207 lines (1166 source files, generated excluded)
  • Files >500 lines: 105 (9%)
  • Largest: model_registry_service_api.py (16255L), artifact_test.go (3474L), model_catalog_service_api.py (3005L)
Generated Code RatioNavigate2%80
  • 188/1357 files are generated (14%)
  • Examples: model_metadata_proto_value.go, model_base_resource_create.go, model_artifact_create.go, model_artifact_list.go, model_doc_artifact.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 100 direct dependencies / 1169 source files (ratio: 0.09)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 26 entries
Test-to-Source RatioVerify15%38
  • 325 test files / 844 source files (ratio: 0.39)
  • Mixed test quality: 15/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, catalog/test, clients/python/test-e2e, clients/python/test, jobs/async-upload/test, jobs/async-upload/test-e2e, jobs/async-upload/test-integration
  • Multiple test types available
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: build.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): test-fuzz.yml, async-upload-test.yml, ui-frontend-build.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: ui-bff-build.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
batch-gateway 83/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%68
  • CLAUDE.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (18/50 sampled files)
  • Error wrapping patterns (24 files)
Architecture DocumentationUnderstand3%40
  • 5 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (10 files)
Code NavigabilityNavigate5%70
  • Average file: 306 lines (152 source files, generated excluded)
  • Files >500 lines: 23 (15%)
  • Largest: executor_test.go (2918L), redis_ds_client_test.go (2320L), preprocessor_test.go (1892L)
Generated Code RatioNavigate2%100
  • 6/158 files are generated (4%)
  • Examples: mock_db_client.go, mock_queue_client.go, mock_status_client.go, mock_event_client.go, mock_files_client.go
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 67 direct dependencies / 152 source files (ratio: 0.44)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%70
  • 55 test files / 97 source files (ratio: 0.57)
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, check, test-integration, test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci-dco-signoff.yml, ci-integration-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%60
  • Found: CONTRIBUTING.md
  • 1/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~89% unit tests, ~11% infra-dependent (25/28 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
litellm 81/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (2/7 quality keywords)
Bug Report Template QualityUnderstand8%65
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (12 files)
Architecture DocumentationUnderstand3%40
  • 46 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 281 lines (2137 source files, generated excluded)
  • Files >500 lines: 285 (13%)
  • Largest: proxy_server.py (9467L), utils.py (7739L), networking.tsx (7525L)
Generated Code RatioNavigate2%100
  • 0/2158 files are generated (0%)
Build / Dependency SetupNavigate5%80
  • Lockfiles: npm lockfile, Poetry lockfile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
  • Pyright configured
Dependency ComplexityNavigate2%90
  • 61 direct dependencies / 2158 source files (ratio: 0.03)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%64
  • 826 test files / 1332 source files (ratio: 0.62)
  • Mixed test quality: 13/20 sampled test files have assertions
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-integration
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): test-litellm.yml, llm-translation-testing.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: test-linting.yml, ghcr_helm_deploy.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%100
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
  • Makefile separates unit and integration test targets
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
data-science-pipelines-operator 81/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (20/50 sampled files)
  • Error wrapping patterns (14 files)
Architecture DocumentationUnderstand3%30
  • 4 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: config/samples, tests/resources (37 files)
Code NavigabilityNavigate5%70
  • Average file: 204 lines (73 source files, generated excluded)
  • Files >500 lines: 6 (8%)
  • Largest: apiserver_test.go (1235L), managed_pipelines_validation_test.go (1029L), dspipeline_params.go (1002L)
Generated Code RatioNavigate2%100
  • 1/74 files are generated (1%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 123 direct dependencies / 73 source files (ratio: 1.68)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 20 entries
Test-to-Source RatioVerify15%64
  • 32 test files / 41 source files (ratio: 0.78)
  • Mixed test quality: 14/20 sampled test files have assertions
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, unittest, functest
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): functests.yml, unittests.yml, nightly_tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: precommit.yml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%85
  • ~53% unit tests, ~47% infra-dependent (16/30 sampled)
  • Makefile separates unit and integration test targets
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-ide-extensions 81/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%92
  • CLAUDE.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (3/25 sampled files)
  • Error wrapping patterns (1 files)
Architecture DocumentationUnderstand3%55
  • Architecture doc: docs/ARCHITECTURE.md
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: testdata (8 files)
Code NavigabilityNavigate5%90
  • Average file: 40 lines (26 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/26 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: npm lockfile, Yarn lockfile
Type Safety / Static AnalysisNavigate3%90
  • TypeScript strict mode enabled
Dependency ComplexityNavigate2%90
  • 2 direct dependencies / 26 source files (ratio: 0.08)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 12 entries
Test-to-Source RatioVerify15%64
  • 9 test files / 17 source files (ratio: 0.53)
  • Frontend-heavy repo (relaxed thresholds)
  • Mixed test quality: 7/9 sampled test files have assertions
One-Command Test ExecutionVerify11%80
  • npm test script defined
Coverage ConfigurationVerify3%80
  • Codecov configured
  • Coverage in CI workflow: build_extension.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): build_extension.yml, build_all_extensions.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (9/9 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
mlflow-operator 80/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%80
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (24/50 sampled files)
  • Error wrapping patterns (19 files)
Architecture DocumentationUnderstand3%70
  • Architecture doc: ARCHITECTURE.md
  • 4 module-level READMEs
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: config/samples (6 files)
Code NavigabilityNavigate5%70
  • Average file: 228 lines (83 source files, generated excluded)
  • Files >500 lines: 11 (13%)
  • Largest: deploy.py (1420L), migration.go (901L), migration_test.go (717L)
Generated Code RatioNavigate2%100
  • 1/84 files are generated (1%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 117 direct dependencies / 83 source files (ratio: 1.41)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 5 entries
Test-to-Source RatioVerify15%75
  • 52 test files / 31 source files (ratio: 1.68)
  • Mixed test quality: 11/20 sampled test files have assertions
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, test-e2e
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): test.yml, upgrade-tests.yml, integration-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Getting Started
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~90% unit tests, ~10% infra-dependent (26/29 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
model-registry-operator 80/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%85
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (16/38 sampled files)
  • Error wrapping patterns (15 files)
Architecture DocumentationUnderstand3%70
  • Architecture doc: docs/architecture.md
  • 3 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: config/samples (27 files)
Code NavigabilityNavigate5%70
  • Average file: 279 lines (47 source files, generated excluded)
  • Files >500 lines: 6 (13%)
  • Largest: modelcatalog_controller_test.go (2246L), modelcatalog_controller.go (1374L), modelregistry_controller_test.go (1333L)
Generated Code RatioNavigate2%80
  • 3/50 files are generated (6%)
  • Examples: zz_generated.conversion.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%30
  • 107 direct dependencies / 47 source files (ratio: 2.28)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 26 entries
Test-to-Source RatioVerify15%50
  • 13 test files / 34 source files (ratio: 0.38)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): build.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: build.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%70
  • ~54% unit tests, ~46% infra-dependent (7/13 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-cli 80/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • AGENTS.md found (7/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (23 files)
Architecture DocumentationUnderstand3%70
  • Architecture doc: docs/design.md
  • ADR directory: docs/adr (1 records)
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/20 sampled test files
Code NavigabilityNavigate5%90
  • Average file: 199 lines (299 source files, generated excluded)
  • Files >500 lines: 19 (6%)
  • Largest: impacted.go (1463L), impacted_test.go (1328L), result_test.go (1085L)
Generated Code RatioNavigate2%100
  • 0/299 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 97 direct dependencies / 299 source files (ratio: 0.32)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 4 entries
Test-to-Source RatioVerify15%70
  • 110 test files / 189 source files (ratio: 0.58)
One-Command Test ExecutionVerify11%90
  • Makefile targets: check, test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%90
  • Found: docs/development.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~73% unit tests, ~27% infra-dependent (22/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
ogx 80/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (2/7 quality keywords)
  • AGENTS.md found (3/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in pyproject.toml
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (11 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: ARCHITECTURE.md
  • 36 module-level READMEs
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 7/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 184 lines (1130 source files, generated excluded)
  • Files >500 lines: 103 (9%)
  • Largest: test_openai_vector_stores.py (5664L), page.tsx (2191L), streaming.py (1962L)
Generated Code RatioNavigate2%100
  • 0/1130 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 17 direct dependencies / 1130 source files (ratio: 0.02)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%50
  • 311 test files / 819 source files (ratio: 0.38)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Python coverage config
  • Coverage in CI workflow: pre-commit.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 9 CI workflow(s): record-integration-tests.yml, unit-tests.yml, ui-unit-tests.yml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
Linting / Formatting in CISubmit5%100
  • Linting in CI: pre-commit.yml, post-release.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~96% unit tests, ~4% infra-dependent (25/26 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
feast 80/100 - Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%90
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Go structured logging (zerolog) found in go.mod
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%70
  • ADR directory: docs/adr (14 records)
  • 81 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (170 files)
Code NavigabilityNavigate5%70
  • Average file: 209 lines (1140 source files, generated excluded)
  • Files >500 lines: 116 (10%)
  • Largest: feature_store.py (3491L), ray.py (2632L), test_universal_registry.py (2337L)
Generated Code RatioNavigate2%100
  • 2/1291 files are generated (0%)
  • Examples: zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go, Java
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 125 direct dependencies / 1289 source files (ratio: 0.10)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (CODEOWNERS) with 18 rules
Test-to-Source RatioVerify15%35
  • 385 test files / 904 source files (ratio: 0.43)
  • Low test quality: 8/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, infra/feast-operator/test, infra/feast-operator/test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 13 CI workflow(s): operator-e2e-integration-tests.yml, pr_duckdb_integration_tests.yml, pr_ray_integration_tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: linter.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~87% unit tests, ~13% infra-dependent (26/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
spark-operator 79/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%80
  • CLAUDE.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (17/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%40
  • 7 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples, config/samples (65 files)
Code NavigabilityNavigate5%70
  • Average file: 208 lines (145 source files, generated excluded)
  • Files >500 lines: 12 (8%)
  • Largest: sparkpod_defaulter_test.go (2351L), controller.go (1472L), controller_test.go (1440L)
Generated Code RatioNavigate2%60
  • 27/172 files are generated (16%)
  • Examples: expansion_generated.go, scheduledsparkapplication.go, sparkapplication.go, clientset.go, doc.go
Build / Dependency SetupNavigate5%70
  • Lockfiles: Go lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 153 direct dependencies / 145 source files (ratio: 1.06)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%70
  • 48 test files / 97 source files (ratio: 0.49)
One-Command Test ExecutionVerify11%90
  • Makefile targets: unit-test, e2e-test
Coverage ConfigurationVerify3%100
  • Codecov configured
  • Go coverage flags in Makefile
  • Coverage in CI workflow: codecov.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): codecov.yaml, integration.yaml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: integration.yaml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~64% unit tests, ~36% infra-dependent (18/28 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
llm-d-inference-scheduler 78/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%70
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has environment/version fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (25/50 sampled files)
  • Error wrapping patterns (17 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: docs/architecture.md
  • 38 module-level READMEs
Test Fixtures / Sample DataUnderstand2%70
  • Test manifests in overlay/config dirs (17 files)
Code NavigabilityNavigate5%70
  • Average file: 208 lines (440 source files, generated excluded)
  • Files >500 lines: 36 (8%)
  • Largest: controller_test.go (1434L), director_test.go (1408L), processor_test.go (1350L)
Generated Code RatioNavigate2%100
  • 6/446 files are generated (1%)
  • Examples: vllm_engine_grpc.pb.go, vllm_engine.pb.go, data_source_mock.go, mock_server_test.go, zz_generated.register.go
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 145 direct dependencies / 440 source files (ratio: 0.33)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%85
  • 180 test files / 260 source files (ratio: 0.69)
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-integration, test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: ci-pr-checks.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci-pr-checks.yaml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci-pr-checks.yaml
Contributing / Dev GuideSubmit5%100
  • Found: DEVELOPMENT.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~90% unit tests, ~10% infra-dependent (27/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llama-stack-provider-trustyai-garak 78/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (4/7 quality keywords)
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (18/47 sampled files)
  • Error wrapping patterns (15 files)
Architecture DocumentationUnderstand3%70
  • Architecture doc: ARCHITECTURE.md
  • 4 module-level READMEs
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: tests/fixtures (3 files)
Code NavigabilityNavigate5%30
  • Average file: 394 lines (46 source files, generated excluded)
  • Files >500 lines: 12 (26%)
  • Largest: test_evalhub_adapter.py (3341L), garak_adapter.py (1596L), result_utils.py (1149L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/47 files are generated (0%)
Build / Dependency SetupNavigate5%30
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%10
  • 195 direct dependencies / 47 source files (ratio: 4.15)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%50
  • 11 test files / 36 source files (ratio: 0.31)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, check
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage-related target in Makefile
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): run-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (11/11 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
workload-variant-autoscaler 78/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (14/50 sampled files)
  • Error wrapping patterns (14 files)
Architecture DocumentationUnderstand3%40
  • 9 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: config/samples (14 files)
Code NavigabilityNavigate5%70
  • Average file: 256 lines (270 source files, generated excluded)
  • Files >500 lines: 37 (14%)
  • Largest: smoke_test.go (2377L), greedy_test.go (1684L), system_test.go (1657L)
Generated Code RatioNavigate2%100
  • 1/271 files are generated (0%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 110 direct dependencies / 270 source files (ratio: 0.41)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 16 entries
Test-to-Source RatioVerify15%85
  • 115 test files / 155 source files (ratio: 0.74)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci-pr-checks.yaml, ci-benchmark.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci-pr-checks.yaml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~93% unit tests, ~7% infra-dependent (27/29 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
pipelines-components 77/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%68
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (8 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 75 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 8/20 sampled test files
Code NavigabilityNavigate5%90
  • Average file: 120 lines (344 source files, generated excluded)
  • Files >500 lines: 16 (5%)
  • Largest: test_component_unit.py (940L), component.py (928L), test_component_unit.py (918L)
Generated Code RatioNavigate2%100
  • 0/372 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: uv lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (5/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 2 direct dependencies / 372 source files (ratio: 0.01)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 4 entries
Test-to-Source RatioVerify15%43
  • 165 test files / 207 source files (ratio: 0.80)
  • Low test quality: 7/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): component-pipeline-tests.yml, scripts-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%100
  • Linting in CI: python-lint.yml, yaml-lint.yml
Contributing / Dev GuideSubmit5%100
  • Found: docs/CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kserve-autogluon-server 76/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%80
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%40
  • 119 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%70
  • Test manifests in overlay/config dirs (14 files)
Code NavigabilityNavigate5%30
  • Average file: 777 lines (1028 source files, generated excluded)
  • Files >500 lines: 160 (16%)
  • Largest: llmisvc-full-install-with-manifests.sh (91423L), llmisvc-full-install-with-manifests.sh (90786L), llmisvc-full-install-with-manifests.sh (90744L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%80
  • 115/1160 files are generated (10%)
  • Examples: saved_model.pb.go, saver.pb.go, meta_graph.pb.go, tensor_description.pb.go, api_def.pb.go
Build / Dependency SetupNavigate5%70
  • Lockfiles: Go lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 205 direct dependencies / 1045 source files (ratio: 0.20)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 18 entries
Test-to-Source RatioVerify15%43
  • 458 test files / 587 source files (ratio: 0.78)
  • Low test quality: 9/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: check, test, tools/tf2openapi/test, python/sklearnserver/test, python/kserve/test, python/artexplainer/test, python/xgbserver/test, python/pmmlserver/test, python/predictiveserver/test, python/lgbserver/test, python/aiffairness/test, python/paddleserver/test, python/custom_model/test, python/custom_transformer/test, python/autogluonserver/test, python/huggingfaceserver/test
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): precommit-check.yml, python-test.yml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~86% unit tests, ~14% infra-dependent (24/28 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
mlflow 76/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%80
  • CLAUDE.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: ARCHITECTURE.md
  • 77 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/data, examples, tests/resources (468 files)
Code NavigabilityNavigate5%50
  • Average file: 320 lines (4223 source files, generated excluded)
  • Files >500 lines: 410 (10%)
  • Largest: Service.java (274253L), ModelRegistry.java (53284L), DatabricksArtifacts.java (23030L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/4415 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Java
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 36 direct dependencies / 4415 source files (ratio: 0.01)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 8 entries
Test-to-Source RatioVerify15%53
  • 1432 test files / 2983 source files (ratio: 0.48)
  • Mixed test quality: 13/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 10 CI workflow(s): protobuf-cross-test.yml, js.yml, docs.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%100
  • Linting in CI: js.yml, docs.yml, lint.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
modelmesh-serving 75/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (24/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%40
  • 15 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: config/samples, tests/resources (12 files)
Code NavigabilityNavigate5%90
  • Average file: 173 lines (126 source files, generated excluded)
  • Files >500 lines: 7 (6%)
  • Largest: predictor_test.go (1286L), fvtclient.go (1019L), servingruntime_controller.go (801L)
Generated Code RatioNavigate2%80
  • 14/140 files are generated (10%)
  • Examples: kfs_inference_v2.pb.go, inference.pb.go, inference_grpc.pb.go, tensor.pb.go, resource_handle.pb.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%70
  • 123 direct dependencies / 126 source files (ratio: 0.98)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 23 entries
Test-to-Source RatioVerify15%50
  • 34 test files / 92 source files (ratio: 0.37)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, e2e-test, tests/test
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): test.yml, build.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%100
  • Linting in CI: lint.yml, build.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~67% unit tests, ~33% infra-dependent (20/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
NeMo-Guardrails 74/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%44
  • CLAUDE.md found (2/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in requirements.txt
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%40
  • 96 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (360 files)
Code NavigabilityNavigate5%70
  • Average file: 223 lines (673 source files, generated excluded)
  • Files >500 lines: 66 (10%)
  • Largest: test_flow_mechanics.py (2429L), statemachine.py (2174L), config.py (2068L)
Generated Code RatioNavigate2%100
  • 0/673 files are generated (0%)
Build / Dependency SetupNavigate5%80
  • Lockfiles: Poetry lockfile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 11/20 sampled Python files
Dependency ComplexityNavigate2%90
  • 162 direct dependencies / 673 source files (ratio: 0.24)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%64
  • 299 test files / 374 source files (ratio: 0.80)
  • Mixed test quality: 13/20 sampled test files have assertions
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
  • pytest configured in pyproject.toml
  • tox.ini found
  • pytest.ini found
Coverage ConfigurationVerify3%80
  • Coverage-related target in Makefile
  • Coverage in CI workflow: pr-tests.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%70
  • CI has PR triggers and test steps, but in separate workflows
  • Tests found in 1 CI workflow(s): _test.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kuberay 74/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%95
  • Found: .github/ISSUE_TEMPLATE/bug-report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Go structured logging (zerolog) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%40
  • 11 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 217 lines (365 source files, generated excluded)
  • Files >500 lines: 38 (10%)
  • Largest: raycluster_controller_unit_test.go (3811L), raycluster_controller.go (2053L), pod_test.go (1954L)
Generated Code RatioNavigate2%60
  • 78/444 files are generated (18%)
  • Examples: utils.go, expansion_generated.go, rayjob.go, rayservice.go, raycluster.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 114 direct dependencies / 366 source files (ratio: 0.31)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%85
  • 147 test files / 219 source files (ratio: 0.67)
One-Command Test ExecutionVerify11%100
  • Makefile targets: ray-operator/test, ray-operator/test, ray-operator/test, ray-operator/test-e2e, ray-operator/test-e2e, apiserver/test, apiserver/e2e-test, apiserversdk/test, apiserversdk/test, apiserversdk/test
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): odh-release.yml, consistency-check.yaml, e2e-tests.yaml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: helm.yaml, test-job.yaml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%70
  • ~62% unit tests, ~38% infra-dependent (16/26 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
argo-workflows 74/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%90
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has reproduction steps
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (26 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: docs/architecture.md
  • 11 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (207 files)
Code NavigabilityNavigate5%90
  • Average file: 197 lines (1403 source files, generated excluded)
  • Files >500 lines: 56 (4%)
  • Largest: operator_test.go (11613L), operator.go (4259L), util_test.go (4178L)
Generated Code RatioNavigate2%80
  • 81/1484 files are generated (5%)
  • Examples: Gatekeeper.go, Interface.go, workflow-template.pb.go, workflow-template.pb.gw.go, cron-workflow.pb.go
Build / Dependency SetupNavigate5%100
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 304 direct dependencies / 1403 source files (ratio: 0.22)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%50
  • 272 test files / 1131 source files (ratio: 0.24)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, sdks/python/test, sdks/java/test
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Codecov configured
  • Coverage-related target in Makefile
  • Coverage in CI workflow: ci-build.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): release.yaml, ci-build.yaml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci-build.yaml
Contributing / Dev GuideSubmit5%70
  • Found: docs/CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~81% unit tests, ~19% infra-dependent (21/26 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
data-science-pipelines 72/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (6/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (7) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (8/50 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%40
  • 90 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: samples (53 files)
Code NavigabilityNavigate5%70
  • Average file: 189 lines (2517 source files, generated excluded)
  • Files >500 lines: 184 (7%)
  • Largest: large-graph-runtime.ts (12660L), pipeline_spec.ts (11299L), compiler_test.py (6662L)
Generated Code RatioNavigate2%80
  • 395/2937 files are generated (13%)
  • Examples: expansion_generated.go, scheduledworkflow.go, clientset.go, doc.go, doc.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
  • mypy.ini found
Dependency ComplexityNavigate2%90
  • 249 direct dependencies / 2542 source files (ratio: 0.10)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 17 entries
Test-to-Source RatioVerify15%53
  • 731 test files / 1811 source files (ratio: 0.40)
  • Mixed test quality: 13/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: manifests/kustomize/test
  • pytest.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 13 CI workflow(s): gcpc-modules-tests.yml, integration-tests-v1.yml, backend-visualization.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%100
  • Linting in CI: pre-commit.yml, sdk-isort.yml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (28/29 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kubeflow 71/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (6/7 quality keywords)
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (1) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (22/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: ARCHITECTURE.md
  • 9 module-level READMEs
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 288 lines (64 source files, generated excluded)
  • Files >500 lines: 12 (19%)
  • Largest: notebook_controller_test.go (1992L), notebook_mutating_webhook.go (972L), notebook_controller.go (883L)
Generated Code RatioNavigate2%100
  • 3/67 files are generated (4%)
  • Examples: zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 22 entries
Test-to-Source RatioVerify15%70
  • 22 test files / 42 source files (ratio: 0.52)
One-Command Test ExecutionVerify11%100
  • Makefile targets: components/notebook-controller/test, components/odh-notebook-controller/test, components/odh-notebook-controller/e2e-test
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Codecov configured
  • Coverage in CI workflow: odh_notebook_controller_unit_test.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): odh_notebook_controller_unit_test.yaml, notebook_controller_unit_test.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: code-quality.yaml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~61% unit tests, ~39% infra-dependent (11/18 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-platform-utilities 71/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%92
  • AGENTS.md found (6/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (9/50 sampled files)
  • Error wrapping patterns (18 files)
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (1 files)
Code NavigabilityNavigate5%90
  • Average file: 161 lines (92 source files, generated excluded)
  • Files >500 lines: 3 (3%)
  • Largest: openshift_test.go (603L), deploy.go (596L), meta_test.go (584L)
Generated Code RatioNavigate2%100
  • 1/93 files are generated (1%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 96 direct dependencies / 92 source files (ratio: 1.04)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%70
  • 32 test files / 60 source files (ratio: 0.53)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%100
  • Codecov configured
  • Go coverage flags in Makefile
  • Coverage in CI workflow: ci.yaml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci.yaml, release.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yaml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~70% unit tests, ~30% infra-dependent (21/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
base-containers 70/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (4/7 quality keywords)
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/5 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 208 lines (11 source files, generated excluded)
  • Files >500 lines: 1 (9%)
  • Largest: generate-containerfile.sh (621L)
Generated Code RatioNavigate2%100
  • 0/11 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 5 test files / 6 source files (ratio: 0.83)
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: docs/DEVELOPMENT.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (5/5 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
kubeflow-sdk 70/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (5/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%55
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has environment/version fields
  • YAML template with required fields
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (16 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 7 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: examples (8 files)
Code NavigabilityNavigate5%30
  • Average file: 327 lines (101 source files, generated excluded)
  • Files >500 lines: 22 (22%)
  • Largest: transformers_test.py (5014L), transformers.py (1777L), backend_test.py (1689L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/112 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (4/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 22 direct dependencies / 112 source files (ratio: 0.20)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 9 entries
Test-to-Source RatioVerify15%38
  • 30 test files / 82 source files (ratio: 0.37)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: verify
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: test-python.yaml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): test-spark-examples.yaml, test-python.yaml, odh-release.yaml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%80
  • Found: CONTRIBUTING.md
  • 3/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~89% unit tests, ~11% infra-dependent (25/28 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
semantic-router 70/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%80
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (3) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (12/50 sampled files)
  • Error wrapping patterns (12 files)
Architecture DocumentationUnderstand3%40
  • 56 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%70
  • Test manifests in overlay/config dirs (21 files)
Code NavigabilityNavigate5%70
  • Average file: 347 lines (1279 source files, generated excluded)
  • Files >500 lines: 245 (19%)
  • Largest: extproc_test.go (5228L), dsl_test.go (4518L), semantic-router_test.go (4474L)
Generated Code RatioNavigate2%100
  • 4/1283 files are generated (0%)
  • Examples: semantic-router_mock.go, nlp_binding_mock.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go, Rust
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%50
  • 244 test files / 1035 source files (ratio: 0.24)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: src/vllm-sr/test, paper/check, deploy/operator/test
  • Multiple test types available
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: operator-ci.yml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): integration-test-k8s.yml, performance-nightly.yml, operator-ci.yml
PR TemplateSubmit2%55
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Has checklist items
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: helm-publish.yml, integration-test-helm.yml, pre-commit.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~80% unit tests, ~20% infra-dependent (24/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
ogx-k8s-operator 70/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (4) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (20/46 sampled files)
  • Error wrapping patterns (17 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: config/samples (7 files)
Code NavigabilityNavigate5%70
  • Average file: 271 lines (51 source files, generated excluded)
  • Files >500 lines: 10 (20%)
  • Largest: llamastackdistribution_controller.go (1680L), llamastackdistribution_controller_test.go (1258L), kustomizer_test.go (1117L)
Generated Code RatioNavigate2%100
  • 1/52 files are generated (2%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 70 direct dependencies / 51 source files (ratio: 1.37)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%85
  • 25 test files / 26 source files (ratio: 0.96)
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, test-e2e
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: code-coverage.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): run-e2e-test.yml, code-coverage.yml, generate-release.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: pre-commit.yml, generate-release.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%50
  • ~45% unit tests, ~55% infra-dependent (10/22 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
training-operator 69/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%55
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has environment/version fields
  • YAML template with required fields
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (12/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%40
  • 19 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (99 files)
Code NavigabilityNavigate5%90
  • Average file: 178 lines (271 source files, generated excluded)
  • Files >500 lines: 18 (7%)
  • Largest: training_client_test.py (1995L), training_client.py (1558L), mpijob_controller.go (1404L)
Generated Code RatioNavigate2%60
  • 69/343 files are generated (20%)
  • Examples: expansion_generated.go, testjob.go, clientset.go, doc.go, doc.go
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 76 direct dependencies / 274 source files (ratio: 0.28)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%38
  • 67 test files / 207 source files (ratio: 0.32)
  • Mixed test quality: 13/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): integration-tests.yaml, test-python.yaml, e2e-test-train-api.yaml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: test-go.yaml, pre-commit.yaml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~93% unit tests, ~7% infra-dependent (26/28 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kserve 69/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%80
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%40
  • 126 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%70
  • Test manifests in overlay/config dirs (17 files)
Code NavigabilityNavigate5%30
  • Average file: 1185 lines (1138 source files, generated excluded)
  • Files >500 lines: 194 (17%)
  • Largest: llmisvc-full-install-with-manifests.sh (91820L), llmisvc-full-install-with-manifests.sh (91764L), llmisvc-full-install-with-manifests.sh (91764L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%80
  • 116/1271 files are generated (9%)
  • Examples: saved_model.pb.go, saver.pb.go, meta_graph.pb.go, tensor_description.pb.go, api_def.pb.go
Build / Dependency SetupNavigate5%70
  • Lockfiles: Go lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 208 direct dependencies / 1155 source files (ratio: 0.18)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 29 entries
Test-to-Source RatioVerify15%43
  • 488 test files / 667 source files (ratio: 0.73)
  • Low test quality: 9/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: check, test, tools/tf2openapi/test, python/sklearnserver/test, python/kserve/test, python/artexplainer/test, python/xgbserver/test, python/pmmlserver/test, python/predictiveserver/test, python/lgbserver/test, python/aiffairness/test, python/paddleserver/test, python/custom_model/test, python/custom_transformer/test, python/huggingfaceserver/test
  • Multiple test types available
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: go.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): precommit-check.yml, distro-build-check.yml, go.yml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%60
  • Found: CONTRIBUTING.md
  • 1/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (28/29 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
rhoai-mcp 69/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (7/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (6 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • Architecture doc: docs/ARCHITECTURE.md
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 7/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 202 lines (183 source files, generated excluded)
  • Files >500 lines: 16 (9%)
  • Largest: tools.py (1147L), test_client.py (1138L), test_tools.py (1048L)
Generated Code RatioNavigate2%100
  • 0/190 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 6 direct dependencies / 190 source files (ratio: 0.03)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%53
  • 64 test files / 126 source files (ratio: 0.51)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-integration, check
  • Multiple test types available
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: ci.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci.yml, eval.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
mod-arch-library 68/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: docs/architecture.md
  • 15 module-level READMEs
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 2/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 68 lines (318 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 5/324 files are generated (2%)
  • Examples: http_mock.go, mock_client.go, mock_factory.go, token_k8s_client_mock.go, internal_k8s_client_mock.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: npm lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 25 entries
Test-to-Source RatioVerify15%53
  • 52 test files / 267 source files (ratio: 0.19)
  • Frontend-heavy repo (relaxed thresholds)
  • Mixed test quality: 15/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: mod-arch-starter/bff/test
  • npm test script defined
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: test.yml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): test.yml, release.yml, publish.yml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~87% unit tests, ~13% infra-dependent (26/30 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
  • .husky/ directory found
model-registry-bf4-kf 68/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%85
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 5/17 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 236 lines (60 source files, generated excluded)
  • Files >500 lines: 7 (12%)
  • Largest: core_test.go (3381L), core.go (1466L), api_model_registry_service.go (952L)
Generated Code RatioNavigate2%20
  • 63/123 files are generated (51%)
  • Examples: model_metadata_proto_value.go, model_base_resource_create.go, model_artifact_list.go, model_doc_artifact.go, model_serve_model_update.go
Add '// Code generated' headers to generated files and document which files are auto-generated in CLAUDE.md.
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 68 direct dependencies / 60 source files (ratio: 1.13)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 17 entries
Test-to-Source RatioVerify15%38
  • 17 test files / 43 source files (ratio: 0.40)
  • Mixed test quality: 10/17 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%100
  • Go coverage flags in Makefile
  • Coverage in CI workflow: build.yml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): build.yml, python-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~88% unit tests, ~12% infra-dependent (15/17 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-model-controller 67/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (16/50 sampled files)
  • Error wrapping patterns (14 files)
Architecture DocumentationUnderstand3%30
  • 4 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: test/data, config/samples (9 files)
Code NavigabilityNavigate5%90
  • Average file: 191 lines (163 source files, generated excluded)
  • Files >500 lines: 9 (6%)
  • Largest: configmap_handler_test.go (999L), inferenceservice_controller_test.go (954L), batch_authpolicy_test_env.go (941L)
Generated Code RatioNavigate2%100
  • 1/164 files are generated (1%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%100
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 173 direct dependencies / 163 source files (ratio: 1.06)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 32 entries
Test-to-Source RatioVerify15%70
  • 57 test files / 106 source files (ratio: 0.54)
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, test-e2e
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): test.yml, test-e2e.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Getting Started, Develop, Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~63% unit tests, ~37% infra-dependent (19/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
trainer 67/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%55
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has environment/version fields
  • YAML template with required fields
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Error wrapping patterns (7 files)
Architecture DocumentationUnderstand3%40
  • 16 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (11 files)
Code NavigabilityNavigate5%90
  • Average file: 141 lines (538 source files, generated excluded)
  • Files >500 lines: 16 (3%)
  • Largest: framework_test.go (2625L), progression_test.go (1912L), trainingruntime_test.go (1865L)
Generated Code RatioNavigate2%80
  • 34/576 files are generated (6%)
  • Examples: expansion_generated.go, trainjob.go, clustertrainingruntime.go, trainingruntime.go, clientset.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go, Rust
Dependency ComplexityNavigate2%90
  • 85 direct dependencies / 542 source files (ratio: 0.16)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 14 entries
Test-to-Source RatioVerify15%13
  • 66 test files / 476 source files (ratio: 0.14)
  • Low test quality: 9/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-integration, test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): test-go.yaml, test-python.yaml, test-rust.yaml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: test-go.yaml, test-python.yaml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%100
  • ~96% unit tests, ~4% infra-dependent (26/27 sampled)
  • Makefile separates unit and integration test targets
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
trustyai-service-operator 67/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (7/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (24/50 sampled files)
  • Error wrapping patterns (11 files)
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: config/samples (4 files)
Code NavigabilityNavigate5%70
  • Average file: 245 lines (146 source files, generated excluded)
  • Files >500 lines: 18 (12%)
  • Largest: lmevaljob_controller_test.go (4373L), unit_test.go (2189L), lmevaljob_controller_validation_test.go (1798L)
Generated Code RatioNavigate2%100
  • 6/152 files are generated (4%)
  • Examples: zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go, zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%70
  • 120 direct dependencies / 146 source files (ratio: 0.82)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%50
  • 36 test files / 110 source files (ratio: 0.33)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, tests/test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): controller-tests.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint-yaml.yaml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%70
  • ~63% unit tests, ~37% infra-dependent (19/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
trainer-sdk 67/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%55
  • Found: .github/ISSUE_TEMPLATE/bug_report.yaml
  • Has environment/version fields
  • YAML template with required fields
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Error wrapping patterns (7 files)
Architecture DocumentationUnderstand3%40
  • 10 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (4 files)
Code NavigabilityNavigate5%90
  • Average file: 119 lines (474 source files, generated excluded)
  • Files >500 lines: 9 (2%)
  • Largest: torch_test.go (1350L), wrapper.go (1191L), framework_test.go (1176L)
Generated Code RatioNavigate2%80
  • 32/513 files are generated (6%)
  • Examples: expansion_generated.go, trainjob.go, clustertrainingruntime.go, trainingruntime.go, clientset.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 80 direct dependencies / 481 source files (ratio: 0.17)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 13 entries
Test-to-Source RatioVerify15%13
  • 45 test files / 436 source files (ratio: 0.10)
  • Low test quality: 6/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-integration, test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): test-go.yaml, test-python.yaml, test-e2e.yaml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: test-go.yaml, test-python.yaml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~92% unit tests, ~8% infra-dependent (24/26 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
rhaii-cluster-validation 66/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (7/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (7/48 sampled files)
  • Error wrapping patterns (19 files)
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (2 files)
Code NavigabilityNavigate5%70
  • Average file: 210 lines (48 source files, generated excluded)
  • Files >500 lines: 3 (6%)
  • Largest: controller.go (2260L), topology.go (651L), runner.go (606L)
Generated Code RatioNavigate2%100
  • 0/48 files are generated (0%)
Build / Dependency SetupNavigate5%80
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 51 direct dependencies / 48 source files (ratio: 1.06)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 18 test files / 30 source files (ratio: 0.60)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci.yaml, image-build.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yaml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Develop
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~94% unit tests, ~6% infra-dependent (17/18 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
kagenti-operator 66/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%68
  • CLAUDE.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (22/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 304 lines (105 source files, generated excluded)
  • Files >500 lines: 18 (17%)
  • Largest: agentcard_controller_test.go (1735L), e2e_test.go (1415L), agentcard_controller.go (1288L)
Generated Code RatioNavigate2%100
  • 1/106 files are generated (1%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 7 rules
Test-to-Source RatioVerify15%85
  • 46 test files / 59 source files (ratio: 0.78)
One-Command Test ExecutionVerify11%100
  • Makefile targets: kagenti-operator/test, kagenti-operator/test-e2e, kagenti-operator/test-integration
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: ci.yaml, security-scans.yaml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~76% unit tests, ~24% infra-dependent (22/29 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
models-as-a-service 66/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (23/50 sampled files)
  • Error wrapping patterns (22 files)
Architecture DocumentationUnderstand3%40
  • 15 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%50
  • Average file: 359 lines (144 source files, generated excluded)
  • Files >500 lines: 29 (20%)
  • Largest: test_subscription.py (2512L), test_models_endpoint.py (2302L), deployment-helpers.sh (1719L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 2/146 files are generated (1%)
  • Examples: zz_generated.deepcopy.go, store_mock.go
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 39 entries
Test-to-Source RatioVerify15%53
  • 48 test files / 96 source files (ratio: 0.50)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: maas-controller/test, maas-api/test
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: maas-api-ci.yml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): maas-api-ci.yml, maas-controller-ci.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: maas-api-ci.yml, maas-controller-ci.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~70% unit tests, ~30% infra-dependent (21/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llm-d-kv-cache 65/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (18/50 sampled files)
  • Error wrapping patterns (14 files)
Architecture DocumentationUnderstand3%80
  • Architecture doc: docs/architecture.md
  • 15 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (22 files)
Code NavigabilityNavigate5%90
  • Average file: 188 lines (134 source files, generated excluded)
  • Files >500 lines: 6 (4%)
  • Largest: index_test.go (735L), test_priority_queue.py (719L), uds_e2e_test.go (666L)
Generated Code RatioNavigate2%100
  • 4/140 files are generated (3%)
  • Examples: tokenizer_grpc.pb.go, tokenizer.pb.go, indexer.pb.go, indexer_grpc.pb.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go, C++
Dependency ComplexityNavigate2%70
  • 123 direct dependencies / 136 source files (ratio: 0.90)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (CODEOWNERS) with 4 rules
Test-to-Source RatioVerify15%53
  • 42 test files / 94 source files (ratio: 0.45)
  • Mixed test quality: 12/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, unit-test, e2e-test, kv_connectors/llmd_fs_backend/test
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci-nightly-race.yaml, ci-test.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci-lint.yaml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~89% unit tests, ~11% infra-dependent (25/28 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
modelmesh-runtime-adapter 64/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (28/50 sampled files)
  • Error wrapping patterns (21 files)
Architecture DocumentationUnderstand3%40
  • 6 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 158 lines (90 source files, generated excluded)
  • Files >500 lines: 6 (7%)
  • Largest: adaptmodellayout_test.go (1246L), adaptmodellayout_test.go (652L), puller_test.go (637L)
Generated Code RatioNavigate2%60
  • 26/116 files are generated (22%)
  • Examples: mock_provider_test.go, mock_torchserve_server.go, mock_inference.go, mock_management.go, model_runtime_client_mock.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%50
  • 97 direct dependencies / 90 source files (ratio: 1.08)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 25 entries
Test-to-Source RatioVerify15%70
  • 27 test files / 63 source files (ratio: 0.43)
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, model-serving-puller/test, model-mesh-mlserver-adapter/test, model-mesh-triton-adapter/test, model-mesh-ovms-adapter/test
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%40
  • PR template found: .github/pull_request_template.md
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: test.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (29/29 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
openrag 64/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in pyproject.toml
  • Some logging (15/50 sampled files)
  • Error wrapping patterns (12 files)
Architecture DocumentationUnderstand3%40
  • 6 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 199 lines (409 source files, generated excluded)
  • Files >500 lines: 43 (11%)
  • Largest: opensearch_multimodal.py (1962L), main.py (1925L), settings.py (1833L)
Generated Code RatioNavigate2%100
  • 0/417 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (8/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 23 direct dependencies / 417 source files (ratio: 0.06)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%25
  • 32 test files / 385 source files (ratio: 0.08)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-integration
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test-integration.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~93% unit tests, ~7% infra-dependent (25/27 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
langfuse 64/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (6/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%80
  • Found: .github/ISSUE_TEMPLATE/bug_report.yml
  • Has reproduction steps
  • Has environment/version fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (12 files)
Architecture DocumentationUnderstand3%40
  • 33 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 224 lines (2096 source files, generated excluded)
  • Files >500 lines: 197 (9%)
  • Largest: root.ts (16411L), otelMapping.servertest.ts (6754L), queryBuilder.servertest.ts (4826L)
Generated Code RatioNavigate2%100
  • 0/2097 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: pnpm lockfile
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%30
  • CODEOWNERS found (.github/CODEOWNERS) but empty
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%50
  • 191 test files / 1906 source files (ratio: 0.10)
  • Frontend-heavy repo (relaxed thresholds)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): pipeline.yml
PR TemplateSubmit2%100
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: sdk-api-spec.yml, pipeline.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (29/30 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
  • .husky/ directory found
codeflare-operator 63/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (4/18 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%50
  • Test manifests in overlay/config dirs (3 files)
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 224 lines (22 source files, generated excluded)
  • Files >500 lines: 3 (14%)
  • Largest: raycluster_webhook_test.go (880L), raycluster_controller.go (713L), mnist_rayjob_raycluster_test.go (559L)
Generated Code RatioNavigate2%100
  • 0/22 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%10
  • 92 direct dependencies / 22 source files (ratio: 4.18)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 31 entries
Test-to-Source RatioVerify15%64
  • 9 test files / 13 source files (ratio: 0.69)
  • Mixed test quality: 7/9 sampled test files have assertions
One-Command Test ExecutionVerify11%90
  • Makefile targets: test-unit, test-e2e
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): odh-release.yml, unit_tests.yml, component_tests.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: unit_tests.yml, tag-and-build.yml, precommit.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%30
  • ~12% unit tests, ~88% infra-dependent (1/8 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
codeflare-operator-poc 63/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (4/18 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%50
  • Test manifests in overlay/config dirs (3 files)
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 225 lines (22 source files, generated excluded)
  • Files >500 lines: 4 (18%)
  • Largest: raycluster_webhook_test.go (880L), raycluster_controller.go (713L), mnist_rayjob_raycluster_test.go (559L)
Generated Code RatioNavigate2%100
  • 0/22 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%10
  • 95 direct dependencies / 22 source files (ratio: 4.32)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 31 entries
Test-to-Source RatioVerify15%64
  • 9 test files / 13 source files (ratio: 0.69)
  • Mixed test quality: 7/9 sampled test files have assertions
One-Command Test ExecutionVerify11%90
  • Makefile targets: test-unit, test-e2e
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): odh-release.yml, unit_tests.yml, component_tests.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: unit_tests.yml, tag-and-build.yml, precommit.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%30
  • ~12% unit tests, ~88% infra-dependent (1/8 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
training-notebooks 63/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%80
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (23/50 sampled files)
  • Error wrapping patterns (18 files)
Architecture DocumentationUnderstand3%40
  • 12 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (2 files)
Code NavigabilityNavigate5%70
  • Average file: 188 lines (116 source files, generated excluded)
  • Files >500 lines: 17 (15%)
  • Largest: konflux_generate_component_build_pipelines.py (863L), bootstrapper.py (769L), bootstrapper.py (769L)
Generated Code RatioNavigate2%100
  • 0/119 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 18 direct dependencies / 119 source files (ratio: 0.15)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 17 entries
Test-to-Source RatioVerify15%25
  • 29 test files / 90 source files (ratio: 0.32)
  • Low test quality: 9/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%70
  • pytest.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): build-notebooks-TEMPLATE.yaml, code-quality.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%100
  • Linting in CI: sec-scan.yml, auto-add-issue-to-project.yml, sync-branches-through-pr.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~79% unit tests, ~21% infra-dependent (23/29 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
kube-authkit 62/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (5/26 sampled files)
  • Error wrapping patterns (8 files)
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/14 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 280 lines (26 source files, generated excluded)
  • Files >500 lines: 3 (12%)
  • Largest: test_oidc.py (1181L), oidc.py (643L), test_factory.py (518L)
Generated Code RatioNavigate2%100
  • 0/26 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 8/12 sampled Python files
Dependency ComplexityNavigate2%90
  • 4 direct dependencies / 26 source files (ratio: 0.15)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%100
  • 14 test files / 12 source files (ratio: 1.17)
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: test.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): test.yml, publish.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~71% unit tests, ~29% infra-dependent (10/14 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
rhoai-observability-mcp 62/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%50
  • Some logging (7/43 sampled files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 2/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 94 lines (41 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/45 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 5 direct dependencies / 45 source files (ratio: 0.11)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 21 test files / 24 source files (ratio: 0.88)
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: ci.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (21/21 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
MLServer 62/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%40
  • 54 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/testdata (26 files)
Code NavigabilityNavigate5%90
  • Average file: 121 lines (348 source files, generated excluded)
  • Files >500 lines: 9 (3%)
  • Largest: generate-pinned-requirements.py (1051L), test_build_command.py (900L), test_settings.py (851L)
Generated Code RatioNavigate2%100
  • 0/375 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Poetry lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%64
  • 145 test files / 230 source files (ratio: 0.63)
  • Mixed test quality: 12/20 sampled test files have assertions
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
  • pytest configured in pyproject.toml
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): tests.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: tests.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
caikit-nlp 62/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/fixtures, examples, tests/resources (33 files)
Code NavigabilityNavigate5%70
  • Average file: 225 lines (71 source files, generated excluded)
  • Files >500 lines: 9 (13%)
  • Largest: peft_prompt_tuning.py (1241L), embedding.py (1226L), test_embedding.py (1145L)
Generated Code RatioNavigate2%100
  • 0/79 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (6/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 19 direct dependencies / 79 source files (ratio: 0.24)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%53
  • 27 test files / 52 source files (ratio: 0.52)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): publish-library.yml, lint-code.yml, build-library.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (27/27 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
ai-gateway-payload-processing 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (23/46 sampled files)
  • Error wrapping patterns (15 files)
Architecture DocumentationUnderstand3%40
  • 5 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 215 lines (49 source files, generated excluded)
  • Files >500 lines: 6 (12%)
  • Largest: vertex_test.go (1621L), anthropic_test.go (879L), vertex.go (751L)
Generated Code RatioNavigate2%100
  • 1/50 files are generated (2%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%70
  • Lockfiles: Go lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%30
  • 111 direct dependencies / 49 source files (ratio: 2.27)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 16 entries
Test-to-Source RatioVerify15%85
  • 21 test files / 28 source files (ratio: 0.75)
One-Command Test ExecutionVerify11%100
  • Makefile targets: verify, test-unit, test-e2e, test
  • Multiple test types available
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci-e2e.yaml, ci-pr-checks.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~80% unit tests, ~20% infra-dependent (16/20 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
kube-rbac-proxy 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (11/40 sampled files)
  • Error wrapping patterns (15 files)
Architecture DocumentationUnderstand3%40
  • 8 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (36 files)
Code NavigabilityNavigate5%90
  • Average file: 166 lines (46 source files, generated excluded)
  • Files >500 lines: 3 (7%)
  • Largest: kubernetes.go (680L), basics.go (594L), kube-rbac-proxy.go (572L)
Generated Code RatioNavigate2%100
  • 0/46 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%30
  • 101 direct dependencies / 46 source files (ratio: 2.20)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%75
  • 23 test files / 23 source files (ratio: 1.00)
  • Mixed test quality: 10/20 sampled test files have assertions
One-Command Test ExecutionVerify11%100
  • Makefile targets: test, test-unit, test-e2e
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): build.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: build.yml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~56% unit tests, ~44% infra-dependent (10/18 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
opencode 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%56
  • AGENTS.md found (3/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%80
  • Found: .github/ISSUE_TEMPLATE/bug-report.yml
  • Has reproduction steps
  • Has environment/version fields
  • YAML template with required fields
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (4 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 18 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 9/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 248 lines (1477 source files, generated excluded)
  • Files >500 lines: 151 (10%)
  • Largest: models-snapshot.js (61474L), types.gen.ts (5214L), index.tsx (4454L)
Generated Code RatioNavigate2%100
  • 0/1479 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • package.json exists but no lockfile found
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Rust
  • tsconfig.json found (strict mode not enabled)
Dependency ComplexityNavigate2%90
  • 6 direct dependencies / 1479 source files (ratio: 0.00)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 4 rules
Test-to-Source RatioVerify15%70
  • 278 test files / 1201 source files (ratio: 0.23)
  • Frontend-heavy repo (relaxed thresholds)
One-Command Test ExecutionVerify11%80
  • npm test script defined
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 6/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (27/27 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
  • .husky/ directory found
trustyai-explainability 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 8 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 146 lines (710 source files, generated excluded)
  • Files >500 lines: 30 (4%)
  • Largest: ModelInferRequest.java (5632L), ModelInferResponse.java (4037L), ModelMetadataResponse.java (3177L)
Generated Code RatioNavigate2%100
  • 0/711 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Java
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%70
  • 238 test files / 473 source files (ratio: 0.50)
One-Command Test ExecutionVerify11%80
  • Makefile targets: tests/test
  • Maven build found with test files
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yaml
PR TemplateSubmit2%55
  • PR template found: .github/pull_request_template.md
  • Has checklist items
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (29/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
operator-chaos 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (14/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: testdata (6 files)
Code NavigabilityNavigate5%70
  • Average file: 206 lines (299 source files, generated excluded)
  • Files >500 lines: 25 (8%)
  • Largest: clean_test.go (2024L), reconciler_test.go (1940L), webhook_test.go (1528L)
Generated Code RatioNavigate2%100
  • 1/300 files are generated (0%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 81 direct dependencies / 299 source files (ratio: 0.27)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 127 test files / 172 source files (ratio: 0.74)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yaml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~93% unit tests, ~7% infra-dependent (28/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
ai-helpers 60/100 - Partially Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (4/7 quality keywords)
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (7) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (6 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 5 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/1 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 232 lines (50 source files, generated excluded)
  • Files >500 lines: 3 (6%)
  • Largest: review.py (787L), compare_reqs.py (523L), env_finder.py (515L)
Generated Code RatioNavigate2%100
  • 0/50 files are generated (0%)
Build / Dependency SetupNavigate5%30
  • Build/install targets in Makefile
  • Dev container configuration
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 17/20 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%10
  • 1 test files / 49 source files (ratio: 0.02)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
mcp-server-operator 59/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (4/13 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: config/samples (2 files)
Code NavigabilityNavigate5%70
  • Average file: 212 lines (14 source files, generated excluded)
  • Files >500 lines: 1 (7%)
  • Largest: mcpserver_test.go (1132L)
Generated Code RatioNavigate2%80
  • 1/15 files are generated (7%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%100
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%10
  • 90 direct dependencies / 14 source files (ratio: 6.43)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%70
  • 5 test files / 9 source files (ratio: 0.56)
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, test-e2e
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Develop, Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~75% unit tests, ~25% infra-dependent (3/4 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
elyra 58/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (3) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%40
  • 12 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 4/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 211 lines (259 source files, generated excluded)
  • Files >500 lines: 29 (11%)
  • Largest: test_processor_kfp.py (1883L), test_metadata_app.py (1785L), PipelineEditorWidget.tsx (1421L)
Generated Code RatioNavigate2%100
  • 0/272 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Yarn lockfile
Type Safety / Static AnalysisNavigate3%60
  • tsconfig.json found (strict mode not enabled)
  • Some type annotations (8/20 sampled)
Dependency ComplexityNavigate2%90
  • 39 direct dependencies / 272 source files (ratio: 0.14)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%38
  • 71 test files / 201 source files (ratio: 0.35)
  • Mixed test quality: 11/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: test-integration, test
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage-related target in Makefile
  • Coverage in CI workflow: build.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): build.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: build.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (29/30 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
kueue 58/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (5) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%40
  • 47 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (44 files)
Code NavigabilityNavigate5%70
  • Average file: 294 lines (633 source files, generated excluded)
  • Files >500 lines: 88 (14%)
  • Largest: scheduler_test.go (7541L), pod_controller_test.go (5833L), cache_test.go (3920L)
Generated Code RatioNavigate2%80
  • 88/721 files are generated (12%)
  • Examples: expansion_generated.go, topology.go, expansion_generated.go, multikueueconfig.go, resourceflavor.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 145 direct dependencies / 633 source files (ratio: 0.23)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 18 entries
Test-to-Source RatioVerify15%85
  • 240 test files / 393 source files (ratio: 0.61)
One-Command Test ExecutionVerify11%80
  • Makefile targets: verify
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%60
  • CI runs tests (but may not trigger on PRs)
  • Tests found in 1 CI workflow(s): odh-release.yml
PR TemplateSubmit2%85
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
  • Mentions review
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~52% unit tests, ~48% infra-dependent (13/25 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
rest-proxy 57/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (5/6 sampled files)
  • Error wrapping patterns (3 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 170 lines (8 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%60
  • 3/11 files are generated (27%)
  • Examples: grpc_predict_v2.pb.go, grpc_predict_v2_grpc.pb.go, grpc_predict_v2.pb.gw.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%30
  • 29 direct dependencies / 8 source files (ratio: 3.62)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 27 entries
Test-to-Source RatioVerify15%38
  • 2 test files / 6 source files (ratio: 0.33)
  • Mixed test quality: 1/2 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: test.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (2/2 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-test-gen 55/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (9 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 134 lines (90 source files, generated excluded)
  • Files >500 lines: 4 (4%)
  • Largest: ui_report.py (1137L), ui_prepare.py (970L), repo.py (560L)
Generated Code RatioNavigate2%100
  • 0/91 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 11/20 sampled Python files
Dependency ComplexityNavigate2%90
  • 3 direct dependencies / 91 source files (ratio: 0.03)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%100
  • 48 test files / 43 source files (ratio: 1.12)
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: test.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Contribut, Contribut, Develop
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (28/28 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
elyra-pipeline-editor 55/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (2 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (20 files)
Code NavigabilityNavigate5%70
  • Average file: 220 lines (102 source files, generated excluded)
  • Files >500 lines: 7 (7%)
  • Largest: index.ts (5335L), common-canvas.d.ts (3011L), index.test.ts (1395L)
Generated Code RatioNavigate2%100
  • 0/102 files are generated (0%)
Build / Dependency SetupNavigate5%80
  • Lockfiles: Yarn lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%70
  • 22 test files / 80 source files (ratio: 0.28)
  • Frontend-heavy repo (relaxed thresholds)
One-Command Test ExecutionVerify11%80
  • npm test script defined
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: build.yaml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): build.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (22/22 sampled)
Pre-commit / Local HooksVerify3%70
  • Husky git hooks configured
mlflow-go 55/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (11/25 sampled files)
  • Error wrapping patterns (6 files)
Architecture DocumentationUnderstand3%45
  • ADR directory: docs/adr (11 records)
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: testdata (1 files)
Code NavigabilityNavigate5%50
  • Average file: 328 lines (27 source files, generated excluded)
  • Files >500 lines: 7 (26%)
  • Largest: client_test.go (1175L), client_test.go (1148L), client.go (767L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%60
  • 6/33 files are generated (18%)
  • Examples: assessments.pb.go, service.pb.go, model_registry.pb.go, databricks.pb.go, datasets.pb.go
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%70
  • 9 test files / 18 source files (ratio: 0.50)
One-Command Test ExecutionVerify11%80
  • Makefile targets: check
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): go.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: go.yaml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Develop
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~86% unit tests, ~14% infra-dependent (6/7 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
caikit-nlp-client 55/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (3/19 sampled files)
  • Error wrapping patterns (7 files)
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/fixtures, examples (21 files)
Code NavigabilityNavigate5%70
  • Average file: 151 lines (18 source files, generated excluded)
  • Files >500 lines: 1 (6%)
  • Largest: http_client.py (541L)
Generated Code RatioNavigate2%100
  • 0/19 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (4/10 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 3 direct dependencies / 19 source files (ratio: 0.16)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%64
  • 9 test files / 10 source files (ratio: 0.90)
  • Mixed test quality: 6/9 sampled test files have assertions
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
  • noxfile.py found
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: tests.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): tests.yml, release.yml, tests-docker.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: tests.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (9/9 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
distributed-workloads 53/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (3/7 quality keywords)
  • AGENTS.md found (3/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%90
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Error wrapping patterns (11 files)
Architecture DocumentationUnderstand3%40
  • 31 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (143 files)
Code NavigabilityNavigate5%90
  • Average file: 160 lines (137 source files, generated excluded)
  • Files >500 lines: 8 (6%)
  • Largest: rhai_features_tests.go (1100L), prestage_models_datasets.py (862L), ray_finetune_llm_deepspeed.py (743L)
Generated Code RatioNavigate2%100
  • 0/137 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Go lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%70
  • 78 direct dependencies / 137 source files (ratio: 0.57)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), OWNERS_ALIASES present
Test-to-Source RatioVerify15%75
  • 101 test files / 36 source files (ratio: 2.81)
  • Mixed test quality: 13/20 sampled test files have assertions
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%70
  • CI has PR triggers and test steps, but in separate workflows
  • Tests found in 1 CI workflow(s): odh-release.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%50
  • ~40% unit tests, ~60% infra-dependent (12/30 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
vllm-tgis-adapter 53/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/32 sampled files)
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: tests/fixtures, examples (9 files)
Code NavigabilityNavigate5%90
  • Average file: 143 lines (31 source files, generated excluded)
  • Files >500 lines: 1 (3%)
  • Largest: grpc_server.py (994L)
Generated Code RatioNavigate2%100
  • 0/33 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 9 direct dependencies / 33 source files (ratio: 0.27)
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 31 entries
Test-to-Source RatioVerify15%38
  • 8 test files / 25 source files (ratio: 0.32)
  • Mixed test quality: 6/8 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
  • noxfile.py found
Coverage ConfigurationVerify3%80
  • Coverage in CI workflow: tests.yaml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): tests.yaml, release.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit-autoupdate.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build, Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (8/8 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
llm-d-batch-gateway-operator 52/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (4/10 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: config/samples (3 files)
Code NavigabilityNavigate5%70
  • Average file: 249 lines (12 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%80
  • 1/13 files are generated (8%)
  • Examples: zz_generated.deepcopy.go
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%10
  • 74 direct dependencies / 12 source files (ratio: 6.17)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 5 test files / 7 source files (ratio: 0.71)
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): ci.yml, ci-integration-tests.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%50
  • ~40% unit tests, ~60% infra-dependent (2/5 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
agent-eval-harness 51/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (4/7 quality keywords)
  • AGENTS.md found (4/7 quality keywords)
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (8 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/14 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 250 lines (53 source files, generated excluded)
  • Files >500 lines: 5 (9%)
  • Largest: report.py (2272L), score.py (1066L), trace_builder.py (864L)
Generated Code RatioNavigate2%100
  • 0/53 files are generated (0%)
Build / Dependency SetupNavigate5%20
  • Build/install targets in Makefile
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (6/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 1 direct dependencies / 53 source files (ratio: 0.02)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%50
  • 14 test files / 39 source files (ratio: 0.36)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, test-e2e
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): tests.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (14/14 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llama-stack-provider-ragas 50/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (9/24 sampled files)
  • Error wrapping patterns (4 files)
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/4 sampled test files
Code NavigabilityNavigate5%90
  • Average file: 105 lines (22 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/24 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: npm lockfile, uv lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%50
  • 32 direct dependencies / 24 source files (ratio: 1.33)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%38
  • 4 test files / 20 source files (ratio: 0.20)
  • Mixed test quality: 3/4 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%60
  • Coverage config in pyproject.toml
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (4/4 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
lm-evaluation-harness 49/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (6 files)
Architecture DocumentationUnderstand3%40
  • 233 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/testdata, examples (713 files)
Code NavigabilityNavigate5%90
  • Average file: 126 lines (778 source files, generated excluded)
  • Files >500 lines: 37 (5%)
  • Largest: utils.py (2364L), es_instructions.py (1897L), ca_instructions.py (1895L)
Generated Code RatioNavigate2%100
  • 0/786 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (7/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 15 direct dependencies / 786 source files (ratio: 0.02)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 2 rules (sparse)
Test-to-Source RatioVerify15%10
  • 32 test files / 754 source files (ratio: 0.04)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): unit_tests.yml, new_tasks.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: unit_tests.yml
Contributing / Dev GuideSubmit5%100
  • Found: docs/CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
modelmesh 49/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (1 files)
Architecture DocumentationUnderstand3%40
  • 5 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: config/examples (11 files)
Code NavigabilityNavigate5%50
  • Average file: 443 lines (120 source files, generated excluded)
  • Files >500 lines: 23 (19%)
  • Largest: ModelMesh.java (7365L), LegacyModelMeshService.java (5330L), TasRuntimeOuterClass.java (4876L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/120 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Java
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 25 entries
Test-to-Source RatioVerify15%64
  • 52 test files / 68 source files (ratio: 0.76)
  • Mixed test quality: 12/20 sampled test files have assertions
One-Command Test ExecutionVerify11%70
  • Maven build found with test files
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%40
  • PR template found: .github/pull_request_template.md
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting via .pre-commit-config.yaml (lint hooks configured)
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~87% unit tests, ~13% infra-dependent (26/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
openvino.genai 48/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (13/50 sampled files)
  • Error wrapping patterns (16 files)
Architecture DocumentationUnderstand3%40
  • 24 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: samples (139 files)
Code NavigabilityNavigate5%70
  • Average file: 217 lines (498 source files, generated excluded)
  • Files >500 lines: 48 (10%)
  • Largest: test_vlm_pipeline.py (1927L), adapter.cpp (1771L), classes.cpp (1532L)
Generated Code RatioNavigate2%100
  • 0/501 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++, C
Dependency ComplexityNavigate2%90
  • 1 direct dependencies / 501 source files (ratio: 0.00)
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 25 rules
Test-to-Source RatioVerify15%38
  • 97 test files / 404 source files (ratio: 0.24)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 5 CI workflow(s): windows.yml, linux.yml, mac.yml
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%100
  • Linting in CI: lint.yml, sdl.yml
Contributing / Dev GuideSubmit5%70
  • Found: .github/CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
autogluon 48/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (0/7 quality keywords)
  • AGENTS.md found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (14 files)
Architecture DocumentationUnderstand3%40
  • 14 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (75 files)
Code NavigabilityNavigate5%70
  • Average file: 210 lines (916 source files, generated excluded)
  • Files >500 lines: 88 (10%)
  • Largest: predictor.py (6293L), abstract_trainer.py (5254L), abstract_model.py (3402L)
Generated Code RatioNavigate2%100
  • 0/1040 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (4/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%38
  • 276 test files / 764 source files (ratio: 0.36)
  • Mixed test quality: 13/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%40
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: update-pre-commit.yml
Contributing / Dev GuideSubmit5%80
  • Found: CONTRIBUTING.md
  • 3/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
guardrails-detectors 48/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/35 sampled files)
  • Error wrapping patterns (6 files)
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 15/16 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 160 lines (30 source files, generated excluded)
  • Files >500 lines: 1 (3%)
  • Largest: test_llm_judge_detector.py (588L)
Generated Code RatioNavigate2%100
  • 0/35 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (9/19 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%85
  • 16 test files / 19 source files (ratio: 0.84)
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): test-llm-judge.yaml, test-huggingface-runtime.yaml, test-builtin-detectors.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (16/16 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
fms-guardrails-orchestrator 46/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: tests/resources (2 files)
Code NavigabilityNavigate5%30
  • Average file: 495 lines (77 source files, generated excluded)
  • Files >500 lines: 17 (22%)
  • Largest: chat_completions_streaming.rs (5653L), completions_streaming.rs (4701L), remediation-script.sh (2127L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/77 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Cargo lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Rust
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%25
  • 19 test files / 58 source files (ratio: 0.33)
  • Low test quality: 3/19 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): test.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: test.yml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (19/19 sampled)
Pre-commit / Local HooksVerify3%70
  • .pre-commit-config.yaml found
openvino 46/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (7) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (7 files)
Architecture DocumentationUnderstand3%40
  • 81 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: samples (140 files)
Code NavigabilityNavigate5%70
  • Average file: 167 lines (10205 source files, generated excluded)
  • Files >500 lines: 579 (6%)
  • Largest: convolution_gpu_test.cpp (11196L), caffe_pb2.py (9544L), deformable_convolution.cpp (7789L)
Generated Code RatioNavigate2%100
  • 0/10247 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++, C
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 91 rules
Test-to-Source RatioVerify15%43
  • 4667 test files / 5580 source files (ratio: 0.84)
  • Low test quality: 2/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%60
  • Coverage in CI workflow: coverage.yml
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 12 CI workflow(s): job_jax_models_tests.yml, job_onnx_models_tests.yml, job_tensorflow_layer_tests.yml
PR TemplateSubmit2%40
  • PR template found: .github/pull_request_template.md
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: py_checks.yml
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llama-stack-client-python 45/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (5 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Fixture directories: examples (3 files)
Code NavigabilityNavigate5%90
  • Average file: 148 lines (422 source files, generated excluded)
  • Files >500 lines: 31 (7%)
  • Largest: _base_client.py (1999L), test_client.py (1692L), response_object_stream.py (1550L)
Generated Code RatioNavigate2%100
  • 0/423 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: uv lockfile
  • Dev container configuration
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%90
  • 15 direct dependencies / 423 source files (ratio: 0.04)
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%19
  • 67 test files / 356 source files (ratio: 0.19)
  • Mixed test quality: 12/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~97% unit tests, ~3% infra-dependent (29/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
data-processing 42/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (3/19 sampled files)
  • Error wrapping patterns (8 files)
Architecture DocumentationUnderstand3%40
  • 6 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 156 lines (19 source files, generated excluded)
  • Files >500 lines: 1 (5%)
  • Largest: subset_selection.py (931L)
Generated Code RatioNavigate2%100
  • 0/19 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 2 rules (sparse)
Test-to-Source RatioVerify15%25
  • 2 test files / 17 source files (ratio: 0.12)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 2 CI workflow(s): execute-all-notebooks.yml, validate-notebooks.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: validate-python.yml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (2/2 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
ogx-distribution 40/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 175 lines (7 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/7 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 3 rules
Test-to-Source RatioVerify15%43
  • 3 test files / 4 source files (ratio: 0.75)
  • Low test quality: 0/3 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): redhat-distro-container.yml
PR TemplateSubmit2%70
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
  • Mentions testing
Linting / Formatting in CISubmit5%100
  • Linting in CI: pre-commit.yml, update-llama-stack-version.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%70
  • ~67% unit tests, ~33% infra-dependent (2/3 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-observability 40/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Go structured logging (zap) found in go.mod
  • Go structured logging (logr) found in go.mod
  • Kubernetes-style logging (klog) found in go.mod
  • Good logging coverage (7/13 sampled files)
  • Error wrapping patterns (5 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 265 lines (13 source files, generated excluded)
  • Files >500 lines: 1 (8%)
  • Largest: templatedata.go (826L)
Generated Code RatioNavigate2%100
  • 0/13 files are generated (0%)
Build / Dependency SetupNavigate5%90
  • Lockfiles: Go lockfile
  • Build/install targets in Makefile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%10
  • 94 direct dependencies / 13 source files (ratio: 7.23)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%50
  • 3 test files / 10 source files (ratio: 0.30)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: test
Coverage ConfigurationVerify3%80
  • Go coverage flags in Makefile
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (3/3 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
vllm-gaudi 39/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (10) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (6/50 sampled files)
  • Error wrapping patterns (13 files)
Architecture DocumentationUnderstand3%40
  • 7 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: tests/data, examples (79 files)
Code NavigabilityNavigate5%70
  • Average file: 256 lines (943 source files, generated excluded)
  • Files >500 lines: 130 (14%)
  • Largest: config.py (2413L), hpu_model_runner.py (2213L), llm_engine.py (2091L)
Generated Code RatioNavigate2%100
  • 0/1025 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%60
  • CODEOWNERS found (.github/CODEOWNERS) with 1 rules (sparse)
Test-to-Source RatioVerify15%53
  • 342 test files / 683 source files (ratio: 0.50)
  • Mixed test quality: 12/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%40
  • PR template found: .github/PULL_REQUEST_TEMPLATE.md
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ruff.yml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (29/29 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
openvino_model_server 38/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (1) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (4 files)
Architecture DocumentationUnderstand3%40
  • 66 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%50
  • Test manifests in overlay/config dirs (1 files)
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 267 lines (611 source files, generated excluded)
  • Files >500 lines: 72 (12%)
  • Largest: ensemble_tests.cpp (6409L), ensemble_flow_custom_node_tests.cpp (5967L), llmnode_test.cpp (4131L)
Generated Code RatioNavigate2%100
  • 0/611 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Yarn lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++, Go, Java, C
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 17 entries
Test-to-Source RatioVerify15%35
  • 222 test files / 389 source files (ratio: 0.57)
  • Low test quality: 2/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%50
  • Coverage-related target in Makefile
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%70
  • CI has PR triggers and test steps, but in separate workflows
  • Tests found in 2 CI workflow(s): integration-tests-konflux.yml, integration-tests.yml
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: docs/developer_guide.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
gpt-researcher 38/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%80
  • .cursorrules found (5/7 quality keywords)
Bug Report Template QualityUnderstand8%100
  • Found: .github/ISSUE_TEMPLATE/bug_report.md
  • Has reproduction steps
  • Has expected/actual behavior fields
  • Has environment/version fields
  • Has log/error output fields
Structured Logging / ErrorsUnderstand3%90
  • Python structured logging found in requirements.txt
  • Some logging (12/50 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%40
  • 12 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/18 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 133 lines (245 source files, generated excluded)
  • Files >500 lines: 9 (4%)
  • Largest: scripts.js (2469L), page.tsx (1017L), researcher.py (989L)
Generated Code RatioNavigate2%100
  • 0/279 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 10/20 sampled Python files
Dependency ComplexityNavigate2%90
  • 44 direct dependencies / 279 source files (ratio: 0.16)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%13
  • 18 test files / 261 source files (ratio: 0.07)
  • Low test quality: 8/18 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (18/18 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
perf_analyzer 37/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (3 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 2/20 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 94 lines (764 source files, generated excluded)
  • Files >500 lines: 17 (2%)
  • Largest: doctest.h (7824L), test_llm_profile_data_parser.py (1587L), test_cli.py (1579L)
Generated Code RatioNavigate2%100
  • 0/765 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dev container configuration
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (4/20 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%19
  • 69 test files / 696 source files (ratio: 0.10)
  • Mixed test quality: 14/20 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): python-package-genai.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
elyra-examples 37/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%100
  • Good logging coverage (14/46 sampled files)
  • Error wrapping patterns (8 files)
Architecture DocumentationUnderstand3%40
  • 31 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/3 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 85 lines (46 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/46 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%19
  • 3 test files / 43 source files (ratio: 0.07)
  • Mixed test quality: 2/3 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%100
  • Makefile targets: component-catalog-connectors/mlx-connector/test, component-catalog-connectors/kfp-example-components-connector/test, component-catalog-connectors/artifactory-connector/test
  • Multiple test types available
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%85
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: build.yaml
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (3/3 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llama-stack-provider-kfp-trainer 34/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (3 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 69 lines (16 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/16 files are generated (0%)
Build / Dependency SetupNavigate5%10
  • Dockerfile/Containerfile for reproducible builds
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • mypy configured in pyproject.toml
Dependency ComplexityNavigate2%70
  • 10 direct dependencies / 16 source files (ratio: 0.62)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%25
  • 1 test files / 15 source files (ratio: 0.07)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): test.yml, mypy.yml, lint.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
openvino_contrib 34/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (1) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (7/50 sampled files)
  • Error wrapping patterns (5 files)
Architecture DocumentationUnderstand3%40
  • 11 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 116 lines (432 source files, generated excluded)
  • Files >500 lines: 8 (2%)
  • Largest: convolution.cpp (8897L), group_convolution.cpp (822L), bidirectional_lstm_sequence_composition.cpp (755L)
Generated Code RatioNavigate2%100
  • 0/434 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++, Java
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • CODEOWNERS found (.github/CODEOWNERS) with 7 rules
Test-to-Source RatioVerify15%25
  • 107 test files / 327 source files (ratio: 0.33)
  • Low test quality: 4/20 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 4 CI workflow(s): windows.yml, linux.yml, mac.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: openvino_code.yml
Contributing / Dev GuideSubmit5%60
  • Found: CONTRIBUTING.md
  • 1/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (30/30 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
architecture-context 33/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (19 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 44 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 191 lines (62 source files, generated excluded)
  • Files >500 lines: 5 (8%)
  • Largest: deps.go (586L), diff.go (561L), fetch.py (550L)
Generated Code RatioNavigate2%100
  • 0/62 files are generated (0%)
Build / Dependency SetupNavigate5%80
  • Lockfiles: uv lockfile
  • Build/install targets in Makefile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%90
  • 3 direct dependencies / 62 source files (ratio: 0.05)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%10
  • 1 test files / 61 source files (ratio: 0.02)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%90
  • Makefile targets: test, src/arch-query/test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: ci.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build, Setup
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
modelcar-base-image 32/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (1/8 sampled files)
  • Error wrapping patterns (1 files)
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 22 lines (11 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/12 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: Go lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (1/4 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%38
  • 3 test files / 9 source files (ratio: 0.33)
  • Mixed test quality: 2/3 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%80
  • Makefile targets: python/test
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (3/3 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
openvino_tokenizers 29/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%15
  • Issue templates exist (1) but no dedicated bug template
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (4/24 sampled files)
  • Error wrapping patterns (9 files)
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 1/6 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 225 lines (54 source files, generated excluded)
  • Files >500 lines: 7 (13%)
  • Largest: tokenizer_pipeline.py (1623L), tokenizers_test.py (1114L), hf_parser.py (1088L)
Generated Code RatioNavigate2%100
  • 0/55 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Poetry lockfile
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): C++
Dependency ComplexityNavigate2%90
  • 2 direct dependencies / 55 source files (ratio: 0.04)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%19
  • 6 test files / 49 source files (ratio: 0.12)
  • Mixed test quality: 3/6 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 3 CI workflow(s): windows.yml, linux.yml, mac.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build, Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (6/6 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
rag 28/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (9/37 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%40
  • 13 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 194 lines (47 source files, generated excluded)
  • Files >500 lines: 3 (6%)
  • Largest: client.go (1581L), evaluation_utilities.py (900L), beir_benchmarks.py (619L)
Generated Code RatioNavigate2%100
  • 0/47 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 19 entries
Test-to-Source RatioVerify15%19
  • 3 test files / 44 source files (ratio: 0.07)
  • Mixed test quality: 2/3 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yaml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%70
  • ~67% unit tests, ~33% infra-dependent (2/3 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
agentic-ci 27/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 156 lines (7 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/9 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%13
  • 1 test files / 8 source files (ratio: 0.12)
  • Low test quality: 0/1 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): ci.yml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
client 24/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (4 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 5 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 209 lines (109 source files, generated excluded)
  • Files >500 lines: 9 (8%)
  • Largest: _client.py (1936L), _client.py (1659L), __init__.py (810L)
Generated Code RatioNavigate2%100
  • 0/109 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Java
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%10
  • 5 test files / 104 source files (ratio: 0.05)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%40
  • README has development sections: contribut, CONTRIBUT, Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (5/5 sampled)
Pre-commit / Local HooksVerify3%100
  • .pre-commit-config.yaml found
  • Includes both linting and type/test hooks
caikit-tgis-serving 23/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 4 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 54 lines (29 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/29 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: Poetry lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 11 entries
Test-to-Source RatioVerify15%43
  • 11 test files / 18 source files (ratio: 0.61)
  • Low test quality: 1/11 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%100
  • Found: CONTRIBUTING.md
  • 5/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~91% unit tests, ~9% infra-dependent (10/11 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
fips-compliance-checker-claude-code-plugin 23/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%44
  • CLAUDE.md found (2/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%80
  • Fixture directories: tests/fixtures (9 files)
Code NavigabilityNavigate5%70
  • Average file: 164 lines (13 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/13 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 1/1 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%75
  • 7 test files / 6 source files (ratio: 1.17)
  • Mixed test quality: 4/7 sampled test files have assertions
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build, Build, Contribut
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (7/7 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
odh-s2i-project-cds 18/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 50 lines (7 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/15 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%90
  • 2 direct dependencies / 15 source files (ratio: 0.13)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%13
  • 1 test files / 14 source files (ratio: 0.07)
  • Low test quality: 0/1 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%60
  • tox.ini found
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%40
  • Lint targets in Makefile (but not confirmed in CI)
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
ml-metadata 17/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (9 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 1 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%40
  • Some fixture patterns in 2/13 sampled test files
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%30
  • Average file: 332 lines (64 source files, generated excluded)
  • Files >500 lines: 14 (22%)
  • Largest: metadata_store_test.py (2631L), metadata_store.py (2012L), types.py (1578L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/64 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%38
  • 13 test files / 51 source files (ratio: 0.25)
  • Mixed test quality: 9/13 sampled test files have assertions
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%50
  • Found: CONTRIBUTING.md
  • 0/6 development keywords
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (13/13 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
vllm-orchestrator-gateway 17/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%50
  • Average file: 228 lines (4 source files, generated excluded)
  • Files >500 lines: 1 (25%)
  • Largest: main.rs (547L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/4 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: Cargo lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Rust
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 4 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 1 CI workflow(s): tests.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: tests.yaml
Contributing / Dev GuideSubmit5%40
  • README has development sections: Getting started
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
autofix-skills 16/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%100
  • CLAUDE.md found (3/7 quality keywords)
  • AGENTS.md found (3/7 quality keywords)
Bug Report Template QualityUnderstand8%50
  • Jira link found in README.md
  • Explicit bug/issue reporting via Jira in README.md
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 183 lines (6 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/6 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 3/3 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 6 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: lint.yml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llama-stack-provider-kft 16/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (2/9 sampled files)
  • Error wrapping patterns (1 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 94 lines (8 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/9 files are generated (0%)
Build / Dependency SetupNavigate5%70
  • Lockfiles: uv lockfile
  • Dockerfile/Containerfile for reproducible builds
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (2/9 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%50
  • 17 direct dependencies / 9 source files (ratio: 1.89)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 9 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
llama-stack-provider-instructlab-train 14/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (1 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 56 lines (4 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/4 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: uv lockfile
Type Safety / Static AnalysisNavigate3%50
  • Some type annotations (1/4 sampled)
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%30
  • 16 direct dependencies / 4 source files (ratio: 4.00)
Consider reducing direct dependencies or documenting key dependencies to help AI agents understand the project's dependency surface.
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 4 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks
odh-s2i-project-cookiecutter 13/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%15
  • 2 module-level README(s)
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 40 lines (5 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/5 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%70
  • 4 direct dependencies / 5 source files (ratio: 0.80)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%50
  • 1 test files / 4 source files (ratio: 0.25)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%90
  • ~100% unit tests, ~0% infra-dependent (1/1 sampled)
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
agents 13/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%56
  • AGENTS.md found (3/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (10/38 sampled files)
  • Error wrapping patterns (10 files)
Architecture DocumentationUnderstand3%70
  • ADR directory: adr (3 records)
  • 27 module-level READMEs
Test Fixtures / Sample DataUnderstand2%90
  • Fixture directories: examples (92 files)
Code NavigabilityNavigate5%90
  • Average file: 139 lines (41 source files, generated excluded)
  • Files >500 lines: 1 (2%)
  • Largest: nps_mcp_server.py (757L)
Generated Code RatioNavigate2%100
  • 0/42 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%80
  • Statically typed language(s): Go
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%13
  • 3 test files / 39 source files (ratio: 0.08)
  • Low test quality: 0/3 sampled test files have assertions (stub penalty applied)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%50
  • ~33% unit tests, ~67% infra-dependent (1/3 sampled)
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
odh-gitops 10/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 3 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 157 lines (17 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/17 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 17 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%100
  • PR template found: .github/pull_request_template.md
  • Mentions testing
  • Has checklist items
  • Mentions review
Linting / Formatting in CISubmit5%80
  • Linting in CI: helm.yaml
Contributing / Dev GuideSubmit5%90
  • Found: CONTRIBUTING.md
  • 4/6 development keywords
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
skills-registry 10/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%56
  • CLAUDE.md found (3/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • Architecture doc: ARCHITECTURE.md
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 213 lines (8 source files, generated excluded)
  • Files >500 lines: 1 (12%)
  • Largest: generate_site.py (580L)
Generated Code RatioNavigate2%100
  • 0/8 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 7/7 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 8 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%60
  • Found: CONTRIBUTING.md
  • 1/6 development keywords
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
opendatahub.io 9/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 97 lines (45 source files, generated excluded)
  • Files >500 lines: 1 (2%)
  • Largest: const.ts (845L)
Generated Code RatioNavigate2%100
  • 0/45 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: npm lockfile
Type Safety / Static AnalysisNavigate3%90
  • TypeScript strict mode enabled
Dependency ComplexityNavigate2%90
  • 22 direct dependencies / 45 source files (ratio: 0.49)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 45 source files (ratio: 0.00)
  • Frontend-heavy repo (relaxed thresholds)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No linting in CI detected
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%70
  • Found: CONTRIBUTING.md
  • 2/6 development keywords
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
odh-konflux-central 7/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 4 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 292 lines (3 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/3 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 3 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%30
  • CI triggers on PRs but no test step found
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: yaml-lint.yaml
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
model-runtimes-agent 6/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%44
  • AGENTS.md found (2/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%70
  • Some logging (4/20 sampled files)
  • Error wrapping patterns (2 files)
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%50
  • Average file: 328 lines (17 source files, generated excluded)
  • Files >500 lines: 3 (18%)
  • Largest: app.py (1962L), html_report.py (749L), accelerator_validator.py (574L)
Break large files (>500 lines) into smaller, focused modules. Exclude generated files from linting.
Generated Code RatioNavigate2%100
  • 0/21 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 10/20 sampled Python files
Dependency ComplexityNavigate2%90
  • 8 direct dependencies / 21 source files (ratio: 0.38)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 21 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Develop
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
knowledge-skills 5/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%56
  • CLAUDE.md found (3/7 quality keywords)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 99 lines (3 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/3 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 3 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
llm-d-playbooks 5/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 15 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 109 lines (7 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/7 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 2/3 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 7 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
odh-s2i-project-simple 4/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 15 lines (3 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/3 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%70
  • 2 direct dependencies / 3 source files (ratio: 0.67)
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 3 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%40
  • README has development sections: Build
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
aiops-infra 4/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%0
  • No architecture documentation found
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%70
  • Average file: 170 lines (73 source files, generated excluded)
  • Files >500 lines: 1 (1%)
  • Largest: run_github_workflow.py (538L)
Generated Code RatioNavigate2%100
  • 0/73 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%70
  • Type annotations in 15/20 sampled Python files
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 73 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
dsp-dev-tools 4/100 - Not Ready
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%0
  • No structured logging detected
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%40
  • 8 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%0
  • No test fixtures or sample data found
Add test fixtures or sample data directories (testdata/, fixtures/, examples/) to help AI agents understand expected inputs and reproduce bugs.
Code NavigabilityNavigate5%90
  • Average file: 48 lines (27 source files, generated excluded)
  • Files >500 lines: 0 (0%)
Generated Code RatioNavigate2%100
  • 0/27 files are generated (0%)
Build / Dependency SetupNavigate5%0
  • No dependency lockfiles or build configuration found
Add dependency lockfiles (go.sum, package-lock.json, poetry.lock) and a documented build setup to ensure reproducible builds.
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%0
  • No CODEOWNERS or OWNERS file
Create a .github/CODEOWNERS file mapping directories to team members for automated PR review assignment.
Test-to-Source RatioVerify15%0
  • 0 test files / 27 source files (ratio: 0.00)
Add unit tests for critical code paths. Aim for at least 1 test file per 2 source files.
One-Command Test ExecutionVerify11%0
  • No obvious one-command test execution found
Add a 'make test' or 'make unittest' target that runs unit tests without external dependencies.
Coverage ConfigurationVerify3%0
  • No coverage configuration found
Configure coverage reporting (e.g., -coverprofile for Go, pytest-cov for Python) and add a Codecov or Coveralls integration.
CI Runs Tests on PRsVerify10%0
  • No .github/workflows/ directory
Ensure CI workflows triggered by pull_request events include a step that runs tests.
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%0
  • No CI workflows
Add a linting step (golangci-lint, eslint, ruff) to your CI pipeline.
Contributing / Dev GuideSubmit5%0
  • No contributing/development guide found
Add CONTRIBUTING.md with build, test, and debug instructions.
Test Isolation (unit vs e2e)Verify4%0
  • No test files found
Separate unit tests (no external deps) from integration/e2e tests using build tags or directory structure.
Pre-commit / Local HooksVerify3%0
  • No pre-commit hooks or local validation configured
Add pre-commit hooks (.pre-commit-config.yaml, husky, lefthook) for fast local feedback on formatting and linting.
Non-Code Repos Excluded (26) #

These repos contain no source code (docs, config, governance, etc.) and are excluded from scoring. AI bug-fix readiness assessment is not applicable to non-code repos.

1/1
Code Repos Assessed
58/100
Average Score
0
Ready
0
Partially Ready
1
Needs Work
0
Not Ready

Bug Bash Shortlist #

Ready (score 80+) - 0 repos

Partially Ready (score 60-79) - can start with some gaps (0 repos)

Needs Work (score 40-59) - fix key gaps first (1 repo)

Not Ready (score <40) - significant work needed (0 repos)

Score Overview #

Score Distribution

Biggest Gaps (Lowest Avg Scores)

Bottleneck Phases

Which phase is the weakest for each repo

Bug Fix Workflow Phases #

An AI agent fixing a bug goes through these phases. Scores show ecosystem average per phase.

Understand

22/100
Can the agent understand the bug from the report and codebase context?

Navigate

62/100
Can the agent find the relevant code efficiently?

Verify

82/100
Can the agent run tests to verify the fix works?

Submit

65/100
Can the agent submit the fix following project conventions?

Repository Scores #

Repository Score Level Languages
codeflare-sdk 58 Needs Work Python, Shell

Quick Wins (Highest Impact Actions) #

Actions that would raise the most scores across the ecosystem, sorted by estimated impact.

ActionRepos Below 40WeightHow to Fix
AI Context Files 1 repos 8% Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template Quality 1 repos 8% Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Type Safety / Static Analysis 1 repos 3% Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
PR Template 1 repos 2% Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Structured Logging / Errors 1 repos 3% Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture Documentation 1 repos 3% Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
How Scoring Works #

The overall score is a weighted average of 20 checks, each scored 0-100. Checks are grouped into 4 phases of an AI bug-fixing workflow:

PhaseWeightWhat it measures
Understand24%AI Context Files (8%), Bug Report Template Quality (8%), Structured Logging / Errors (3%), Architecture Documentation (3%), Test Fixtures / Sample Data (2%)
Navigate17%Code Navigability (5%), Generated Code Ratio (2%), Build / Dependency Setup (5%), Type Safety / Static Analysis (3%), Dependency Complexity (2%)
Verify46%Test-to-Source Ratio (15%), One-Command Test Execution (11%), Coverage Configuration (3%), CI Runs Tests on PRs (10%), Test Isolation (unit vs e2e) (4%), Pre-commit / Local Hooks (3%)
Submit13%Code Ownership (CODEOWNERS) (1%), PR Template (2%), Linting / Formatting in CI (5%), Contributing / Dev Guide (5%)

Verify Phase Gate: If a repo's average Verify score is below 50, the overall score receives a smooth penalty multiplier that scales linearly from x0.4 (verify avg = 0) to x1.0 (verify avg = 50). This reflects that without test infrastructure, autonomous bug fixing is not viable.

Readiness levels: Ready (80+), Partially Ready (60-79), Needs Work (40-59), Not Ready (<40).

All Checks Ranked by Average Score #
CheckAvg ScoreWeight
AI Context Files0 8%
Bug Report Template Quality0 8%
Type Safety / Static Analysis0 3%
PR Template0 2%
Structured Logging / Errors20 3%
Architecture Documentation30 3%
Test Fixtures / Sample Data60 2%
Build / Dependency Setup60 5%
One-Command Test Execution60 11%
Code Navigability70 5%
Test-to-Source Ratio75 15%
Dependency Complexity80 2%
Coverage Configuration80 3%
Linting / Formatting in CI80 5%
Contributing / Dev Guide80 5%
Test Isolation (unit vs e2e)90 4%
Pre-commit / Local Hooks90 3%
Generated Code Ratio100 2%
Code Ownership (CODEOWNERS)100 1%
CI Runs Tests on PRs100 10%
Detailed Heatmap #

Green (80+) = ready, Yellow (40-79) = partial, Red (<40) = gap.

RepositoryScore AI Context Files Bug Report Template Quality Structured Logging / Errors Architecture Documentation Test Fixtures / Sample Data Code Navigability Generated Code Ratio Build / Dependency Setup Type Safety / Static Analysis Dependency Complexity Code Ownership (CODEOWNERS) Test-to-Source Ratio One-Command Test Execution Coverage Configuration CI Runs Tests on PRs PR Template Linting / Formatting in CI Contributing / Dev Guide Test Isolation (unit vs e2e) Pre-commit / Local Hooks
codeflare-sdk58 0 0 20 30 60 70 100 60 0 80 100 75 60 80 100 0 80 80 90 90
Per-Repository Details #
codeflare-sdk 58/100 - Needs Work
CheckPhaseWeightScoreEvidence & Recommendation
AI Context FilesUnderstand8%0
  • No AI context files found (CLAUDE.md, AGENTS.md, etc.)
Create an AGENTS.md at the repo root describing architecture, how to build, test, and debug. For Claude users, a CLAUDE.md is also supported. Other recognized files: COPILOT.md, .cursorrules, CONTEXT.md.
Bug Report Template QualityUnderstand8%0
  • No .github/ISSUE_TEMPLATE/ directory
Add .github/ISSUE_TEMPLATE/bug_report.yml with required fields: reproduction steps, expected/actual behavior, environment, and error logs. Alternatively, if using Jira for bug tracking, document the process in CONTRIBUTING.md with a Jira link and bug reporting instructions.
Structured Logging / ErrorsUnderstand3%20
  • Error wrapping patterns (8 files)
Adopt a structured logging library (e.g., logr/zap for Go, structlog for Python, Sentry for frontend) and wrap errors with context.
Architecture DocumentationUnderstand3%30
  • 4 module-level READMEs
Add architecture documentation (ARCHITECTURE.md, docs/design/, or module-level READMEs) to help AI agents understand codebase structure.
Test Fixtures / Sample DataUnderstand2%60
  • Factory/fixture patterns in 3/20 sampled test files
Code NavigabilityNavigate5%70
  • Average file: 290 lines (138 source files, generated excluded)
  • Files >500 lines: 20 (14%)
  • Largest: ray_cluster_migration.py (2424L), test_cluster.py (2306L), support.py (2120L)
Generated Code RatioNavigate2%100
  • 0/169 files are generated (0%)
Build / Dependency SetupNavigate5%60
  • Lockfiles: Poetry lockfile
Type Safety / Static AnalysisNavigate3%0
  • No type safety or static analysis configured
Enable type checking (mypy for Python, tsconfig strict for TypeScript) or add type annotations to help AI agents understand function contracts.
Dependency ComplexityNavigate2%80
  • No dependency manifest found or zero dependencies
Code Ownership (CODEOWNERS)Submit1%100
  • OWNERS file found (OpenShift/Kubernetes-style), 26 entries
Test-to-Source RatioVerify15%75
  • 100 test files / 69 source files (ratio: 1.45)
  • Mixed test quality: 13/20 sampled test files have assertions
One-Command Test ExecutionVerify11%60
  • pytest configured in pyproject.toml
Coverage ConfigurationVerify3%80
  • Codecov configured
  • Coverage in CI workflow: unit-tests.yml
  • Coverage config in pyproject.toml
  • Multiple coverage signals detected
CI Runs Tests on PRsVerify10%100
  • CI runs tests on pull requests
  • Tests found in 6 CI workflow(s): unit-tests.yml, rayjob_e2e_tests.yaml, coverage-badge.yaml
PR TemplateSubmit2%0
  • No PR template found
Add .github/PULL_REQUEST_TEMPLATE.md with a testing checklist.
Linting / Formatting in CISubmit5%80
  • Linting in CI: pre-commit.yaml
Contributing / Dev GuideSubmit5%80
  • Found: CONTRIBUTING.md
  • 3/6 development keywords
Test Isolation (unit vs e2e)Verify4%90
  • ~76% unit tests, ~24% infra-dependent (22/29 sampled)
Pre-commit / Local HooksVerify3%90
  • .pre-commit-config.yaml found
  • Includes linting hooks

Cross-Org Comparison

OrgReposAvg ScoreReadyPartially ReadyNeeds WorkNot Ready
opendatahub-io1225418472433
project-codeflare1580010

Average Score by Org

AI Bug Automation Readiness Report · Generated 2026-05-11 09:06