Skip to content

Update Vally packages to 0.20.0 #1064

Update Vally packages to 0.20.0

Update Vally packages to 0.20.0 #1064

Triggered via pull request October 30, 2026 06:50
Status Failure
Total duration 9m 59s
Artifacts –

agent-harness-evaluation.yml

on: pull_request_target
discover
7s
discover
Matrix: evaluate
evaluation
2s
evaluation
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 37 warnings
evaluate (copilot-instructions)
Process completed with exit code 1.
evaluate (code-review)
Process completed with exit code 1.
evaluate (change-tracking)
Process completed with exit code 1.
evaluate (make-custom-agent)
Process completed with exit code 1.
evaluate (cosmos-provider)
Process completed with exit code 1.
evaluate (make-github-actions-workflow)
Process completed with exit code 1.
evaluate (migrations)
Process completed with exit code 1.
evaluate (make-instructions)
Process completed with exit code 1.
evaluate (make-skill)
Process completed with exit code 1.
evaluate (model-building)
Process completed with exit code 1.
evaluate (run-apichief)
Process completed with exit code 1.
evaluate (query-pipeline)
Process completed with exit code 1.
evaluate (scaffolding)
Process completed with exit code 1.
evaluate (servicing-pr)
Process completed with exit code 1.
evaluate (sqlite-adonet)
Process completed with exit code 1.
evaluate (tooling)
Process completed with exit code 1.
evaluate (triage)
Process completed with exit code 1.
evaluate (update-pipeline)
Process completed with exit code 1.
evaluation
Process completed with exit code 1.
evaluation
At least one agent harness component comparison failed.
Workflow execution policy warning (evaluate mode): .github/workflows/agent-harness-evaluation.yml#L1
On December 2, 2026, GitHub will restrict `pull_request_target` on public repositories by default. To continue allowing the event trigger, configure an Actions policy. Learn more: https://gh.io/securely-using-pull_request_target#default-policy-for-pull_request_target
evaluate (copilot-instructions)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/copilot-instructions', found 0.
evaluate (copilot-instructions)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/copilot-instructions/. No artifacts will be uploaded.
evaluate (code-review)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/code-review', found 0.
evaluate (code-review)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/code-review/. No artifacts will be uploaded.
evaluate (change-tracking)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/change-tracking', found 0.
evaluate (change-tracking)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/change-tracking/. No artifacts will be uploaded.
evaluate (make-custom-agent)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/make-custom-agent', found 0.
evaluate (make-custom-agent)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/make-custom-agent/. No artifacts will be uploaded.
evaluate (cosmos-provider)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/cosmos-provider', found 0.
evaluate (cosmos-provider)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/cosmos-provider/. No artifacts will be uploaded.
evaluate (make-github-actions-workflow)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/make-github-actions-workflow', found 0.
evaluate (make-github-actions-workflow)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/make-github-actions-workflow/. No artifacts will be uploaded.
evaluate (migrations)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/migrations', found 0.
evaluate (migrations)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/migrations/. No artifacts will be uploaded.
evaluate (make-instructions)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/make-instructions', found 0.
evaluate (make-instructions)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/make-instructions/. No artifacts will be uploaded.
evaluate (make-skill)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/make-skill', found 0.
evaluate (make-skill)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/make-skill/. No artifacts will be uploaded.
evaluate (model-building)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/model-building', found 0.
evaluate (model-building)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/model-building/. No artifacts will be uploaded.
evaluate (run-apichief)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/run-apichief', found 0.
evaluate (run-apichief)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/run-apichief/. No artifacts will be uploaded.
evaluate (query-pipeline)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/query-pipeline', found 0.
evaluate (query-pipeline)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/query-pipeline/. No artifacts will be uploaded.
evaluate (scaffolding)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/scaffolding', found 0.
evaluate (scaffolding)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/scaffolding/. No artifacts will be uploaded.
evaluate (servicing-pr)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/servicing-pr', found 0.
evaluate (servicing-pr)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/servicing-pr/. No artifacts will be uploaded.
evaluate (sqlite-adonet)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/sqlite-adonet', found 0.
evaluate (sqlite-adonet)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/sqlite-adonet/. No artifacts will be uploaded.
evaluate (tooling)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/tooling', found 0.
evaluate (tooling)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/tooling/. No artifacts will be uploaded.
evaluate (triage)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/triage', found 0.
evaluate (triage)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/triage/. No artifacts will be uploaded.
evaluate (update-pipeline)
Could not parse treatment grades: Expected one Vally experiment below 'candidate/artifacts/TestResults/harness-evaluation/update-pipeline', found 0.
evaluate (update-pipeline)
No files were found with the provided path: candidate/artifacts/TestResults/harness-evaluation/update-pipeline/. No artifacts will be uploaded.