Increase timeout for evaluation run to 150 minutes - #369
Conversation
There was a problem hiding this comment.
Pull request overview
This PR updates the GitHub Actions evaluation workflow runtime budget to reduce job cancellations for long-running evaluation scenarios (notably dotnet-upgrade), aligning with the timeout investigations linked in issue #288.
Changes:
- Increase the
evaluatejob timeout from 90 minutes to 150 minutes in the reusable evaluation workflow.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
You can also share your feedback on Copilot code review. Take the survey.
Skill Validation Results
[1] (Plugin) Quality unchanged but weighted score is -25.0% due to: completion (✓ → ✗), tokens (11858 → 50417), tool calls (0 → 3), time (10.1s → 23.9s)
Model: claude-opus-4.6 | Judge: claude-opus-4.6 |
|
Superseded by #354 |
Motivation
Regular timeouts of dotnet-update eval scenarios
Investigation details: #288 (comment)