Skip to content

Update Vally packages to 0.20.0 - #39461

Merged
AndriySvyryd merged 6 commits into
mainfrom
update-vally-020-audit
Oct 30, 2026
Merged

AndriySvyryd merged 6 commits into
mainfrom
update-vally-020-audit

Conversation

Copilot AI commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Updates Vally and Vally CLI to 0.20.0, refreshes vulnerable transitive dependencies, and applies a scoped Zod override for the Copilot SDK. Adapts the judge-timeout integration for Vally 0.20.
Also switches the npm repository to dotnet-public-npm.

- Upgrade Vally packages to 0.20.0 and refresh vulnerable transitive dependencies.
- Adapt harness timeout integration to Vally 0.20.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues are recorded for the Vally 0.20.0 upgrade and judge-timeout integration changes.

No open issues 🎉

1 file not reviewed
  • eng/harness-evaluation/package-lock.json: Generated file
What changed in this PR

Updates EF Core’s harness-evaluation tooling to Vally 0.20.0 and adapts its judge-timeout integration to the new behavior.

Changes:

  • Upgrades Vally packages, refreshes transitive dependencies, and adds a Copilot SDK–scoped Zod override.
  • Removes the obsolete SDK timeout-cap patch and forwards explicit timeouts to native CLI commands.
  • Updates regression tests for timeout handling, CLI argument placement, and validation messages.
File Description
eng/​harness-evaluation/​test/​harness.test.mjs Updates timeout, CLI, and mock SDK expectations.
eng/​harness-evaluation/​src/​vally.mjs Forwards explicit judge timeouts after the command or subcommand.
eng/​harness-evaluation/​src/​judge-timeout-loader.mjs Removes the obsolete SDK timeout-cap replacement.
eng/​harness-evaluation/​package.json Pins Vally 0.20.0 and adds the scoped Zod override.
eng/​harness-evaluation/​package-lock.json Records upgraded dependencies and refreshed integrity hashes.

Review effort: Balanced

@github-code-quality

github-code-quality Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Code coverage overview

Languages: C#

C# / code-coverage

main 6090cb9 update-vally-020-aud... e0ea127 +/-
76% 76% 0%
View coverage of the 10 most impacted files.
File main 6090cb9 update-vally-020-aud... e0ea127 +/-
src/EFCore.Sqli...ryRepository.cs 97% 91% -6%
src/EFCore.Abst...erExtensions.cs 100% 100% 0%
src/EFCore.Cosm...erExtensions.cs 100% 100% 0%
src/EFCore.Cosm...nsExtensions.cs 82% 82% 0%
src/EFCore.Cosm...erExtensions.cs 46% 46% 0%
src/EFCore.Cosm...peExtensions.cs 73% 73% 0%
src/EFCore.Cosm...erExtensions.cs 87% 87% 0%
src/EFCore.Cosm...delValidator.cs 98% 98% 0%
src/EFCore.Rela...osticsLogger.cs 98% 99% +1%
src/EFCore.Rela...CommandCache.cs 98% 100% +2%

ℹ️ Calculations represent line coverage. Results may change as calculations are updated.


Updated October 30, 2026 01:48 UTC

Co-authored-by: AndriySvyryd <6539701+AndriySvyryd@users.noreply.github.com>
Copilot AI requested a review from a team as a code owner October 29, 2026 22:19
Copilot AI balanced review requested due to automatic review settings October 29, 2026 22:19
Copilot AI requested a review from AndriySvyryd October 29, 2026 22:20

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

Vally 0.20 loader compatibility, native timeout/CLI integration tests, and npm audit support through the new proxy remain unverified without dependencies and network execution.

No open issues 🎉

1 file not reviewed
  • eng/harness-evaluation/package-lock.json: Generated file

Review effort: Balanced

Comment thread eng/harness-evaluation/.npmrc Resolved
Co-authored-by: AndriySvyryd <6539701+AndriySvyryd@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings October 29, 2026 22:53
Copilot AI requested a review from AndriySvyryd October 29, 2026 22:54
Co-authored-by: AndriySvyryd <6539701+AndriySvyryd@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings October 29, 2026 23:44

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues are reported for the Vally 0.20.0 harness upgrade.

No open issues 🎉

2 resolved since last review

Review effort: Balanced

@AndriySvyryd
AndriySvyryd merged commit 716a0a9 into main Oct 30, 2026
23 of 26 checks passed
@AndriySvyryd
AndriySvyryd deleted the update-vally-020-audit branch October 30, 2026 06:50
@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: code-review

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: copilot-instructions

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: change-tracking

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: cosmos-provider

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: make-custom-agent

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: make-github-actions-workflow

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: migrations

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: make-instructions

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: make-skill

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: model-building

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: run-apichief

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: query-pipeline

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: scaffolding

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: servicing-pr

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: sqlite-adonet

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: tooling

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: triage

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Agent evaluation: update-pipeline

Status: error for 716a0a9517f963afc764b157716f733523f966c3

An error occurred while generating the evaluation report.

View workflow run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants