Skip to content

fix: isolate perf workloads for verify budget#75

Merged
davidahmann merged 1 commit intomainfrom
codex/fix-verify-perf-v107
Feb 28, 2026
Merged

fix: isolate perf workloads for verify budget#75
davidahmann merged 1 commit intomainfrom
codex/fix-verify-perf-v107

Conversation

@davidahmann
Copy link
Contributor

Problem

v1 release preflight was failing in scripts/test_perf_budgets.sh on the verify_chain command budget.

The perf harness measured command budgets against state-100.json after also running a 500-repo scan in the same temp directory. Because proof chains are keyed by state directory, the 100-repo verify checks were run against a chain that already included both workloads, inflating chain size and causing false failures.

Changes

  • Updated scripts/test_perf_budgets.sh to isolate 100-repo and 500-repo scans into separate workspace roots.
  • Kept command-budget checks (score, verify --chain, regress run) tied to the 100-repo workload chain only.
  • Preserved existing scan-duration checks for both 100 and 500 repo workloads.

Validation

  • scripts/test_perf_budgets.sh
  • scripts/run_v1_acceptance.sh --mode=release
  • make prepush-full

@davidahmann davidahmann merged commit 400f1fb into main Feb 28, 2026
7 checks passed
@davidahmann davidahmann deleted the codex/fix-verify-perf-v107 branch February 28, 2026 04:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant