Fix Promise.all ctx.task pending effects#930
Conversation
Live-stack QAResult: not passed within the 20-minute QA wait window. Run: https://github.com/a5c-ai/babysitter/actions/runs/27028811430
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Verdict: pending/timeout, not a passing QA result. The workflow was still running when the predefined QA process timed out waiting for results. |
Live-stack QAResult: incomplete. The workflow was dispatched but did not reach a terminal conclusion within the 20-minute QA polling window. Run: https://github.com/a5c-ai/babysitter/actions/runs/27028826874
Tested matrix: [{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"}]Overall verdict: not passed because the live-stack run timed out before the selected BP/plugin scenarios completed. |
Live-stack QAResult: pending / timed out in QA watcher. The live-stack workflow was dispatched for adversarial QA, but the Babysitter QA watcher timed out after 20 minutes before the matrix jobs completed. Run: https://github.com/a5c-ai/babysitter/actions/runs/27028827889 Current job state at watcher timeout
Tested matrix[{"agent":"codex","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"codex","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"}]Overall verdict: not yet pass/fail. Build setup passed, but the selected live-stack matrix was still pending when the QA watcher timed out. |
|
Adversarial review result: blocking concerns found. GitHub would not allow this actor to submit a formal request-changes review on its own PR, so posting the review as a comment. FindingsBlocker: fixed 250ms collection window can still drop Promise.all ctx.task effects
The new test only covers 100ms and 200ms delayed task builders, so it passes while the same bug remains for slower builders/hooks. Suggested fix: replace the wall-clock grace period with deterministic accounting for in-flight Major: required CI is failing
The PR's QAI dispatched Risk AssessmentRisk level:
|
Blocking review resultI attempted to submit this as a request-changes review, but GitHub rejected it because the authenticated actor owns the PR. Recording the blocking review here instead. Blocker
Please replace the timer-dependent behavior with a deterministic contract. Either explicitly reject/document raw QAI dispatched Risk AssessmentRisk level:
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/27028826803 Result: incomplete / timed out. The workflow was still running after the 20-minute polling window in the QA process. Build and matrix setup passed; all selected live-stack scenario jobs were still in progress when polling stopped.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"}
]Overall verdict: not passed yet because the selected scenario jobs had not completed within the process timeout. |
|
Implemented the PR feedback for #930. Summary:
Verification:
|
|
Implemented PR #930 feedback. Summary:
Verification:
Commit: 5bb6fe5 |
|
Addressed the blocking review feedback on PR #930. Summary:
Verification:
|
|
Implemented the PR #930 review feedback. Summary:
Verification:
Branch state: origin/agent/issue-879 is at 5bb6fe5 (Fix PR 930 pending task feedback). |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/27033435831 Result: incomplete / timed out. The workflow was dispatched for adversarial QA against
Matrix tested: [{"agent":"codex","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"}]Overall verdict: not passed because the selected live-stack scenario jobs did not complete inside the QA watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/27033445359 Result: incomplete / timed out in QA watcher. The workflow was still
Tested matrix: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes Babysitter SDK task/orchestration internals and the tasks adapter CLI. Live-stack cannot directly target the tasks adapter CLI, so this focused matrix exercises BP plugin paths that depend on coherent task emission and orchestration across predefined process execution, process creation, native interactive mode, bridged hooks mode, and two agent/provider combinations. Overall verdict: not passed yet because the selected live-stack workflow did not reach a terminal conclusion within the QA process timeout. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/27033442923 Result: incomplete / timed out. The workflow was still running after the 20-minute polling window in the predefined QA process. Build and matrix setup passed; all selected live-stack scenario jobs were still in progress when polling stopped.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Overall verdict: not passed yet because the selected scenario jobs had not completed within the QA process timeout. |
Live-stack QAResult: incomplete / timed out in QA watcher. The live-stack workflow was dispatched for adversarial QA, but the predefined QA process reached its 20-minute polling timeout before the workflow completed. Run: https://github.com/a5c-ai/babysitter/actions/runs/27033459858
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Overall verdict: not passed within the QA wait window. The workflow was still running when the watcher timed out, so this is not a green QA result. |
|
Blocking this PR for correctness and verification reasons. FindingsBlocker: fixed 250ms collection window can still drop Promise.all ctx.task effects
A sibling Suggested fix: replace the wall-clock grace period with deterministic in-flight Major: regression test fits inside the implementation timer
The new regression delays sibling task builders by 100ms and 200ms, while the implementation waits 250ms. That proves the fixture fits under the timer; it does not prove raw Please add a regression where a sibling task emits after more than the current collection window and assert that Major: required quality gates are not green
The PR should not merge until the required check is green and the targeted SDK tests/build pass in an installed workspace. QAI dispatched Risk AssessmentRisk level:
|
|
Adversarial review result: request changes. FindingsBlocker: fixed 250 ms collection window can still drop raw
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28433740956 Result: incomplete / timed out in QA watcher. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes SDK task/orchestration internals and task intrinsics, so BP install scenarios exercise the full Babysitter process loop where pending-effect coherence matters. Codex/Gemini and Claude/Foundry cover two harness/provider paths. Predefined mode stresses deterministic existing process execution; create mode stresses process authoring and task emission; interactive and bridged-hooks cover native BP and hook bridge paths. The tasks-adapter CLI rename is not directly covered by live-stack axes, so this matrix focuses on the affected orchestration surface available to the workflow. Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs did not complete before timeout. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28433740892 Result: incomplete / timed out in QA watcher. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes Babysitter SDK task/orchestration internals, so this focused adversarial matrix exercises BP/plugin paths that depend on coherent task emission and run orchestration across predefined process execution, process creation, native interactive mode, bridged hooks mode, and two agent/provider combinations. The tasks-adapter CLI change does not map directly to a live-stack scenario and should remain covered by targeted adapter CLI tests. Overall verdict: not passed within the QA wait window. The selected live-stack scenario jobs did not complete, so this is not a green QA result. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28433746081 Result: incomplete / timed out in QA watcher. The workflow was still
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: focused adversarial coverage for PR #930's SDK orchestration changes around raw Overall verdict: not passed within the QA wait window. The workflow should be inspected or allowed to finish before treating this as green QA. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28433746363 Result: incomplete / timed out in QA watcher. The workflow did not reach a terminal conclusion within the predefined 20-poll QA window. Build and matrix setup passed; the selected BP live-stack scenario jobs were still queued at final capture.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes SDK orchestration/task internals for raw Overall verdict: not passed because the live-stack scenario jobs did not complete inside the QA watcher window. |
|
Adversarial review result: request changes. FindingsBlocker: in-flight task accounting is process-global and can corrupt concurrent runs
The fix replaces the fixed 250 ms collection window with If run A is waiting for slow raw Please move the new/in-flight effect request accounting onto the per-run process context or an AsyncLocalStorage-scoped execution tracker, and add a regression with two concurrent Blocker: latest PR-head CI is failed
The latest CI run I found on head This PR changes central SDK orchestration behavior; it should not merge while the main package gate is red. Major: live-stack QA did not pass
The QA dispatch I ran completed its dispatcher job, but the live-stack QA it launched did not pass within the watcher window. The QA comments posted runs including Risk AssessmentRisk level:
GitHub rejected a formal request-changes review for this actor; recording the blocking review as a comment. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28487267824 Result: failed. The selected BP/plugin live-stack scenarios did not run because the workflow failed in
Failure detail: Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes SDK task/orchestration internals around raw Adapter CLI verification: attempted Overall verdict: not passed. Re-run live-stack after dependency install is healthy, and run the targeted tasks-adapter CLI test in an installed workspace. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28487187979 Result: incomplete / timed out in QA watcher. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes SDK runtime orchestration and task intrinsics around concurrent Overall verdict: not passed within the QA watcher window. The workflow should be inspected or allowed to finish before treating this as green QA. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28487183083 Result: incomplete / timed out in QA watcher. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes Babysitter SDK task/orchestration internals and task intrinsics around raw Overall verdict: not passed within the QA wait window. The selected live-stack scenario jobs did not complete before timeout. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28694320138 Result: not passed within the 20-minute QA wait window.
Matrix tested: [{"agent":"codex","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}]Matrix rationale: PR #930 changes central Babysitter SDK task/orchestration internals around raw Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but all selected live-stack scenario jobs were still non-terminal after the watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28694308945 Result: not passed within the QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [{"agent":"codex","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}]Matrix rationale: PR #930 changes central SDK Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal after the watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28694312513 Result: failed. The predefined 20-minute watcher timed out while the workflow was still in progress; a fresh post-timeout snapshot shows the workflow has since completed with conclusion failure.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK/runtime Overall verdict: not passed. Failing scenarios: Claude BP create bridged-hooks, Codex BP predefined bridged-hooks, and Codex BP predefined interactive. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28694323849 Result: failed.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK orchestration and Overall verdict: not passed. The failed scenarios were Codex BP/predefined interactive, Codex BP/predefined bridged-hooks, and Claude BP/create bridged-hooks. |
|
Adversarial review result: request changes. FindingsBlocker: in-flight task accounting is process-global and can corrupt concurrent runs
The PR stores A long-lived SDK host can orchestrate two different runDirs concurrently in one Node process. If run A is waiting for slow raw There is also a second failure mode: if one run resets the global count while another run still has in-flight requests, the original run's Please move request tracking onto per-run/per-process execution state, for example Blocker: the collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir journal after Blocker: required PR-head CI is failing
This PR changes central SDK orchestration behavior and should not merge while the main package gate is red. Major: regression coverage misses the new concurrency boundary
The added delayed-builder test is useful, but it only covers one run. It does not cover the implementation's actual risk boundary: two different runDirs orchestrated concurrently in the same Node process while sharing module globals. Please add a regression where run A has slow raw Major: PR is not in a mergeable review statePR metadata currently reports QAI dispatched Latest PR QA results report downstream live-stack failures in runs Risk AssessmentRisk level:
|
|
GitHub rejected a formal request-changes review for this actor because it owns the PR, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores If run A is waiting for slow raw Please move request tracking onto per-run/per-process-execution state, for example Blocker: iteration reset/wait uses shared process-wide state
The collector needs to know that this execution's task requests have settled, then scan only this runDir's journal. Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the actual concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Latest posted live-stack QA reports run Overall QA verdict: not passed. Risk AssessmentRisk level:
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729352448 Result: failed. The predefined QA watcher reached its 20-minute window while the workflow was still non-terminal; a fresh post-timeout snapshot shows three selected live-stack scenarios failed.
Matrix tested: [{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}]Matrix rationale: PR #930 changes central Babysitter SDK runtime Overall verdict: not passed. Failing scenarios: Codex BP/predefined interactive, Codex BP/predefined bridged-hooks, and Claude BP/create bridged-hooks. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729358605 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK/runtime Overall verdict: not passed within the QA wait window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729356133 Result: not passed within the 20-minute QA wait window. The workflow was still
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK Overall verdict: not passed. Failed scenarios at timeout: Codex BP/predefined bridged-hooks and Claude BP/create bridged-hooks. Codex BP/predefined interactive and Claude BP/create interactive were still non-terminal when the QA watcher timed out. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729357150 Result: failed. The predefined 20-minute watcher reached its wait window while the workflow was still in progress; a fresh post-timeout snapshot shows two selected live-stack scenarios failed, two passed, and the report job was still running.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK runtime Overall verdict: not passed. Failing scenarios: Codex BP/predefined bridged-hooks and Claude BP/create bridged-hooks. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729362179 Result: not passed. The predefined 20-minute QA watcher timed out while the workflow was still in progress, and both bridged-hooks scenarios had already failed.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK runtime orchestration and Overall verdict: not passed. Failed scenarios: Codex BP/predefined bridged-hooks and Claude BP/create bridged-hooks. The Codex BP/predefined interactive and Claude BP/create interactive scenarios were still non-terminal at the watcher timeout. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729360170 Result: not passed. The workflow was still in progress at the 20-minute QA watcher limit, and the snapshot already includes failing live-stack jobs.
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK runtime task/orchestration behavior for raw Overall verdict: not passed. Failing scenarios: Codex BP/predefined bridged-hooks and Claude BP/create bridged-hooks. Codex BP/predefined interactive was still in progress at the watcher timeout. |
|
GitHub rejected a formal request-changes review for this actor because it owns the PR, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores A long-lived SDK host can orchestrate two different runDirs concurrently in one Node process. If run A is waiting for slow raw Please move request tracking onto per-run/per-process execution state, for example Blocker: collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the actual concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Existing PR QA comments also report failed live-stack scenarios for this PR, including Codex BP/predefined interactive, Codex BP/predefined bridged-hooks, and Claude BP/create bridged-hooks. Risk AssessmentRisk level:
|
|
Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores A long-lived SDK host can orchestrate two different runDirs concurrently in one Node process. If run A is waiting for slow raw Please move request tracking onto per-run/per-process execution state, for example Blocker: the collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the new concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Latest QA comments during this dispatch window report failed/not-passed live-stack runs, including failures in Codex BP/predefined bridged-hooks and Claude BP/create bridged-hooks scenarios. Other selected scenarios were still non-terminal at watcher timeout in some runs. Risk AssessmentRisk level:
|
|
GitHub rejected a formal request-changes review for this actor, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores If run A has slow raw There is a second failure mode: one run can reset the counter while another still has in-flight requests, then the original run's Please move request tracking onto per-run/per-process execution state, such as Blocker: iteration reset and collector wait on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir's journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the new concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Fresh QA comments posted around 2026-07-05 04:43 UTC report failures/timeouts. Representative runs include:
Overall QA verdict: not passed. Risk AssessmentRisk level:
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729448949 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK runtime Overall verdict: not passed within the QA wait window. No selected live-stack scenario jobs had reached a terminal result by the final snapshot. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28729451697 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK/runtime Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal after the watcher window. |
|
GitHub rejected a formal request-changes review for this actor because it owns the PR, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores A long-lived SDK host can orchestrate two different runDirs concurrently in one Node process. If run A is waiting for slow raw There is also a second failure mode: if one run resets the global count while another run still has in-flight requests, the original run's Please move request tracking onto per-run/per-process-execution state, for example Blocker: collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir's journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the actual concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Overall QA verdict: not passed within the review window. Risk AssessmentRisk level:
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28767919856 Result: not passed within the 20-minute QA wait window. The workflow was still
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK/runtime Overall verdict: not passed. The failed bridged-hooks jobs are blocking QA, and the selected interactive jobs did not complete inside the predefined watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28767920390 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK/runtime Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal after the watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28767925474 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK runtime Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal when reported. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28767931964 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK Overall verdict: not passed within the QA wait window. No selected live-stack scenario jobs had reached a terminal result by the final watcher snapshot. |
|
GitHub rejected a formal request-changes review for this actor because it owns the PR, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores If run A has slow raw There is a second failure mode: one run can reset the counter while another still has in-flight requests, then the original run's Please move request tracking onto per-run/per-process-execution state, such as Blocker: the collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the actual concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Overall QA verdict: not passed within the review window. Risk AssessmentRisk level:
|
|
GitHub rejected a formal request-changes review for this actor because it owns the PR, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight ctx.task accounting is process-global and can corrupt concurrent runs
The PR stores A long-lived SDK host can orchestrate two different runDirs concurrently in one Node process. If run A is waiting for slow raw Please move request tracking onto per-run/per-process-execution state, for example Blocker: collector waits on unrelated global state
The collector needs to know that this execution's task requests have settled, then scan only this runDir journal after Blocker: required PR-head CI is failing
Blocker: PR is draft and conflicting
PR metadata reports Major: regression coverage misses the actual concurrency boundary
The delayed raw Please add a regression where run A has slow raw QAI dispatched Overall QA verdict: not passed. Risk AssessmentRisk level:
|
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28841253386 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK/runtime Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but no selected live-stack scenario reached a terminal result inside the predefined watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28841240949 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK runtime/orchestration behavior for Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal after the watcher window. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28841276630 Result: not passed. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central Babysitter SDK runtime Overall verdict: not passed. The failed selected live-stack jobs are blocking QA. |
Live-stack QARun: https://github.com/a5c-ai/babysitter/actions/runs/28841243740 Result: not passed within the 20-minute QA wait window. The workflow was dispatched for adversarial QA against
Matrix tested: [
{"agent":"codex","model":"google-gemini31","mode":"interactive","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"codex","model":"google-gemini31","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"predefined"},
{"agent":"claude","model":"foundry-gpt55","mode":"interactive","install":"bp","live":true,"process_mode":"create"},
{"agent":"claude","model":"foundry-gpt55","mode":"bridged-hooks","install":"bp","live":true,"process_mode":"create"}
]Matrix rationale: PR #930 changes central SDK runtime Overall verdict: not passed within the QA wait window. Build setup and matrix computation passed, but the selected live-stack scenario jobs were still non-terminal after the predefined watcher window. |
|
GitHub rejected a formal request-changes review for this actor, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight
|
|
GitHub rejected a formal request-changes review for this actor, so recording the blocking review as a comment. Adversarial review result: request changes. FindingsBlocker: in-flight
|
Fixes #879.
Summary:
Tests: