Repository navigation
feat(runs): diagnose each check failure with run diagnose --failures (WIZ-12578) - #1702
Merged
Merged
Conversation
Pin @qawolf/api-contracts 0.129.0. Since 0.127.0, run.diagnose takes failures as <attemptId>:<position>, so an attempt that failed on several checks can be diagnosed one failure at a time instead of being refused with several-failures. attempt get lists those failures (WIZ-12578).
Matt Teran (matt-teran)
marked this pull request as ready for review
November 5, 2026 22:34
run create --investigate-failures could only send true, which keeps the workspace's policy, so the generator now skips that flag. build upload gives the PUT 60 minutes, the signed URL's lifetime, so a 1 GB file fits at ~300 KB/s. A handle test pins run diagnose: no request without --failures or --flow-ids, and --failures sends only failures, issueId and runId. The changeset adds notABugReason (WIZ-12578).
Felipe Augusto (felipe-augusto)
approved these changes
Nov 5, 2026
Matt Teran (matt-teran)
deleted the
matt/wiz-12578-api-contracts-0-129
branch
November 5, 2026 23:16
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Related to WIZ-12578
Overview of Changes
qawolf run diagnosegains--failures, which diagnoses an attempt's failures one by one as<attemptId>:<position>, andqawolf attempt getnow lists each attempt's failures with their positions. Until now the CLI pinned@qawolf/api-contracts0.116.0, so a flow whose attempt failed on severalexpect.soft()checks was refused withseveral-failuresand could not be diagnosed from the CLI. This pins 0.129.0 and commits the regenerated skill and snapshots; the generator also addsdeployment reportStatus --changes <json>, plus new output fields onissue get,investigation get,activity waitandpromotion get, which the changeset lists.--flow-idsonrun diagnoseis now optional; the command needs--failuresor--flow-ids, and the CLI checks that before it sends anything. A handle test pins both cases.build uploadhelp now says "up to 1 GB by default", matchingbuild requestUploadand the server's new limit, and the upload gets 60 minutes instead of 30, the signed URL's lifetime.run createdoes not get--investigate-failures. A presence-only flag could only sendtrue, which keeps the workspace's policy, so the generator skips it through a newskippedFlagPathslist next toskippedContractNames.Testing
Checked by hand:
qawolf run diagnose --issue-id i --run-id rwithout either flag fails locally with "At least one of failures or flowIds is required.",--failures "bad value"fails with "Expected :", andqawolf run create --investigate-failuresfails with "unknown option".Checklist