Skip to content

Add review, query commands and pre-recorded answers support#362

Draft
rcj-siteimprove wants to merge 21 commits into
mainfrom
cli-record-questions-mode
Draft

Add review, query commands and pre-recorded answers support#362
rcj-siteimprove wants to merge 21 commits into
mainfrom
cli-record-questions-mode

Conversation

@rcj-siteimprove
Copy link
Copy Markdown
Contributor

@rcj-siteimprove rcj-siteimprove commented May 8, 2026

  • Adds alfa review command for recording oracle Q&A sessions (answer, list, reset, status subcommands)
  • Adds alfa query command for inspecting and filtering audit result files
  • Extends alfa audit with --alfa-dir flag to auto-load pre-recorded answers, so oracle questions are resolved automatically on subsequent runs
  • Adds a Claude Code skill definition (skills/alfa/SKILL.md) documenting the full review → audit → query workflow

Notes

The audit command currently uses the standard ruleset. Experimental rules (R98, R101) are commented out pending publication of the local alfa packages.

Test plan

  • alfa review <url> lists unanswered questions
  • alfa review answer <hash=value>... records answers and surfaces follow-up questions
  • alfa review reset clears the session
  • alfa review status shows answered/unanswered counts
  • alfa audit <url> picks up pre-recorded answers from --alfa-dir
  • alfa query <file> filters and inspects audit results

Enables commands that accept both positional arguments and
subcommands — neither withSubcommands nor withArguments alone
supports this combination.
Page serialized at High verbosity so every node carries internalId.
Outcomes serialized at Minimal verbosity as {type, internalId} stubs
— consumers resolve nodes by looking up internalId in the page,
avoiding duplicate node data across every outcome.
Adds `alfa interview` for recording oracle Q&A sessions and `alfa query`
for inspecting audit results. The audit command gains an `--alfa-dir` flag
to load pre-recorded answers so questions are resolved automatically on
subsequent runs. Includes a Claude Code skill definition for the full
interview → audit → query workflow.
@rcj-siteimprove rcj-siteimprove self-assigned this May 8, 2026
@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented May 8, 2026

🦋 Changeset detected

Latest commit: 52291f9

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 28 packages
Name Type
@siteimprove/alfa-cli Minor
@siteimprove/alfa-formatter-json Minor
@siteimprove/alfa-angular-test Minor
@siteimprove/alfa-angular Minor
@siteimprove/alfa-assert Minor
@siteimprove/alfa-chai Minor
@siteimprove/alfa-cheerio Minor
@siteimprove/alfa-command Minor
@siteimprove/alfa-crawler Minor
@siteimprove/alfa-cypress Minor
@siteimprove/alfa-formatter-earl Minor
@siteimprove/alfa-formatter-sarif Minor
@siteimprove/alfa-formatter Minor
@siteimprove/alfa-frontier Minor
@siteimprove/alfa-interviewer Minor
@siteimprove/alfa-jasmine Minor
@siteimprove/alfa-jest Minor
@siteimprove/alfa-jquery Minor
@siteimprove/alfa-playwright Minor
@siteimprove/alfa-puppeteer Minor
@siteimprove/alfa-react Minor
@siteimprove/alfa-scraper Minor
@siteimprove/alfa-selenium Minor
@siteimprove/alfa-test-utils Minor
@siteimprove/alfa-unexpected Minor
@siteimprove/alfa-vitest Minor
@siteimprove/alfa-vue Minor
@siteimprove/alfa-webdriver Minor

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

import type { Oracle } from "@siteimprove/alfa-act";
import type { Document } from "@siteimprove/alfa-dom";
import { Future } from "@siteimprove/alfa-future";
import { None, Option } from "@siteimprove/alfa-option";
@rcj-siteimprove rcj-siteimprove changed the title Add interview, query commands and pre-recorded answers support Add review, query commands and pre-recorded answers support May 8, 2026
@rcj-siteimprove
Copy link
Copy Markdown
Contributor Author

!pr extract

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants