Skip to content

spec: falsifiable-by-replay evidence — ship the probe recipe inside the stamp #128

Description

@HMAKT99

Raised by Mike Czerwinski on the launch post.

The insight: a signature proves who said it; a replay proves it could have been true. AKF stamps today are signer==subject (the agent attests to its own work) — an accountability trail, not verification. What makes an attestation reusable by strangers is falsifiability: anyone can re-run the probe and diff against the claimed result.

Proposed: extend Evidence with an optional replay recipe:

  • replay.command (e.g. pytest -q), replay.cwd, replay.expected_exit, optional replay.output_digest
  • New akf verify <file>: re-runs the recipe and reports CONFIRMED / REFUTED / UNREPLAYABLE — turning claimed evidence into checkable evidence
  • akf check could weight replayable evidence above bare receipts — which also gives trust: evidence weighting can be gamed by weak tests (stamp inflation) #125 (stamp inflation) a principled answer: a weak test can still be replayed and seen to be weak

Touches: python/akf/models.py (Evidence), stamp.py, check.py, new verify command.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions