Skip to content

feat(replay): falsifiable-by-replay evidence + akf replay - #132

Merged
HMAKT99 merged 1 commit into
mainfrom
v16-replay
Jul 14, 2026
Merged

feat(replay): falsifiable-by-replay evidence + akf replay#132
HMAKT99 merged 1 commit into
mainfrom
v16-replay

Conversation

@HMAKT99

@HMAKT99 HMAKT99 commented Jul 14, 2026

Copy link
Copy Markdown
Owner

Second of the v1.6 "from claimed to checkable" series. Closes #128.

A signature proves who said it; a replay proves it could have been true.

  • akf stamp file --replay "pytest -q" records a probe recipe in evidence: command, expected exit, optional output digest, and an input fingerprint pinned at issuance (over recorded dependencies + pinned sources)
  • New akf replay <file>: default = safe inspection (recipe + input drift); --run executes:
    • CONFIRMED (0) — probe succeeded, inputs match issuance
    • CONFIRMED_DRIFTED (1) — probe succeeded against diverged inputs: provably reproducible, possibly reproducibly wrong
    • REFUTED (2) / UNREPLAYABLE (3)
  • MCP server gains replay_file (11th tool) — execution opt-in, labeled arbitrary-code
  • Python API akf.verify_file(); CLI named replay because akf verify is taken by Ed25519 signature verification (found by collision in testing)
  • Dogfood: python/akf/verify.py's own stamp carries a replay recipe pointing at its test suite

Tests: 10 new (record → inspect → confirm → drift-split → refute → unreplayable + CLI); 33 pass across verify/deps/check.

Design credit: Mike Czerwinski — the input fingerprint and the CONFIRMED/CONFIRMED_DRIFTED split are his.

A signature proves who said it; a replay proves it could have been
true. Evidence can now carry a probe recipe recorded at stamp time:
command, expected exit, optional output digest, and an input
fingerprint pinned at issuance (over recorded deps + pinned sources).

New 'akf replay <file>': default is safe inspection (recipe + input
drift); --run executes. CONFIRMED (0) / CONFIRMED_DRIFTED (1) /
REFUTED (2) / UNREPLAYABLE (3). CLI named 'replay' because 'akf
verify' is taken by signature verification. MCP gains replay_file
(11 tools). Design credit: Mike Czerwinski.
@vercel

vercel Bot commented Jul 14, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
akf Ready Ready Preview, Comment Jul 14, 2026 1:22pm
akf18 Ready Ready Preview, Comment Jul 14, 2026 1:22pm

@github-actions

Copy link
Copy Markdown

AKF Trust Certification — ✅ Certified

❌ 0/11 files certified · average trust 0.45 · 3 failed

File Trust Evidence Issues
skills/check.md 0.26 other ai_content_without_review, trust_below_threshold, hallucination_risk, knowledge_laundering, ungrounded_ai_claims, excessive_ai_concentration, provenance_gap, unknown, unknown, unknown, unknown, unknown, unknown, unknown
skills/hermes-akf/SKILL.md 0.54 human_review ai_content_without_review, hallucination_risk, knowledge_laundering, ungrounded_ai_claims, excessive_ai_concentration, provenance_gap, unknown, unknown, unknown, unknown, unknown, unknown
skills/openclaw-akf/SKILL.md 0.54 human_review ai_content_without_review, hallucination_risk, knowledge_laundering, ungrounded_ai_claims, excessive_ai_concentration, provenance_gap, unknown, unknown, unknown, unknown, unknown, unknown

Total: 11 | Certified: 0 | Failed: 3 | Skipped: 8

Generated by AKF Certify

@HMAKT99
HMAKT99 merged commit c28d0d7 into main Jul 14, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

spec: falsifiable-by-replay evidence — ship the probe recipe inside the stamp

1 participant