Skip to content

Verdict freshness: staleness metadata + drift-aware re-decision triggers #27

Description

@aktasbatuhan

A gate_result decided last month renders identically to one decided yesterday. For a verdict to be trusted as a standing decision, it needs a freshness dimension:

  • Surface decided_at and the decision cohort size wherever a verdict is shown (view, gate output).
  • Track how many new eligible traces/cases have arrived for the task since the decision cohort was sealed, and label the verdict fresh/stale accordingly ("decided 2026-07-30 · 412 new traces since").
  • Optionally a cheap drift signal (e.g., input-length / tool-mix distribution shift between decision cohort and new traffic) as a stronger staleness cue than raw counts.

This is the trigger input for the continuous re-gate loop, but it is valuable standalone: even fully manual users should see when a verdict has gone stale.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions