Skip to content

Deferred: framework-evaluation team (wave-parallel, 5 members) #189

@pjt222

Description

@pjt222

Summary

Status: DEFERRED — Design documented for future activation when solo evaluations prove insufficient.

Concept

A wave-parallel team for multi-perspective framework evaluation:

Member Agent Role Wave
Lead framework-scout Scout & Synthesizer 1, 3, 4
Architect senior-software-developer Architecture Reviewer 2
Security security-analyst Security Surface Assessor 2
Contrarian advocatus-diaboli Constructive Challenge 3

Tending checkpoints (center, rest, meditate) invoked by lead between waves — not via a dedicated contemplative member.

Why Deferred (Adversarial Review)

The devil's advocate landed several strong hits:

  1. "A 5-person committee to decide whether to fork a repo." The coordination overhead exceeds the value at current evaluation volume (~1-3 per quarter).
  2. Wave-parallel is the wrong pattern. Most waves have 1-2 agents. This is sequential coordination wearing a wave-parallel costume.
  3. Contemplative as team member is a category error. Every agent inherits tending skills. A dedicated agent for checkpoints adds token cost and latency without unique value. The lead should invoke tending directly.
  4. The "just do it" baseline. A manual 30-minute evaluation produces nearly identical information content at 1/5th the coordination cost.

Design Adjustment from Review

  • Removed contemplative as dedicated member (tending invoked by lead instead)
  • Reduced from 5 to 4 members
  • Acknowledged that hub-and-spoke or sequential may be more honest patterns

Activation Trigger

Create this team when:

  • 3+ frameworks evaluated by framework-scout solo
  • At least 1 evaluation retrospective reveals a perspective that was missed
  • Evaluation volume increases to justify coordination overhead

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions