Skip to content

[BUG] Arbitration Resolution Always Picks First Response (Stub Methods) #174

@shrixtacy

Description

@shrixtacy

Description

All three resolution methods in ConcreteArbitrationLayer are stubs that always return the first response ID:

  • _resolve_content_contradiction → conflict.response_ids[0]
  • _resolve_confidence_conflict → conflict.response_ids[0]
  • _resolve_quality_conflict → conflict.response_ids[0]

They never compare actual response quality, confidence scores, or content.

Component

ai_council/arbitration/layer.py:246-274

How to Reproduce

Run a BEST_QUALITY query with 2+ models. Even if model B has higher confidence, model A's response is always chosen in conflict resolution.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions