feat(evaluator): parity sync, Claude SDK adapter, kiro per-stage gates, shared simulator#235

Open

harmjeff wants to merge 37 commits into

awslabs:mainfrom

harmjeff:fix/evaluator-update

Commits on Apr 29, 2026

feat(evaluator): parity sync + Claude SDK adapter with interactive simulator

harmjeff
and
claude
committed
fix(evaluator): support podman as docker fallback, skip sandbox check with --no-sandbox

harmjeff
and
claude
committed
fix(evaluator): container runtime detection + deterministic run folder allocation

harmjeff
and
claude
committed
fix(evaluator): add aidlc-cli-harness to root workspace dependencies

harmjeff
and
claude
committed
fix(evaluator): runner Mode 1, sdk adapter bugs, orchestrator script path

harmjeff
and
claude
committed
fix(sdk-adapter): add post-run test evaluation (stage 2)

harmjeff
and
claude
committed
feat(evaluator): inject OpenAPI contract into all human-analog agents

harmjeff
and
claude
committed
feat(evaluator): shared HumanSimulator + kiro-cli human analog review

harmjeff
and
claude
committed
fix(evaluator): wire simulator model from config into CLI adapter runs

harmjeff
and
claude
committed
feat(evaluator): Strands swarm uses shared HumanSimulator for all modes

harmjeff
and
claude
committed
fix(evaluator): separate executor and simulator token tracking for full mode

harmjeff
and
claude
committed
fix(sdk-adapter): import _get_container_cli from shared.sandbox

harmjeff
and
claude
committed
fix(kiro-adapter): add post-run test evaluation (stage 2)

harmjeff
and
claude
committed
fix(sandbox): pin base image to Python 3.13 instead of 3.14

harmjeff
and
claude
committed
fix(kiro-adapter): interactive stdin mode for genuine simulator gate reviews

harmjeff
and
claude
committed

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 5, 2026