Skip to content

Fix/tp1 large batch - #6

Closed
ckybit wants to merge 5 commits into
mainfrom
fix/tp1-large-batch
Closed

ckybit wants to merge 5 commits into
mainfrom
fix/tp1-large-batch

Conversation

@ckybit

@ckybit ckybit commented Nov 11, 2026

Copy link
Copy Markdown
Collaborator

Refs #5
Support TP1 large batches and add contributor checks

Reuse the factorized proposal calculation in bounded eager chunks when no small-batch graph exists. Keep full B16 verification and native sampling/ReplaySSM fallbacks for larger batches. Add numerical and opt-in serving regressions, and correct the CPU seeded-sampler test backend. Refs #5.
Run repository hooks and lightweight CPU policy tests on PRs. Fix YAML quoting of Ruff rule arguments and make isort configuration deterministic. Add issue and PR templates, merge-rule guidance, and the H200 batch-32 validation record.
@ckybit ckybit closed this Nov 11, 2026
@ckybit
ckybit deleted the fix/tp1-large-batch branch November 11, 2026 04:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant