Skip to content

Fix/large batch support - #7

Closed
ckybit wants to merge 6 commits into
mainfrom
fix/tp1-large-batch
Closed

ckybit wants to merge 6 commits into
mainfrom
fix/tp1-large-batch

Conversation

@ckybit

@ckybit ckybit commented Nov 11, 2026

Copy link
Copy Markdown
Collaborator

Refs #5
Fix/tp1 large batch

Reuse the factorized proposal calculation in bounded eager chunks when no small-batch graph exists. Keep full B16 verification and native sampling/ReplaySSM fallbacks for larger batches. Add numerical and opt-in serving regressions, and correct the CPU seeded-sampler test backend. Refs #5.
Run repository hooks and lightweight CPU policy tests on PRs. Fix YAML quoting of Ruff rule arguments and make isort configuration deterministic. Add issue and PR templates, merge-rule guidance, and the batch-32 validation record.
@ckybit ckybit closed this Nov 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant