Skip to content

perf(bonsai): gate/up stay in their ternary blocks, and packed batches past 8 rows read the whole FFN there on the int8 tensor cores (1.43x cb-decode @c16 on Ternary-Bonsai-2) - #1161

Merged
skyrocket2026 merged 1 commit into
gittensor-ai-lab:mainfrom
FranDev132:perf/bonsai-native-gate-up
Sep 25, 2026

Commits

Commits on Sep 25, 2026