perf(bonsai): decode and small packed batches read the FFN from a ternary copy through a dp4a GEMV (1.35x decode @128) - #1154

perf(bonsai): decode and small packed batches read the FFN from a ternary copy through a dp4a GEMV (1.35x decode @128)#1154

kaivaryn wants to merge 1 commit into

gittensor-ai-lab:maingittensor-ai-lab/sparkinfer:mainfrom

kaivaryn:perf/bonsai-ffn-shadow-v2kaivaryn/sparkinfer:perf/bonsai-ffn-shadow-v2Copy head branch name to clipboard