perf(moe): precompute Q4_K scales for Muse concurrent decode - #1055

perf(moe): precompute Q4_K scales for Muse concurrent decode#1055

shinyuser2345-svg wants to merge 1 commit into

gittensor-ai-lab:maingittensor-ai-lab/sparkinfer:mainfrom

shinyuser2345-svg:perf/q4k-down-mma-precomputed-scalesshinyuser2345-svg/sparkinfer:perf/q4k-down-mma-precomputed-scalesCopy head branch name to clipboard