experiment: M4 Pro 24GB — 3.50 tok/s at 4-bit, architecture confirmed on 24GB#21
Open
JackCid89 wants to merge 1 commit intodanveloper:mainfrom
Open
experiment: M4 Pro 24GB — 3.50 tok/s at 4-bit, architecture confirmed on 24GB#21JackCid89 wants to merge 1 commit intodanveloper:mainfrom
JackCid89 wants to merge 1 commit intodanveloper:mainfrom