feat(gguf,dsv4): GGUF v3 reader + DeepSeek-V4-Flash GGUF loader & forward path - #17

Merged

TheTom merged 13 commits into

devfrom

tom/wip/gguf-loader-and-dsv4

Jun 23, 2026

Commits on Jun 10, 2026

feat(loader): GGUF v3 reader + DeepSeek-V4 tensor bundle & block dequant
TheTom
committed
feat(ops): DeepSeek-V4 MoE/attention Metal ops + live-compile PSO cache
TheTom
committed
feat(model): DeepSeek-V4-Flash prefill + decode forward
TheTom
committed
feat(kernels): NAX (matmul2d) + simdgroup MoE GEMM kernel sources
TheTom
committed
feat(cli): dsv4bench harness (prefill/decode throughput + correctness)
TheTom
committed
test(dsv4): GGUF reader/ops/integration + Device scratch tests + M5 Max perf log
TheTom
committed
chore(dsv4): scrub WIP labels from status comments + neutralize bench default path
TheTom
committed
fix(loader): nonisolated(unsafe) on resident-gather pool pointers for Swift 6.1
TheTom
committed
refactor(dsv4): address review — consolidate model files, drop dev/ + dsv4 bench command + maxTokens default
TheTom
committed
refactor(dsv4): move system-free-memory check into MemoryStats
TheTom
committed
chore(test): neutralize ds4-model default path → deepseek-v4-flash
TheTom
committed
test(dsv4): pare integration suite to 4-point pattern + add GGUF coverage
TheTom
committed
chore(bench): neutralize machine-local model paths in M5 Max bench log
TheTom
committed