Implement new experimental lookup-based matrix multiplication method(TMAC)#26695

Open

vraspar wants to merge 51 commits intomainfrom

vraspar/lut-gemm

Commits on Jan 30, 2025

init code structure for matmul 2 bits
liqunfu
committed

Commits on Jan 31, 2025

Commits on Feb 3, 2025

Commits on Mar 7, 2025

2 bit quantize to support model builder
liqunfu
committed

Commits on Jul 16, 2025

Merge remote-tracking branch 'msft/main' into carzh/bitnet-reverse-last-commit
carzh
committed

Commits on Jul 17, 2025

fix compile errors
carzh
committed

Commits on Jul 18, 2025

resolve build failure update
carzh
committed

Commits on Jul 23, 2025

2 bits check
HectorSVC
committed

Commits on Jul 25, 2025

fixed bug causing int8 tests to fail
carzh
committed

Commits on Aug 7, 2025

Commits on Aug 13, 2025

prepack wip -- not prepacking b data because dispatch to check for mlas kernel not implemented for fp32. Also, I need to write the packing logic for the scales as well.
carzh
committed

Commits on Aug 15, 2025

fixed dispatch issue, added acc level 4 tests, and now running into assert issue with the data shuffling in prepack
carzh
committed

Commits on Sep 2, 2025

deep sigh
Caroline Zhu
committed

Commits on Sep 4, 2025

builds somehow
Caroline Zhu
committed

Commits on Sep 10, 2025

update
Caroline Zhu
committed

Commits on Sep 16, 2025

udpate
Caroline Zhu
committed

Commits on Oct 1, 2025

Implement Pre Packing of qweight for tmac
vraspar
committed

Commits on Oct 6, 2025

Commits on Oct 7, 2025

Initial implementation of tmac kernel config
vraspar
committed

Commits on Oct 8, 2025

Move pre packing scales and zp code to qlutgemm and use tmac_params
vraspar
committed

Commits on Oct 13, 2025

update
Caroline Zhu
committed

Commits on Oct 16, 2025

bug fixes
Caroline Zhu
committed

Commits on Oct 21, 2025

Fix bug in scale unpacking
vraspar
committed

Commits on Oct 28, 2025

Fix issues with TMAC GEMM kernels and remove hard coded variables
vraspar
committed

Commits on Oct 31, 2025

Fix bug in LUT table generation
vraspar
committed

Commits on Nov 10, 2025

Fix casting issue
vraspar
committed

Commits on Nov 13, 2025

add session option and clean up
vraspar
committed

Commits on Dec 1, 2025

Refactor QNBit GEMM Implementation for AVX2
vraspar
committed

Commits on Dec 2, 2025

Commits on Dec 10, 2025

rewrite test_sqlutgemm.cpp
vraspar
committed

Commits on Dec 11, 2025

Add more robust checking before using LUT kernels
vraspar
committed

Commits on Dec 16, 2025

Commits on Dec 22, 2025

Apply linting and clean up
vraspar
committed

Commits on Dec 24, 2025

Commits on Jan 2, 2026

Commits on Jan 3, 2026

Commits on Jan 8, 2026

Commits on Jan 9, 2026

use MLAS_THROW_EX for qlutgemm.cpp
vraspar
committed

Commits on Jan 12, 2026

Add LUT GEMM 2-bit tests and fix Python quantization reference implementation
Vrajang Parikh
committed