Refactor the code to incorporate more comprehensive experiments#7

Merged

voltjia merged 69 commits intomasterfrom

Jul 2, 2025

Commits on Jan 10, 2025

Commits on Jan 11, 2025

Commits on Jan 13, 2025

Commits on May 15, 2025

Add `compare_code_metrics.py`
voltjia
committed
Separate `bmm` kernels into modular packages

Ziminli
authored and
voltjia
committed
Separate `fused_rms_norm` kernels into modular packages

Ziminli
authored and
voltjia
committed
Update the `bmm` function call in `linear.py`

Ziminli
authored and
voltjia
committed
Separate `silu` kernels into modular packages

Ziminli
authored and
voltjia
committed
Separate `swiglu` kernels into modular packages

Ziminli
authored and
voltjia
committed
Fix the Triton implementation in `scaled_dot_product_attention.py`

Ziminli
authored and
voltjia
committed
Add inference profiling support

Ziminli
authored and
voltjia
committed
Add Triton and PyTorch implementations of non-interleaved RoPE
voltjia
committed
Separate `rope` kernels into modular packages
voltjia
committed
Add context managers to select the backend to use for inference
voltjia
committed

Commits on May 16, 2025

Commits on May 22, 2025

Add `transformers` and `radon` to `requirements.txt`
voltjia
committed

Commits on Jul 2, 2025

Update `README.md`
voltjia
committed