Support head dim 256#329

Open

woct0rdho wants to merge 4 commits into

thu-ml:mainfrom

woct0rdho:head_dim_256

Commits on Jan 9, 2026

Support head dim 256
woct0rdho
committed
Disable head dim 256 on sm90

FurkanGozukara
authored and
woct0rdho
committed

Commits on Jun 11, 2026

Fix WARP_Q = 16 if headdim > 64
woct0rdho
committed

Commits on Jun 12, 2026

Set warp_q = 16 when head_dim == 256; set warp_q = 32 when head_dim == 128 and pv_accum_dtype == fp16+fp32 and non-causal
woct0rdho
committed