Skip to content

feat(rust): Laguna batched prefill, 156 to 559 pp tok/s, plus weight cache and dtype-cache fix#70

Merged
TheTom merged 3 commits into
tom/feat/cuda-hip-vulkan-backendsfrom
tom/laguna-prefill
Jul 23, 2026
Merged

feat(rust): Laguna batched prefill, 156 to 559 pp tok/s, plus weight cache and dtype-cache fix#70
TheTom merged 3 commits into
tom/feat/cuda-hip-vulkan-backendsfrom
tom/laguna-prefill

feat(laguna): on-disk weight cache and windowed parallel conversion

5f40660
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
label
succeeded Jul 23, 2026 in 5s