2L QAT Int4-MLP + Int6-Attn#910

Open

Meirzhan05 wants to merge 2 commits intoopenai:mainfrom

Meirzhan05:main

Commits on Mar 26, 2026

Add 11L QAT Int4-MLP submission: QAT via STE, int4 MLP quantization, 11 layers, stride=32
Meirzhan05
committed
Rebase submission onto SOTA #1: 12L QAT Int4-MLP + Int6-Attn on PR #549 stack
Meirzhan05
committed