Gemma 4 12B SFT-uplift PoC (+ MTP) on NVIDIA RTX 4000 Ada#129

Draft

ulises-c wants to merge 134 commits into

mainfrom

feat/gemma4-12b-sft-poc-nvidia

Commits on May 29, 2026

fix(train): gfx1201 ROCm fixes + Gemma 4 26B-A4B QLoRA config

ulises-c
and
claude
committed
feat(train): target unsloth bnb-4bit Gemma 4 31B for R9700 QLoRA

ulises-c
and
claude
committed

Commits on May 30, 2026

fix(train): inference-matching SFT format + W&B + quantization_config fix

ulises-c
and
claude
committed

Commits on May 31, 2026

Commits on Jun 1, 2026

Commits on Jun 2, 2026

Commits on Jun 3, 2026

feat(diag): add rocblas bench capture + replay scripts for gfx1201 repro

ulises-c
and
claude
committed

Commits on Jun 4, 2026

docs(handoff): session 5 — monitor STALLED 8/8, GPU needs driver reset before restart

ulises-c
and
claude
committed

Commits on Jun 5, 2026

Commits on Jun 7, 2026

Commits on Jun 8, 2026

Commits on Jun 10, 2026

Commits on Jun 20, 2026

docs: SFT phase-2 handoff for a fresh session

ulises-c
and
claude
committed

Commits on Jun 21, 2026

Commits on Jun 23, 2026

Commits on Jun 24, 2026

Commits on Jul 6, 2026

docs: consultant-ablation (T1.1) results — SFT internalized quality, not state-tracking

ulises-c
and
claude
committed

Commits on Jul 7, 2026

Commits on Jul 10, 2026

Commits on Jul 12, 2026

Commits on Jul 13, 2026

docs(eval): LLM-judge confirms oracle SFT win on absolute quality (+0.38/10), magnitude far below ROUGE

ulises-c
and
claude
committed