Gemma-4 dense GGUF support: per-layer geometry, gemma tensor mapping, BOS routing, and ggml nibble-layout conformance for Q4_0/Q4_1/Q5_0/Q5_1/Q6_K - #178

Open

layer5one wants to merge 5 commits into

chrishayuk:mainfrom

layer5one:gemma4-gguf-geometry

Commits on Jul 5, 2026

gguf: emit gemma4 per-layer attention geometry in to_config_json
taylorsorensen
committed

Commits on Jul 6, 2026

gguf: map gemma 2/3/4 norm + layer_output_scale tensor names
Taylor
committed
lql: route prompt tokenization through encode_prompt (gemma-4 BOS)
Taylor
committed
quant: fix Q4_0/Q4_1/Q5_0/Q5_1/Q6_K nibble layout to match ggml
Taylor
committed
gguf: emit final_logit_softcapping and rms_norm_eps in to_config_json
Taylor
committed