Non-record: PROTEUS Feature Ablation - Parallel Residuals + Mixed INT5/INT6 + TTT on DGX Spark GB10#1425

Open

dentity007 wants to merge 6 commits intoopenai:mainfrom

NathanMaine:research/proteus-integration

Commits on Mar 31, 2026

Add approach notes for parameter golf challenge
dentity007
committed
Update approach with depth recurrence, factorized embeddings, tokenizer optimization, and SSM exploration
dentity007
committed
Non-record: Mamba-Inspired SSM Hybrid (3:1 SSM:Attention) (val_bpb 3.3168)

dentity007
and
claude
committed

Commits on Apr 3, 2026

Record: Vocab4096 + MLP4.0x + SLOT - val_bpb 1.0925 (3-seed mean)
dentity007
committed

Commits on Apr 4, 2026