Gated Attention & Scaling Speedruns#2281

Draft

Calvin-Xu wants to merge 26 commits intomainfrom

calvin/gated_attention

Commits on Dec 6, 2025

rename attn_sink speedrun dir
Calvin-Xu
committed

Commits on Dec 15, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 16, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 18, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 19, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 20, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 21, 2025

update w/ main
Calvin-Xu
committed

Commits on Dec 26, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 27, 2025

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Dec 28, 2025

Initial LR sweep results
Calvin-Xu
committed

Commits on Dec 30, 2025

tweak
Calvin-Xu
committed

Commits on Jan 4, 2026

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Jan 5, 2026

Commits on Jan 8, 2026

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Jan 9, 2026

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Jan 12, 2026

Merge branch 'main' of https://github.com/marin-community/marin into calvin/gated_attention
Calvin-Xu
committed

Commits on Jan 20, 2026