Unofficial: Interactive dashboard visualizing all 352 submissions

[dentity007]

⚠️ DISCLAIMER: This is NOT an official OpenAI resource. This dashboard is an independent, unofficial project by one participant. It is not affiliated with, endorsed by, or associated with OpenAI or the Parameter Golf organizers. All data is sourced from publicly available submission.json files in pull requests.

---

I built an interactive dashboard that visualizes data from all 352 submissions with BPB scores:

Live Dashboard →

What you can do:

• Search for your PR by author name or number
• Filter by status (Open / Closed / Merged) to see the realistic leaderboard
• Filter by size compliance (under 16MB)
• Sort by any column (BPB, size, date, etc.)
• See which techniques the community is using

Data includes:

• 352 submissions ranked by BPB
• 275 open (likely valid), 61 closed (likely invalid TTT), 16 merged
• 263 submissions under 16MB
• PR links for every submission

Also includes a technique effectiveness matrix showing what worked and what didn't across 46+ experiments, plus cost analysis for anyone budgeting their RunPod spend.

Source: github.com/NathanMaine/parameter-golf-experiment-lab

If your submission data looks wrong, let me know — happy to fix it. The data was pulled from submission.json files as of March 24.

Good luck everyone! 🏌️

[dentity007]

Dashboard Update — v4 (March 31, 2026)

Major update to the dashboard:

Data:

• Now tracking 1,171+ submissions (up from 352)
• 85+ personal experiments logged (up from 60+)
• 11 pods used, ~$330 total spend

New sections:

• 7 OpenAI research directions implemented — Text Diffusion (MDLM), H-Net learned tokenization, Universal Transformer, LLM-JEPA, Mamba SSM Hybrid, Triton Megakernels, Random Linear Map Adapters
• 11 new technique entries (what worked, what didn't)
• 7 new key discoveries (Days 10-11)
• 3 new pod cost cards (RTX 5090 × 2, H200 SXM)

Chart fixes:

• Full Y-axis range — no more cut-off data points
• All charts taller (800px)
• Leaderboard table shows all entries without scroll truncation

Live dashboard: https://nathanmaine.github.io/parameter-golf-experiment-lab/

PRs for all 7 research directions: #1191, #1192, #1193, #1194, #1195, #1196, #1197

[Ribin545]

Thanks @dentity007 This was super usefull for me I was using Universal transformer, and I should have found it sooner i used the same Universal Transformer with Depth Recurrence mentioned in PR #363. I wasted a week with it. I achieved 1.8403 bpb in RTX 3090 which i thought was good until i reduced the depth recurrence to basically none.

[dentity007]

Glad it helped! Yeah depth recurrence was a trap for me too — looked promising in theory but the compute cost per step killed any BPB gains. RTX 3090 hitting 1.84 is solid though, what are you getting now without it?

[dentity007]

@Ribin545 Glad the dashboard helped! I needed it as well many times!

The RTX 3090 is solid hitting 1.84 what are you getting now without it?