Skip to content

[Non-record] ParGolf-Zero v2 — 6-layer joint optimization + BigramHash + SWA + zstd#514

Open
sanjith3057 wants to merge 9 commits intoopenai:mainfrom
sanjith3057:main
Open

[Non-record] ParGolf-Zero v2 — 6-layer joint optimization + BigramHash + SWA + zstd#514
sanjith3057 wants to merge 9 commits intoopenai:mainfrom
sanjith3057:main

Conversation

@sanjith3057
Copy link
Copy Markdown

ParGolf-Zero v2 — Non-record submission

Unique contribution

Joint compression-aware training — per-row weight range
penalty minimizes int8 quantization error during every
gradient step. BigramHash(10240) + SWA + zstd-22 + TTT.

Confirmed on Kaggle T4

  • Artifact: 5.52MB under 16MB ✅
  • All 6 layers active and verified ✅
  • Pipeline complete end-to-end ✅

Status

Awaiting H100 compute grant for final scored run.
val_bpb will be updated once full H100 run completes.

Files

  • train_gpt.py — full training script
  • README.md — approach description
  • submission.json — metadata

@MatoTeziTanka
Copy link
Copy Markdown

MatoTeziTanka commented Apr 11, 2026

Community Review — [Non-record] ParGolf-Zero v2 — 6-layer joint optimization + BigramHash + SWA + zstd

Compliance: NEEDS AUTHOR ACTION — train_gpt.py fails to import on CT2038 (Python 3.10 / torch 2.10.0+cpu)

What I found: The CPU smoke test on CT2038 (proteus-engine, 128 GB RAM, Triton 3.6.0, flash_attn stub, cutlass_evt_fusion stub) failed at the import step with:

SyntaxError: invalid character '—' (U+2014) (line 1)

A few of the common patterns I've seen for this class of error in the 2026-04-11 sweep:

Recommendation: Could you run python3 -c "import py_compile; py_compile.compile('train_gpt.py')" on your records-folder train_gpt.py under Python 3.10 specifically? The eval image is Python 3.10 per Issue #17 / the README, so any parse error on 3.10 blocks the submission at import time before any of the scored-eval logic runs.

Once the parse/import issue is fixed, I'll re-run the compliance audit through the normal pipeline. No other flags identified yet because the audit halts at the import step.


Reviewed by @MatoTeziTankaThe Agora. CPU smoke test (CT2038 proteus-engine, 2026-04-11): IMPORT_FAIL — SyntaxError: invalid character '—' (U+2014) (line 1). Classification via classify_prs.py AST-based classifier; full compliance audit deferred until the import issue is resolved. Auto-drafted from a template and spot-checked before posting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants