Skip to content

Commit b0748a0

Browse files
author
Takoda Mundy
committed
C180 audit 1747Z: 0 demotions, champion 1.3711 unchanged; ★ PR openai#1476/openai#1477 confirm SP8192+TTT is new comp meta — our SP8192 build is ready, deploy next; LEGAL_TTT brittleness pattern confirmed n=2
1 parent 1963eea commit b0748a0

File tree

1 file changed

+32
-0
lines changed

1 file changed

+32
-0
lines changed

RESEARCH_LOG.md

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2415,3 +2415,35 @@ For the THIRD time this session, I conflated "novel sublayer-selective applicati
24152415
Queue: 161 entries, front of queue is the high-EV S2 confirms (TRUE_WINNERS_3WAY, normuon n=2, coprime_rope n=2, byte_weight n=2, NGRAM_BACKOFF, RIEMANNIAN_QKV, LEGAL_TTT) — all in flight or queued.
24162416

24172417
C90 fired at 1133Z (RIEMANNIAN ship → just demoted). C30 fired at 1127Z (L03+L10 candidates) and 1141Z (L07+L09 candidates). Next C90 should pick a candidate from the new C30 backlog — probably **NGR_modified_kneser_ney_discount** (35 LOC, comp-novel + PhD-defensible, never tested in comp).
2418+
2419+
## AUDIT_20260408T1747Z (C180)
2420+
2421+
**Pods alive**: 8 (B/C/E/F/G/H/I/J), all 96-100% GPU
2422+
**In-flight**: 8 unique experiments (3 NIGHT_MODE shots: B=GATED_NORM_PCT_LEGAL_TTT_seed1337, J=LEGAL_TTT_NGRAM_BACKOFF_seed42)
2423+
**Spend**: $21.48 / $50 ceiling (warn tier, $3.52 to soft cap, $28.52 to hard cap)
2424+
**Champion**: STACK_GATED_LEGAL_TTT n=2 mean **1.3711** (unchanged since 1255Z)
2425+
**Layers locked**: 0 (no layer reaches 3 confirmed-wins)
2426+
**Novelties demoted this cycle**: 0 (all world-novels held; STACK_GATED_NORM_PCT_LEGAL_TTT just confirmed FAIL but it was a stack experiment, not a layer slot)
2427+
**World-novel-yes count**: 5 (L02_mdl, L05_norm_pct, L04_gated, L04_coprime_per_head, L11_lyapclip — last 2 demoted/neutral)
2428+
**World-novel COMBINATIONS tested**: 5 (FIREHOSE_LEGAL_TTT, MDL_LEGAL_TTT_GATED, FIREHOSE_NORM_PCT, GATED_NORM_PCT_LEGAL_TTT, LEGAL_TTT_NGRAM_BACKOFF in flight)
2429+
2430+
**KEY FINDING tonight**: LEGAL_TTT champion is BRITTLE — 4/4 ingredient stacks tested all return 1.40-1.42 region, never break 1.39. Only the bare 2-component (gated_attention + LEGAL_TTT) achieves 1.3711.
2431+
2432+
**Recent comp PR audit (last 8h, since 0945Z C180)**:
2433+
- **PR #1476** [Record] SP8192 + QK5 + Legal TTT — val_bpb 1.0842 (15:50Z) ★ — TTT now in comp
2434+
- **PR #1477** Record: SP8192 + Parallel Residuals + Score-First TTT — val_bpb 1.0822 (17:11Z) ★
2435+
- **PR #1478** Shallow Blue: BOS-Reset Exact Memory Probe (17:14Z) — different mechanism
2436+
- **PR #1471** [Record] SP8192 + SDClip + 3L Depth Recurrence + EMA — 1.0866 (10:20Z)
2437+
- **PR #1474** Vocab1792 FlashMuon LinearScaleInit XSA5LastGated RReLU2 Int6AWQ (12:07Z)
2438+
- **PR #1473** 11L FullGPTQ + XSA-all + BigramHash 3072×112 — 1.11564 (11:43Z)
2439+
2440+
**IMPLICATIONS**:
2441+
1. **LEGAL_TTT is no longer world-novel as a standalone** — comp now uses it (PR #1476). Our LEGAL_TTT was always comp-port (Patch 45) so no demotion needed.
2442+
2. **SP8192 + LEGAL_TTT is the new comp meta** — we have BPE-8192 built on Mac, need to deploy. Our champion gated_attention+LEGAL_TTT lacks SP8192. The combination SP8192+LEGAL_TTT with our gated_attention + bigram tables 8192v could push us into 1.0-1.1 territory.
2443+
3. **Score-First TTT** (PR #1477) is a new TTT variant — research candidate for next C30 fire.
2444+
4. **No world-novel demotions needed** — our COMBINATION claims (e.g., STACK_FIREHOSE_LEGAL_TTT) remain novel because no comp PR stacks the same combo.
2445+
2446+
**Next priorities**:
2447+
- Deploy SP8192 to a pod (test it ASAP)
2448+
- Consider Score-First TTT as comp-novel candidate
2449+
- Continue waiting for J's STACK_LEGAL_TTT_NGRAM_BACKOFF (n-gram path may bypass LEGAL_TTT brittleness)

0 commit comments

Comments
 (0)