Skip to content

SkyRL recipes: full convergence demonstrated only on GSM8K — capture 8B LoongRL/BIRD curves #39

Description

@sfc-gh-kganesan

Summary

Full convergence is demonstrated only for the 0.6B simple_gsm8k recipe. The
8B long_context_qa (LoongRL) and txt2sql (BIRD) recipes have so far only
been run for short windows (≤10 steps) showing healthy, monotonic learning,
not full convergence curves.

Validated so far

  • simple_gsm8k (Qwen3-0.6B): eval pass@1 0.29 → 0.64, reward 0.28 → 0.80
    over 70 steps. ✅ Full convergence.
  • long_context_qa 8B (LoongRL): reward climbing over 9 steps. ✅ Learning,
    ⏳ not a full curve.
  • txt2sql 8B (BIRD): reward climbing over 10 steps. ✅ Learning, ⏳ not a
    full curve.

Acceptance

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions