Code

add muon code#168

Code

Open

samsja wants to merge 8 commits intomainPrimeIntellect-ai/prime:mainfrom feat-muonPrimeIntellect-ai/prime:feat-muonCopy head branch name to clipboard

+373-136

Commits

Commits on Dec 10, 2024

• add muon code

  samsja

  committed
  973dbff

• add muon tests

  samsja

  committed
  c59e598

• fix preqconditioner

  samsja

  committed
  63f7f88

• fix preqconditioner

  samsja

  committed
  fb3a721

• update 1b confoigs

  samsja

  committed
  e996e85

• update 1b confoigs

  samsja

  committed
  8646e14

Commits on Dec 11, 2024

• disavle wandb for non 9 rank

  samsja

  committed
  d34265b

• disavle wandb for non 9 rank

  samsja

  committed
  6ddfcd0