Code

Add init code#2

Code

Merged

samsja merged 19 commits intomainPrimeIntellect-ai/prime:mainfrom add-init-codePrimeIntellect-ai/prime:add-init-codeCopy head branch name to clipboardSep 21, 2024

+1,970-11

Commits

Commits on Sep 12, 2024

• add llama model from torchtitan

  samsja

  committed
  833e7ad

Commits on Sep 20, 2024

• add training loop

  samsja

  committed
  410e002

• add torchrun test

  samsja

  committed
  b4e4760

• add torchrun test

  samsja

  committed
  fa9fd11

• add tests config

  samsja

  committed
  e94d3c0

• use world info

  samsja

  committed
  2feb040

• add proper logging

  samsja

  committed
  c710fe8

• update readme

  samsja

  committed
  7108546

• chore: change doscrting

  samsja

  committed
  08e02a4

• add noqa triton kernel

  samsja

  committed
  0e4c2b2

• add 150m config

  samsja

  committed
  a145583

• use grad shard op as default strategy

  samsja

  committed
  27669b3

• apply ruff format

  samsja

  committed
  93be8f6

• add training data

  samsja

  committed
  5267437

Commits on Sep 21, 2024

• add tokens / sec

  samsja

  committed
  9a5efa7

• add total samples

  samsja

  committed
  5d0deb9

• add mfu

  samsja

  committed
  e5a1938

• add 1B

  samsja

  committed
  01d13a6

• add 7b

  samsja

  committed
  40f8fd9