Code

Add Speculator Architecture#6

Code

Merged

daviswer merged 13 commits intofoundation-model-stack:mainfoundation-model-stack/fms-extras:mainfrom JRosenkranz:speculator-v2JRosenkranz/fms-extras:speculator-v2Copy head branch name to clipboardFeb 23, 2024

+172

Commits

Commits on Feb 22, 2024

• Add speculator with two forward modes

  daviswer

  committed
  57ed0c0

  Copy full SHA for 57ed0c0

• Small qol adds

  daviswer

  committed
  1e79d45

  Copy full SHA for 1e79d45

• Fix import

  daviswer

  committed
  d9d8530

  Copy full SHA for d9d8530

• Swap n_heads for n_predict

  daviswer

  committed
  ef8ac71

  Copy full SHA for ef8ac71

• Swap self.n_predict for self.npredict

  daviswer

  committed
  423ee80

  Copy full SHA for 423ee80

• Further docs, legibility, comments

  daviswer

  committed
  49b1ea0

  Copy full SHA for 49b1ea0

• Move speculator to models subfolder

  daviswer

  committed
  58c1b09

  Copy full SHA for 58c1b09

Commits on Feb 23, 2024

• Blacking, casing

  daviswer

  authored
  0c98baa

  Copy full SHA for 0c98baa

• Add type hints / docstrings

  daviswer

  authored
  6bf3944

  Copy full SHA for 6bf3944

• Fix typing import

  daviswer

  authored
  3c248c2

  Copy full SHA for 3c248c2

• Blacking (sigh)

  daviswer

  authored
  838c728

  Copy full SHA for 838c728

• Fix typing imports pt2

  daviswer

  authored
  bd45b87

  Copy full SHA for bd45b87

• isorting

  daviswer

  committed
  a4c4ba3

  Copy full SHA for a4c4ba3