Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llama #35

Merged
merged 34 commits into from
Aug 12, 2024
Merged

Llama #35

merged 34 commits into from
Aug 12, 2024

Commits on May 3, 2024

  1. Add Llama-3-8b

    @laggui
    laggui committed May 3, 2024
    Configuration menu
    Copy the full SHA
    ac9a032 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Fix next_token_logits softmax dim

    @laggui
    laggui committed May 7, 2024
    Configuration menu
    Copy the full SHA
    d15e363 View commit details
    Browse the repository at this point in the history

  2. Fix RoPE dim and mask cache_seq_len

    @laggui
    laggui committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3fa0fbc View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Move RotaryEncoding outside of Transformer block so pytorch checkpoin… 

    …ts can be loaded w/o issue
    @laggui
    laggui committed May 9, 2024
    Configuration menu
    Copy the full SHA
    2500ef0 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Fix sampling sort dim

    @laggui
    laggui committed May 10, 2024
    Configuration menu
    Copy the full SHA
    78fbc2e View commit details
    Browse the repository at this point in the history

  2. Fix attention mask

    @laggui
    laggui committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f8a934c View commit details
    Browse the repository at this point in the history

  3. Add load/save model

    @laggui
    laggui committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f958603 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Add tiny llama w/ sentencepiece tokenizer

    @laggui
    laggui committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ffab4ae View commit details
    Browse the repository at this point in the history

  2. Add tiny llama checkpoint loading w/ keys remap

    @laggui
    laggui committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4ddf2bc View commit details
    Browse the repository at this point in the history

  3. Fix top-p sampling index

    @laggui
    laggui committed May 14, 2024
    Configuration menu
    Copy the full SHA
    7623cf4 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Add tiny llama and llama3 feature flags

    @laggui
    laggui committed May 15, 2024
    Configuration menu
    Copy the full SHA
    dff88b4 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Add default prompt and replace sentencepiece newline tokens

    @laggui
    laggui committed May 21, 2024
    Configuration menu
    Copy the full SHA
    ed1277c View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Add pretrained model/tokenizer download

    @laggui
    laggui committed May 22, 2024
    Configuration menu
    Copy the full SHA
    fb57388 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Use sentencepiece from hf tokenizers

    @laggui
    laggui committed May 23, 2024
    Configuration menu
    Copy the full SHA
    edbf3a6 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Fix TinyLlama query/key weights and add chat mode

    @laggui
    laggui committed May 24, 2024
    Configuration menu
    Copy the full SHA
    67740e3 View commit details
    Browse the repository at this point in the history

  2. Update README and features deps

    @laggui
    laggui committed May 24, 2024
    Configuration menu
    Copy the full SHA
    9492e20 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Switch to f16

    @laggui
    laggui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    59061d1 View commit details
    Browse the repository at this point in the history

  2. Use BinFileRecorder

    @laggui
    laggui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    fe35d98 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Fix tiktoken special tokens index offset (could lead to decoding error)

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    98be063 View commit details
    Browse the repository at this point in the history

  2. Fix prompt format for different tokenizers

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    456c262 View commit details
    Browse the repository at this point in the history

  3. Add llama-3-8b-instruct

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    86812fd View commit details
    Browse the repository at this point in the history

  4. Add readme with chat example

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    9b61726 View commit details
    Browse the repository at this point in the history

  5. Add llama burn generated image

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    8c9d9e2 View commit details
    Browse the repository at this point in the history

  6. Add llama to repo README

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    7fa84c0 View commit details
    Browse the repository at this point in the history

  7. Link to models root not readme file

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    7946acd View commit details
    Browse the repository at this point in the history

  8. Fix typo

    @laggui
    laggui committed May 28, 2024
    Configuration menu
    Copy the full SHA
    93f9ecc View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Pin burn git rev and add tch/wgpu feature flags

    @laggui
    laggui committed May 29, 2024
    Configuration menu
    Copy the full SHA
    553f3dd View commit details
    Browse the repository at this point in the history

  2. Update readme and change rev to fix zip version

    @laggui
    laggui committed May 29, 2024
    Configuration menu
    Copy the full SHA
    46f91ee View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Add bin weights note

    @laggui
    laggui committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    7b3daae View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Update TensorData usage

    @laggui
    laggui committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    b5ddcc1 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Switch to NamedMpkFileRecorder

    @laggui
    laggui committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    ee7bb49 View commit details
    Browse the repository at this point in the history

  2. Cleanup todo

    @laggui
    laggui committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    86eb69f View commit details
    Browse the repository at this point in the history

  3. Fix squeezenet half precision flag

    @laggui
    laggui committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f72647b View commit details
    Browse the repository at this point in the history

  4. Update burn pinned revision

    @laggui
    laggui committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c3ec71e View commit details
    Browse the repository at this point in the history