Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dmoe integration #1210

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

Dmoe integration #1210

wants to merge 12 commits into from

Commits on May 6, 2024

  1. feat: ensure only the right architectures get built vs all of them fo… 

    …r 11.x
    @DayOfThePenguin
    DayOfThePenguin committed May 6, 2024
    Configuration menu
    Copy the full SHA
    52a2001 View commit details
    Browse the repository at this point in the history

  2. feat: clean up megablocks-based DMoE implementation

    @DayOfThePenguin
    DayOfThePenguin committed May 6, 2024
    Configuration menu
    Copy the full SHA
    9c66895 View commit details
    Browse the repository at this point in the history

  3. feat: update args, configs, and requirements

    @DayOfThePenguin
    DayOfThePenguin committed May 6, 2024
    Configuration menu
    Copy the full SHA
    3388c51 View commit details
    Browse the repository at this point in the history

  4. Update NeoXArgs docs automatically

    github-actions committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e987126 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Merge branch 'main' of https://github.com/EleutherAI/gpt-neox into dm… 

    …oe_integration
    @DayOfThePenguin
    DayOfThePenguin committed May 21, 2024
    Configuration menu
    Copy the full SHA
    7d6f265 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dmoe_integration' of https://github.com/EleutherAI/gpt-… 

    …neox into dmoe_integration
    @DayOfThePenguin
    DayOfThePenguin committed May 21, 2024
    Configuration menu
    Copy the full SHA
    4aebc2c View commit details
    Browse the repository at this point in the history

  3. Update NeoXArgs docs automatically

    github-actions committed May 21, 2024
    Configuration menu
    Copy the full SHA
    d9f8d55 View commit details
    Browse the repository at this point in the history

  4. feat: Update readme and example config

    @DayOfThePenguin
    DayOfThePenguin committed May 21, 2024
    Configuration menu
    Copy the full SHA
    f8c3776 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'dmoe_integration' of https://github.com/EleutherAI/gpt-… 

    …neox into dmoe_integration
    @DayOfThePenguin
    DayOfThePenguin committed May 21, 2024
    Configuration menu
    Copy the full SHA
    3ef5b66 View commit details
    Browse the repository at this point in the history

  6. Update NeoXArgs docs automatically

    github-actions committed May 21, 2024
    Configuration menu
    Copy the full SHA
    33e41d7 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge branch 'main' of https://github.com/EleutherAI/gpt-neox into dm… 

    …oe_integration
    @DayOfThePenguin
    DayOfThePenguin committed May 22, 2024
    Configuration menu
    Copy the full SHA
    613aeb9 View commit details
    Browse the repository at this point in the history

  2. Update NeoXArgs docs automatically

    github-actions committed May 22, 2024
    Configuration menu
    Copy the full SHA
    35c7225 View commit details
    Browse the repository at this point in the history