Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhance]: Fix sequence parallel memory bottleneck in DPO & ORPO #830

Merged
merged 3 commits into from
Jul 19, 2024
Merged

[Enhance]: Fix sequence parallel memory bottleneck in DPO & ORPO #830

merged 3 commits into from
Jul 19, 2024

Commits on Jul 11, 2024

  1. [WIP]: Fix sequence parallel memory bottleneck in DPO

    @RangiLyu
    RangiLyu authored Jul 11, 2024
    Configuration menu
    Copy the full SHA
    ce9bb62 View commit details
    Browse the repository at this point in the history

  2. loss mask before split

    @RangiLyu
    RangiLyu committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    8753d9a View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. refactor orpo

    @RangiLyu
    RangiLyu committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    1f58ee7 View commit details
    Browse the repository at this point in the history