Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU] Allow deepspeed.comm.inference_all_reduce in torch.compile graph #5604

Open
wants to merge 20 commits into
base: master
Choose a base branch
from
Open

[CPU] Allow deepspeed.comm.inference_all_reduce in torch.compile graph #5604

wants to merge 20 commits into from
+85 −19

Commits on Apr 18, 2024

  1. remove no compile for torchbackend inference_all_reduce

    @delock
    delock committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    1b89ebd View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. add myadd op

    @delock
    delock committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    358bc46 View commit details
    Browse the repository at this point in the history

  2. myadd -> inference_all

    @delock
    delock committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    649fb53 View commit details
    Browse the repository at this point in the history

  3. call inference_all_reduce_ in op implementation

    @delock
    delock committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    284967e View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. test pytorch C++ ops

    @delock
    delock committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    8b24c2b View commit details
    Browse the repository at this point in the history

  2. cleanup

    @delock
    delock committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    ee704a0 View commit details
    Browse the repository at this point in the history

  3. enable inference_all_reduce_ as op

    @delock
    delock committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    ba03ac1 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. add fallback path of all_reduce op

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    ee16062 View commit details
    Browse the repository at this point in the history

  2. remove unused functions

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    39f7328 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into gma/inference_all_reduce_in_graph

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    1af7c0d View commit details
    Browse the repository at this point in the history

  4. fix typo

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    4cb6c33 View commit details
    Browse the repository at this point in the history

  5. fix format

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    9cc13e3 View commit details
    Browse the repository at this point in the history

  6. fix format

    @delock
    delock committed May 31, 2024
    Configuration menu
    Copy the full SHA
    16e79cc View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. change 'foo' in code into 'x'

    @delock
    delock committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    84b039b View commit details
    Browse the repository at this point in the history

  2. remove debug print code

    @delock
    delock committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    07a1576 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. temp save

    @delock
    delock committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    26db8a0 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. remove fallback path

    @delock
    delock committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    620efd1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into gma/inference_all_reduce_in_graph

    @delock
    delock committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    78afbfb View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge branch 'master' into gma/inference_all_reduce_in_graph

    @tjruwase
    tjruwase committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    bf38cf2 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2024

  1. fix format

    @delock
    delock committed Jun 22, 2024
    Configuration menu
    Copy the full SHA
    d6627c0 View commit details
    Browse the repository at this point in the history