Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Distributed][auto-parallel] Sharding Specification and rule discovery #336

Merged
merged 54 commits into from
Aug 4, 2023
Merged

[Distributed][auto-parallel] Sharding Specification and rule discovery #336

merged 54 commits into from
Aug 4, 2023

Commits on Jul 29, 2023

  1. [CI] List package versions in ci (hidet-org#334)

    @yaoyaoding
    yaoyaoding committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    a491cb3 View commit details
    Browse the repository at this point in the history

  2. [CI] List package versions in ci (hidet-org#334)

    @yaoyaoding @soodoshll
    yaoyaoding authored and soodoshll committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    0bc0f2d View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2023

  1. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    8a3cdec View commit details
    Browse the repository at this point in the history

  2. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    6a064bf View commit details
    Browse the repository at this point in the history

  3. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    78fbf83 View commit details
    Browse the repository at this point in the history

  4. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    924d9d4 View commit details
    Browse the repository at this point in the history

  5. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    317d7b4 View commit details
    Browse the repository at this point in the history

  6. update

    @soodoshll
    soodoshll committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    8748c2e View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. update

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    28dcec9 View commit details
    Browse the repository at this point in the history

  2. [Models] Llama2 fix (hidet-org#333) 

    Fix llama2 and add test for num_heads != num_key_value_heads.

---------

Co-authored-by: Allan Lin <[email protected]>
    @Aalanli
    Aalanli and Allan Lin committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    0532154 View commit details
    Browse the repository at this point in the history

  3. update

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    be37b1f View commit details
    Browse the repository at this point in the history

  4. format

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    6790b82 View commit details
    Browse the repository at this point in the history

  5. [Models] Llama2 fix (hidet-org#333) 

    Fix llama2 and add test for num_heads != num_key_value_heads.

---------

Co-authored-by: Allan Lin <[email protected]>
    @Aalanli @soodoshll
    2 people authored and soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    bb9e1cb View commit details
    Browse the repository at this point in the history

  6. update

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    09f340e View commit details
    Browse the repository at this point in the history

  7. update

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    3a37a1e View commit details
    Browse the repository at this point in the history

  8. fix

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    33bcff8 View commit details
    Browse the repository at this point in the history

  9. update

    @soodoshll
    soodoshll committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    138f007 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. update

    @soodoshll
    soodoshll committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    4eaa65c View commit details
    Browse the repository at this point in the history

  2. [Operator] Composite Elementwise Operation (hidet-org#337) 

    Assuming `U1` and `U2` are unary elementwise operators, and `B` is a
binary elementwise operator.
Introduce a new fused operator called Composite Elementwise Operation,
where `comp_elemwise(x, U1, U2, B) = B(U1(x), U2(x))`.
Also add subgraph rewrite rule. This allows for more fusion opportunity.
    @hjjq
    hjjq committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    1eb41ad View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. [Fixbug] Clear the intermediate object files for kernel tuning (hidet… 

    …-org#339)

This PR clears the intermediate object files generated during tuning.

This should reduce 2/3 cache size without hurting any functionality. 

hidet-org#338
    @yaoyaoding
    yaoyaoding committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    a395fb1 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. update

    @soodoshll
    soodoshll committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    7e798e1 View commit details
    Browse the repository at this point in the history

  2. format

    @soodoshll
    soodoshll committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    476acaa View commit details
    Browse the repository at this point in the history

  3. update

    @soodoshll
    soodoshll committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    42b3d0f View commit details
    Browse the repository at this point in the history

  4. [Hidet script] Add hidet.lang.types submodule (hidet-org#340) 

    Also add copyright information for some files.
    @yaoyaoding
    yaoyaoding committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    56197c9 View commit details
    Browse the repository at this point in the history

  5. refactor

    @soodoshll
    soodoshll committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    3213abb View commit details
    Browse the repository at this point in the history

  6. [CPU][Scheduler] Use mutli-threads for autl-scheduler (hidet-org#341) 

    Also add the operator trace.
    @yaoyaoding
    yaoyaoding committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    e9bfa99 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. fix

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    d50f78a View commit details
    Browse the repository at this point in the history

  2. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    1cf263f View commit details
    Browse the repository at this point in the history

  3. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    bb18a18 View commit details
    Browse the repository at this point in the history

  4. shard spec data structure

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0b61aec View commit details
    Browse the repository at this point in the history

  5. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    012748d View commit details
    Browse the repository at this point in the history

  6. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    dbf6edf View commit details
    Browse the repository at this point in the history

  7. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    6b2e4a5 View commit details
    Browse the repository at this point in the history

  8. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    f28c935 View commit details
    Browse the repository at this point in the history

  9. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    fcd1381 View commit details
    Browse the repository at this point in the history

  10. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    d00e34d View commit details
    Browse the repository at this point in the history

  11. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    8a36b44 View commit details
    Browse the repository at this point in the history

  12. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    6d2ee5a View commit details
    Browse the repository at this point in the history

  13. format

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    bef294b View commit details
    Browse the repository at this point in the history

  14. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    2e68239 View commit details
    Browse the repository at this point in the history

  15. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    600d643 View commit details
    Browse the repository at this point in the history

  16. fix

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    2f8aca7 View commit details
    Browse the repository at this point in the history

  17. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    091b4d5 View commit details
    Browse the repository at this point in the history

  18. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    a513d6a View commit details
    Browse the repository at this point in the history

  19. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    c58effe View commit details
    Browse the repository at this point in the history

  20. format

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    2152e8e View commit details
    Browse the repository at this point in the history

  21. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    87443c8 View commit details
    Browse the repository at this point in the history

  22. refactor

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    5c69558 View commit details
    Browse the repository at this point in the history

  23. fix

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    de4daef View commit details
    Browse the repository at this point in the history

  24. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    16aecb2 View commit details
    Browse the repository at this point in the history

  25. update

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    c47a41c View commit details
    Browse the repository at this point in the history

  26. fix

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    36611a4 View commit details
    Browse the repository at this point in the history

  27. fix

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    7d529b5 View commit details
    Browse the repository at this point in the history

  28. merge

    @soodoshll
    soodoshll committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0e860be View commit details
    Browse the repository at this point in the history