Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier #5131

Merged
merged 50 commits into from
Jun 18, 2024
Merged

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier #5131

merged 50 commits into from
Jun 18, 2024

Commits on May 8, 2024

  1. Test commit

    @sroy745
    sroy745 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    00d74c0 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge pull request #1 from vllm-project/main 

    Pull from head
    @sroy745
    sroy745 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    5650b95 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/sroy745/vllm into test-branch

    @sroy745
    sroy745 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    d936a25 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Refactoring some of the logic in rejection_sampling to a base class a… 

    …nd adding

new class for acceptance sampling
    @sroy745
    sroy745 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    81eb966 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Adding comments and some new tests.

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    b09a20f View commit details
    Browse the repository at this point in the history

  2. Formatting and comments.

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    9340244 View commit details
    Browse the repository at this point in the history

  3. Added comments and some more tests.

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    7a7f9bd View commit details
    Browse the repository at this point in the history

  4. Dummy commit

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    aecc2e8 View commit details
    Browse the repository at this point in the history

  5. Reverting change to llm_engine_example.py

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    513e252 View commit details
    Browse the repository at this point in the history

  6. Updating a comment

    @sroy745
    sroy745 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    69e52f0 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    8f36146 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into acceptance_sampling_s… 

    …pec_decode
    @sroy745
    sroy745 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    5559757 View commit details
    Browse the repository at this point in the history

  3. Dummy commit

    @sroy745
    sroy745 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    312bc49 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    9e75057 View commit details
    Browse the repository at this point in the history

  5. Fix device for tensors

    @sroy745
    sroy745 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    ca41215 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Fixing review comments

    @sroy745
    sroy745 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    ba4d3fb View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Addressing comments

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    c9c7a8b View commit details
    Browse the repository at this point in the history

  2. Add a new test for non default posteriors

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0ad9afd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    db2c679 View commit details
    Browse the repository at this point in the history

  4. Documentation for test

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    9b572f7 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into acceptance_sampling_s… 

    …pec_decode
    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    920ffa4 View commit details
    Browse the repository at this point in the history

  6. Fix ruff errors

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    644cae4 View commit details
    Browse the repository at this point in the history

  7. Fix spell corrections

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    5ee4018 View commit details
    Browse the repository at this point in the history

  8. Fixing spell errors

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    b414d42 View commit details
    Browse the repository at this point in the history

  9. Ran format.sh

    @sroy745
    sroy745 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7aa132b View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8d7512c View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'main' into acceptance_sampling_spec_decode

    @sroy745
    sroy745 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    d0e0827 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    1473f74 View commit details
    Browse the repository at this point in the history

  3. Fix formatting

    @sroy745
    sroy745 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    26694a7 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4013e1a View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2dbdd78 View commit details
    Browse the repository at this point in the history

  2. Test commit

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1b8fd3e View commit details
    Browse the repository at this point in the history

  3. Refactoring some of the logic in rejection_sampling to a base class a… 

    …nd adding

new class for acceptance sampling
    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5e80dd8 View commit details
    Browse the repository at this point in the history

  4. Adding comments and some new tests.

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    77dcb79 View commit details
    Browse the repository at this point in the history

  5. Formatting and comments.

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    db3e6fa View commit details
    Browse the repository at this point in the history

  6. Added comments and some more tests.

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7d876d4 View commit details
    Browse the repository at this point in the history

  7. Dummy commit

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    78d011b View commit details
    Browse the repository at this point in the history

  8. Reverting change to llm_engine_example.py

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f67ffcd View commit details
    Browse the repository at this point in the history

  9. Updating a comment

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1bdbe09 View commit details
    Browse the repository at this point in the history

  10. Dummy commit

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    07f7b9c View commit details
    Browse the repository at this point in the history

  11. Fix device for tensors

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    74782dc View commit details
    Browse the repository at this point in the history

  12. Fixing review comments

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7bcbbdb View commit details
    Browse the repository at this point in the history

  13. Addressing comments

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f0c2b79 View commit details
    Browse the repository at this point in the history

  14. Add a new test for non default posteriors

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0b7bc75 View commit details
    Browse the repository at this point in the history

  15. Documentation for test

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    197ded6 View commit details
    Browse the repository at this point in the history

  16. Fix ruff errors

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    bd435df View commit details
    Browse the repository at this point in the history

  17. Fix spell corrections

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d4c750e View commit details
    Browse the repository at this point in the history

  18. Fixing spell errors

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2c2004f View commit details
    Browse the repository at this point in the history

  19. Ran format.sh

    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    85c48f5 View commit details
    Browse the repository at this point in the history

  20. Merge branch 'acceptance_sampling_spec_decode' of https://github.com/… 

    …sroy745/vllm into acceptance_sampling_spec_decode
    @sroy745
    sroy745 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b841f90 View commit details
    Browse the repository at this point in the history