Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with perf-benchmarks label #5073

Merged
merged 115 commits into from
Jun 14, 2024
Merged

[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with perf-benchmarks label #5073

merged 115 commits into from
Jun 14, 2024

Commits on May 27, 2024

  1. Kuntai: add a script to run tgi inside vllm docker

    @KuntaiDu
    KuntaiDu committed May 27, 2024
    Configuration menu
    Copy the full SHA
    470b1c0 View commit details
    Browse the repository at this point in the history

  2. Kuntai: format the bash script using shfmt

    @KuntaiDu
    KuntaiDu committed May 27, 2024
    Configuration menu
    Copy the full SHA
    0f522ae View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Kuntai: add benchmarking script for trt-llm

    @KuntaiDu
    KuntaiDu committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    fb4040b View commit details
    Browse the repository at this point in the history

  2. remove huggingface token

    @KuntaiDu
    KuntaiDu committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    8abe615 View commit details
    Browse the repository at this point in the history

  3. Kuntai: update vLLM benchmarking script

    @KuntaiDu
    KuntaiDu committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    fca4a47 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Kuntai: change the TGI script so that it can be ran inside TGI contai… 

    …ner, and rename the files
    @KuntaiDu
    KuntaiDu committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    d6e7faf View commit details
    Browse the repository at this point in the history

  2. Kuntai: let vllm benchmark read test cases from

    @KuntaiDu
    KuntaiDu committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    fed1136 View commit details
    Browse the repository at this point in the history

  3. Kuntai: update benchmark-parameters.json

    @KuntaiDu
    KuntaiDu committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    c879a89 View commit details
    Browse the repository at this point in the history

  4. Kuntai: update run-vllm-benchmarks.sh so that it parses test cases fr… 

    …om benchmark-parameters.json
    @KuntaiDu
    KuntaiDu committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    c7c1ce6 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Kuntai: fix throughput parsing error while using tensor parallel size… 

    … > 1
    @KuntaiDu
    KuntaiDu committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    33cf9cc View commit details
    Browse the repository at this point in the history

  2. Kuntai: attach GPU type (e.g. H100) to test name

    @KuntaiDu
    KuntaiDu committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    0f4aab3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:vllm-project/vllm into kuntai-tgibe… 

    …nch-dev
    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    8e2bb78 View commit details
    Browse the repository at this point in the history

  4. move files

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    9d8d904 View commit details
    Browse the repository at this point in the history

  5. fix script to run on latest code

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    d02b35b View commit details
    Browse the repository at this point in the history

  6. fix

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    2ba3559 View commit details
    Browse the repository at this point in the history

  7. add hf token

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    c321200 View commit details
    Browse the repository at this point in the history

  8. fix path

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    e3bb365 View commit details
    Browse the repository at this point in the history

  9. fix path

    @simon-mo
    simon-mo committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    22c6dcc View commit details
    Browse the repository at this point in the history

  10. Kuntai: add parameter, so that we can specify the filename of benchma… 

    …rking results.
    @KuntaiDu
    KuntaiDu committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    249aa02 View commit details
    Browse the repository at this point in the history

  11. Kuntai: rename the test parameter files to so that it is clear that i… 

    …t calls .
    @KuntaiDu
    KuntaiDu committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    b41b579 View commit details
    Browse the repository at this point in the history

  12. Kuntai: reformat the test cases file.

    @KuntaiDu
    KuntaiDu committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    ab7a744 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Kuntai: add dummy weight to benchmarking

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    0707a7f View commit details
    Browse the repository at this point in the history

  2. Kuntai: use 7B model for testing.

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    33d31bf View commit details
    Browse the repository at this point in the history

  3. Kuntai: postprocess the benchmarking results to markdown using python… 

    … script.
    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    15dd5a9 View commit details
    Browse the repository at this point in the history

  4. Kuntai: bugfix.

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    9ffe79b View commit details
    Browse the repository at this point in the history

  5. Kuntai: bugfix.

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    f9805f0 View commit details
    Browse the repository at this point in the history

  6. Kuntai: reformat the markdown output, bug fix

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    6febc17 View commit details
    Browse the repository at this point in the history

  7. Kuntai: add load_format to benchmark_latency.py, to allow using dummy… 

    … weights
    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    d9a40c1 View commit details
    Browse the repository at this point in the history

  8. Kuntai: see if benchmark_latency.py works in the CI dcoker

    @KuntaiDu
    KuntaiDu committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    2e448df View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Kuntai: reduce the # of prompts to 100, for debugging.

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f14d3bb View commit details
    Browse the repository at this point in the history

  2. Kuntai: start developing on latency tests

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    d6db0af View commit details
    Browse the repository at this point in the history

  3. Kuntai: update markdown generation script for

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    43deac5 View commit details
    Browse the repository at this point in the history

  4. Kuntai: temporary change for debugging

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    a318650 View commit details
    Browse the repository at this point in the history

  5. Kuntai: bug fix

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    b9e11de View commit details
    Browse the repository at this point in the history

  6. Kuntai: bug fix: percentile key is str not int

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    b12556f View commit details
    Browse the repository at this point in the history

  7. Kuntai: handle the case where the dataframe is empty

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    223a69a View commit details
    Browse the repository at this point in the history

  8. Kuntai: empty is a bool not a function

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    6aadb3d View commit details
    Browse the repository at this point in the history

  9. Kuntai: add double quote for artifact upload

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    63e4bf4 View commit details
    Browse the repository at this point in the history

  10. Kuntai: add various models to latency-tests.json

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    a8876d3 View commit details
    Browse the repository at this point in the history

  11. Kuntai: finish debugging, run the full test now

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    1a19d71 View commit details
    Browse the repository at this point in the history

  12. Kuntai: fix f-string issue

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3cad48f View commit details
    Browse the repository at this point in the history

  13. Kuntai: add more test to serving test

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e36e606 View commit details
    Browse the repository at this point in the history

  14. Kuntai: fix python file syntax.

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    ee9d701 View commit details
    Browse the repository at this point in the history

  15. Kuntai: remove -x debugging flag from the benchmarking script

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0abebfc View commit details
    Browse the repository at this point in the history

  16. Kuntai: add , to the end of string to make yapf happy

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    095b517 View commit details
    Browse the repository at this point in the history

  17. Kuntai: reduce tp from 8 to 4 for mixtral 7B model, to avoid memory a… 

    …ccess error
    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    d5d55b4 View commit details
    Browse the repository at this point in the history

  18. Kuntai: reduce the tp for Mixtral 8x7B to 2

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    6eaef5a View commit details
    Browse the repository at this point in the history

  19. Kuntai: remove 8x22B test, as it triggers illegal memory access

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e2428a9 View commit details
    Browse the repository at this point in the history

  20. Kuntai: fall back to tp=4 for Mixtral 8x7B to avoid cuda OOM error

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3bf2bae View commit details
    Browse the repository at this point in the history

  21. Kuntai: add GPU used memory to debug memory leaking

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3dc0bed View commit details
    Browse the repository at this point in the history

  22. Kuntai: skip latency tests, for debugging

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    70e5778 View commit details
    Browse the repository at this point in the history

  23. Kuntai: fix GPU memory leaking, and update full suite of tests

    @KuntaiDu
    KuntaiDu committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    48b8914 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2024

  1. Merge branch 'main' into kuntai-tgibench-dev

    @KuntaiDu
    KuntaiDu authored Jun 9, 2024
    Configuration menu
    Copy the full SHA
    1a5a2c3 View commit details
    Browse the repository at this point in the history

  2. Kuntai: add GPU memory usage check after killing vllm server

    @KuntaiDu
    KuntaiDu committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    5bd23e9 View commit details
    Browse the repository at this point in the history

  3. Kuntai: remove redundant gpu memory check

    @KuntaiDu
    KuntaiDu committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    4c8dd6a View commit details
    Browse the repository at this point in the history

  4. Kuntai: reduce tp for 8x22B mixtral model, for more stable benchmarking

    @KuntaiDu
    KuntaiDu committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    973c018 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Kuntai: add debug symbol to see why 8x22B crashes under tp=8

    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    74ecb6f View commit details
    Browse the repository at this point in the history

  2. Kuntai: adjust latency-test.json to reproduce bugs

    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    152f3f9 View commit details
    Browse the repository at this point in the history

  3. Kuntai: adjust latency-test.json to reproduce bugs

    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    ca7d6c5 View commit details
    Browse the repository at this point in the history

  4. Kuntai: bug found (running 8x22B after Llama 70B triggers the bug). U… 

    …pload crash report using buildkite
    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    1dc23de View commit details
    Browse the repository at this point in the history

  5. Kuntai: bug found (running 8x22B after Llama 70B triggers the bug). U… 

    …pload crash report using buildkite
    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    ef43f7d View commit details
    Browse the repository at this point in the history

  6. Kuntai: improve the readability of the benchmarking script

    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    e721c07 View commit details
    Browse the repository at this point in the history

  7. Kuntai: remove vllm configuration file after execution, hopefully it … 

    …will fix the crash bug
    @KuntaiDu
    KuntaiDu committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    0de27ff View commit details
    Browse the repository at this point in the history

  8. Add H100 node

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    3dd81fa View commit details
    Browse the repository at this point in the history

  9. remove comment

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    f511a71 View commit details
    Browse the repository at this point in the history

  10. use aws image

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    21306f2 View commit details
    Browse the repository at this point in the history

  11. mount code

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    0654dc5 View commit details
    Browse the repository at this point in the history

  12. reset entrypoints

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    417e4d3 View commit details
    Browse the repository at this point in the history

  13. do not use init

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    5bd8d93 View commit details
    Browse the repository at this point in the history

  14. set command

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    9bcdc87 View commit details
    Browse the repository at this point in the history

  15. inject env

    @simon-mo
    simon-mo committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    54754b5 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. report if buildkite agent is missing, and add longer timeout for wait… 

    …_for_server
    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    d5190a6 View commit details
    Browse the repository at this point in the history

  2. fix git clean bug in buidkite pipeline

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    7b57d96 View commit details
    Browse the repository at this point in the history

  3. fix git clean bug in buidkite pipeline

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    caea9c2 View commit details
    Browse the repository at this point in the history

  4. add debugging flag for more detailed error trace

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    92dcff1 View commit details
    Browse the repository at this point in the history

  5. add debugging flag

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8351dfc View commit details
    Browse the repository at this point in the history

  6. add debugging flag

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    bdc0201 View commit details
    Browse the repository at this point in the history

  7. log trace dumped. revert to review-ready version of the code

    @KuntaiDu
    KuntaiDu committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    b7ce36f View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. move the code to quick-benchmark folder, so that people do not get co… 

    …nfused
    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    f20d0b4 View commit details
    Browse the repository at this point in the history

  2. remove mixtral 8x22B with tp=8 for now, as GPU4 is not stable and thu… 

    …s cannot run tp=8
    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    09baa4f View commit details
    Browse the repository at this point in the history

  3. comment out H100

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    61276a0 View commit details
    Browse the repository at this point in the history

  4. add median and p99, and a new column reflecting GPU type

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    0097e9b View commit details
    Browse the repository at this point in the history

  5. support dummy loading for throughput test

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    504b862 View commit details
    Browse the repository at this point in the history

  6. add json file for debugging --- contains much less test cases so that… 

    … we can iterate faster
    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    75c517c View commit details
    Browse the repository at this point in the history

  7. update benchmarking script to handle multiple qps in serving test

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    71d21b3 View commit details
    Browse the repository at this point in the history

  8. update postprocessing script accordingly

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    1bcc201 View commit details
    Browse the repository at this point in the history

  9. change benchmark root to quick-benchmarks

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    691e8ac View commit details
    Browse the repository at this point in the history

  10. fix bug when globbing qps_list

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    06cc219 View commit details
    Browse the repository at this point in the history

  11. fix for loop

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3ff7399 View commit details
    Browse the repository at this point in the history

  12. evaluate client-side benchmarking command

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3c8a000 View commit details
    Browse the repository at this point in the history

  13. bug fix: fix bug when qps=inf

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    da17560 View commit details
    Browse the repository at this point in the history

  14. bug fix: fix bug when qps=inf

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    855073d View commit details
    Browse the repository at this point in the history

  15. add missing fi

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    a58bb94 View commit details
    Browse the repository at this point in the history

  16. add missing backslash

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    5d83c76 View commit details
    Browse the repository at this point in the history

  17. bring back the full test cases

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    94e2367 View commit details
    Browse the repository at this point in the history

  18. update the doc

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    553266c View commit details
    Browse the repository at this point in the history

  19. fix unnecessary eval command

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    f760deb View commit details
    Browse the repository at this point in the history

  20. make yapf happy

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    938e86c View commit details
    Browse the repository at this point in the history

  21. make yapf happy

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    7eab728 View commit details
    Browse the repository at this point in the history

  22. make yapf happy

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    810c9ff View commit details
    Browse the repository at this point in the history

  23. update the documents

    @KuntaiDu
    KuntaiDu committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    b3b5d5e View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. use BUILDKITE_COMMIT

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    423ba21 View commit details
    Browse the repository at this point in the history

  2. quotation

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    08be0e2 View commit details
    Browse the repository at this point in the history

  3. add jq

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    4f511e2 View commit details
    Browse the repository at this point in the history

  4. try >-

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    99656d3 View commit details
    Browse the repository at this point in the history

  5. fix quote

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    e420563 View commit details
    Browse the repository at this point in the history

  6. fix quote

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    42222dd View commit details
    Browse the repository at this point in the history

  7. use a script

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    d0ad3ae View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' of github.com:vllm-project/vllm into kuntai-tgibe… 

    …nch-dev
    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    0824f3f View commit details
    Browse the repository at this point in the history

  9. don't verbose

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    73dd63e View commit details
    Browse the repository at this point in the history

  10. rename

    @simon-mo
    simon-mo committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    d32723a View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. clean up

    @simon-mo
    simon-mo committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    f0a28f9 View commit details
    Browse the repository at this point in the history

  2. fix path

    @simon-mo
    simon-mo committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    dd90323 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:vllm-project/vllm into kuntai-tgibe… 

    …nch-dev
    @simon-mo
    simon-mo committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a4af5ff View commit details
    Browse the repository at this point in the history

  4. fix path error for convert-results-json-to-markdown.py

    @KuntaiDu
    KuntaiDu committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    64bfa57 View commit details
    Browse the repository at this point in the history