-
-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with perf-benchmarks
label
#5073
Commits on May 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 470b1c0 - Browse repository at this point
Copy the full SHA 470b1c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f522ae - Browse repository at this point
Copy the full SHA 0f522aeView commit details
Commits on Jun 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for fb4040b - Browse repository at this point
Copy the full SHA fb4040bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8abe615 - Browse repository at this point
Copy the full SHA 8abe615View commit details -
Configuration menu - View commit details
-
Copy full SHA for fca4a47 - Browse repository at this point
Copy the full SHA fca4a47View commit details
Commits on Jun 4, 2024
-
Kuntai: change the TGI script so that it can be ran inside TGI contai…
…ner, and rename the files
Configuration menu - View commit details
-
Copy full SHA for d6e7faf - Browse repository at this point
Copy the full SHA d6e7fafView commit details -
Configuration menu - View commit details
-
Copy full SHA for fed1136 - Browse repository at this point
Copy the full SHA fed1136View commit details -
Configuration menu - View commit details
-
Copy full SHA for c879a89 - Browse repository at this point
Copy the full SHA c879a89View commit details -
Kuntai: update run-vllm-benchmarks.sh so that it parses test cases fr…
…om benchmark-parameters.json
Configuration menu - View commit details
-
Copy full SHA for c7c1ce6 - Browse repository at this point
Copy the full SHA c7c1ce6View commit details
Commits on Jun 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 33cf9cc - Browse repository at this point
Copy the full SHA 33cf9ccView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f4aab3 - Browse repository at this point
Copy the full SHA 0f4aab3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e2bb78 - Browse repository at this point
Copy the full SHA 8e2bb78View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9d8d904 - Browse repository at this point
Copy the full SHA 9d8d904View commit details -
Configuration menu - View commit details
-
Copy full SHA for d02b35b - Browse repository at this point
Copy the full SHA d02b35bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2ba3559 - Browse repository at this point
Copy the full SHA 2ba3559View commit details -
Configuration menu - View commit details
-
Copy full SHA for c321200 - Browse repository at this point
Copy the full SHA c321200View commit details -
Configuration menu - View commit details
-
Copy full SHA for e3bb365 - Browse repository at this point
Copy the full SHA e3bb365View commit details -
Configuration menu - View commit details
-
Copy full SHA for 22c6dcc - Browse repository at this point
Copy the full SHA 22c6dccView commit details -
Configuration menu - View commit details
-
Copy full SHA for 249aa02 - Browse repository at this point
Copy the full SHA 249aa02View commit details -
Configuration menu - View commit details
-
Copy full SHA for b41b579 - Browse repository at this point
Copy the full SHA b41b579View commit details -
Configuration menu - View commit details
-
Copy full SHA for ab7a744 - Browse repository at this point
Copy the full SHA ab7a744View commit details
Commits on Jun 6, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0707a7f - Browse repository at this point
Copy the full SHA 0707a7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 33d31bf - Browse repository at this point
Copy the full SHA 33d31bfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 15dd5a9 - Browse repository at this point
Copy the full SHA 15dd5a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ffe79b - Browse repository at this point
Copy the full SHA 9ffe79bView commit details -
Configuration menu - View commit details
-
Copy full SHA for f9805f0 - Browse repository at this point
Copy the full SHA f9805f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6febc17 - Browse repository at this point
Copy the full SHA 6febc17View commit details -
Configuration menu - View commit details
-
Copy full SHA for d9a40c1 - Browse repository at this point
Copy the full SHA d9a40c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e448df - Browse repository at this point
Copy the full SHA 2e448dfView commit details
Commits on Jun 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f14d3bb - Browse repository at this point
Copy the full SHA f14d3bbView commit details -
Configuration menu - View commit details
-
Copy full SHA for d6db0af - Browse repository at this point
Copy the full SHA d6db0afView commit details -
Configuration menu - View commit details
-
Copy full SHA for 43deac5 - Browse repository at this point
Copy the full SHA 43deac5View commit details -
Configuration menu - View commit details
-
Copy full SHA for a318650 - Browse repository at this point
Copy the full SHA a318650View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9e11de - Browse repository at this point
Copy the full SHA b9e11deView commit details -
Configuration menu - View commit details
-
Copy full SHA for b12556f - Browse repository at this point
Copy the full SHA b12556fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 223a69a - Browse repository at this point
Copy the full SHA 223a69aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6aadb3d - Browse repository at this point
Copy the full SHA 6aadb3dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 63e4bf4 - Browse repository at this point
Copy the full SHA 63e4bf4View commit details -
Configuration menu - View commit details
-
Copy full SHA for a8876d3 - Browse repository at this point
Copy the full SHA a8876d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1a19d71 - Browse repository at this point
Copy the full SHA 1a19d71View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3cad48f - Browse repository at this point
Copy the full SHA 3cad48fView commit details -
Configuration menu - View commit details
-
Copy full SHA for e36e606 - Browse repository at this point
Copy the full SHA e36e606View commit details -
Configuration menu - View commit details
-
Copy full SHA for ee9d701 - Browse repository at this point
Copy the full SHA ee9d701View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0abebfc - Browse repository at this point
Copy the full SHA 0abebfcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 095b517 - Browse repository at this point
Copy the full SHA 095b517View commit details -
Configuration menu - View commit details
-
Copy full SHA for d5d55b4 - Browse repository at this point
Copy the full SHA d5d55b4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6eaef5a - Browse repository at this point
Copy the full SHA 6eaef5aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e2428a9 - Browse repository at this point
Copy the full SHA e2428a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3bf2bae - Browse repository at this point
Copy the full SHA 3bf2baeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3dc0bed - Browse repository at this point
Copy the full SHA 3dc0bedView commit details -
Configuration menu - View commit details
-
Copy full SHA for 70e5778 - Browse repository at this point
Copy the full SHA 70e5778View commit details -
Configuration menu - View commit details
-
Copy full SHA for 48b8914 - Browse repository at this point
Copy the full SHA 48b8914View commit details
Commits on Jun 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1a5a2c3 - Browse repository at this point
Copy the full SHA 1a5a2c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5bd23e9 - Browse repository at this point
Copy the full SHA 5bd23e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c8dd6a - Browse repository at this point
Copy the full SHA 4c8dd6aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 973c018 - Browse repository at this point
Copy the full SHA 973c018View commit details
Commits on Jun 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 74ecb6f - Browse repository at this point
Copy the full SHA 74ecb6fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 152f3f9 - Browse repository at this point
Copy the full SHA 152f3f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca7d6c5 - Browse repository at this point
Copy the full SHA ca7d6c5View commit details -
Kuntai: bug found (running 8x22B after Llama 70B triggers the bug). U…
…pload crash report using buildkite
Configuration menu - View commit details
-
Copy full SHA for 1dc23de - Browse repository at this point
Copy the full SHA 1dc23deView commit details -
Kuntai: bug found (running 8x22B after Llama 70B triggers the bug). U…
…pload crash report using buildkite
Configuration menu - View commit details
-
Copy full SHA for ef43f7d - Browse repository at this point
Copy the full SHA ef43f7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e721c07 - Browse repository at this point
Copy the full SHA e721c07View commit details -
Kuntai: remove vllm configuration file after execution, hopefully it …
…will fix the crash bug
Configuration menu - View commit details
-
Copy full SHA for 0de27ff - Browse repository at this point
Copy the full SHA 0de27ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3dd81fa - Browse repository at this point
Copy the full SHA 3dd81faView commit details -
Configuration menu - View commit details
-
Copy full SHA for f511a71 - Browse repository at this point
Copy the full SHA f511a71View commit details -
Configuration menu - View commit details
-
Copy full SHA for 21306f2 - Browse repository at this point
Copy the full SHA 21306f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0654dc5 - Browse repository at this point
Copy the full SHA 0654dc5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 417e4d3 - Browse repository at this point
Copy the full SHA 417e4d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5bd8d93 - Browse repository at this point
Copy the full SHA 5bd8d93View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9bcdc87 - Browse repository at this point
Copy the full SHA 9bcdc87View commit details -
Configuration menu - View commit details
-
Copy full SHA for 54754b5 - Browse repository at this point
Copy the full SHA 54754b5View commit details
Commits on Jun 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d5190a6 - Browse repository at this point
Copy the full SHA d5190a6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7b57d96 - Browse repository at this point
Copy the full SHA 7b57d96View commit details -
Configuration menu - View commit details
-
Copy full SHA for caea9c2 - Browse repository at this point
Copy the full SHA caea9c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 92dcff1 - Browse repository at this point
Copy the full SHA 92dcff1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8351dfc - Browse repository at this point
Copy the full SHA 8351dfcView commit details -
Configuration menu - View commit details
-
Copy full SHA for bdc0201 - Browse repository at this point
Copy the full SHA bdc0201View commit details -
Configuration menu - View commit details
-
Copy full SHA for b7ce36f - Browse repository at this point
Copy the full SHA b7ce36fView commit details
Commits on Jun 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f20d0b4 - Browse repository at this point
Copy the full SHA f20d0b4View commit details -
remove mixtral 8x22B with tp=8 for now, as GPU4 is not stable and thu…
…s cannot run tp=8
Configuration menu - View commit details
-
Copy full SHA for 09baa4f - Browse repository at this point
Copy the full SHA 09baa4fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 61276a0 - Browse repository at this point
Copy the full SHA 61276a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0097e9b - Browse repository at this point
Copy the full SHA 0097e9bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 504b862 - Browse repository at this point
Copy the full SHA 504b862View commit details -
add json file for debugging --- contains much less test cases so that…
… we can iterate faster
Configuration menu - View commit details
-
Copy full SHA for 75c517c - Browse repository at this point
Copy the full SHA 75c517cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 71d21b3 - Browse repository at this point
Copy the full SHA 71d21b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1bcc201 - Browse repository at this point
Copy the full SHA 1bcc201View commit details -
Configuration menu - View commit details
-
Copy full SHA for 691e8ac - Browse repository at this point
Copy the full SHA 691e8acView commit details -
Configuration menu - View commit details
-
Copy full SHA for 06cc219 - Browse repository at this point
Copy the full SHA 06cc219View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ff7399 - Browse repository at this point
Copy the full SHA 3ff7399View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c8a000 - Browse repository at this point
Copy the full SHA 3c8a000View commit details -
Configuration menu - View commit details
-
Copy full SHA for da17560 - Browse repository at this point
Copy the full SHA da17560View commit details -
Configuration menu - View commit details
-
Copy full SHA for 855073d - Browse repository at this point
Copy the full SHA 855073dView commit details -
Configuration menu - View commit details
-
Copy full SHA for a58bb94 - Browse repository at this point
Copy the full SHA a58bb94View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d83c76 - Browse repository at this point
Copy the full SHA 5d83c76View commit details -
Configuration menu - View commit details
-
Copy full SHA for 94e2367 - Browse repository at this point
Copy the full SHA 94e2367View commit details -
Configuration menu - View commit details
-
Copy full SHA for 553266c - Browse repository at this point
Copy the full SHA 553266cView commit details -
Configuration menu - View commit details
-
Copy full SHA for f760deb - Browse repository at this point
Copy the full SHA f760debView commit details -
Configuration menu - View commit details
-
Copy full SHA for 938e86c - Browse repository at this point
Copy the full SHA 938e86cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7eab728 - Browse repository at this point
Copy the full SHA 7eab728View commit details -
Configuration menu - View commit details
-
Copy full SHA for 810c9ff - Browse repository at this point
Copy the full SHA 810c9ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for b3b5d5e - Browse repository at this point
Copy the full SHA b3b5d5eView commit details
Commits on Jun 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 423ba21 - Browse repository at this point
Copy the full SHA 423ba21View commit details -
Configuration menu - View commit details
-
Copy full SHA for 08be0e2 - Browse repository at this point
Copy the full SHA 08be0e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4f511e2 - Browse repository at this point
Copy the full SHA 4f511e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 99656d3 - Browse repository at this point
Copy the full SHA 99656d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for e420563 - Browse repository at this point
Copy the full SHA e420563View commit details -
Configuration menu - View commit details
-
Copy full SHA for 42222dd - Browse repository at this point
Copy the full SHA 42222ddView commit details -
Configuration menu - View commit details
-
Copy full SHA for d0ad3ae - Browse repository at this point
Copy the full SHA d0ad3aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0824f3f - Browse repository at this point
Copy the full SHA 0824f3fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 73dd63e - Browse repository at this point
Copy the full SHA 73dd63eView commit details -
Configuration menu - View commit details
-
Copy full SHA for d32723a - Browse repository at this point
Copy the full SHA d32723aView commit details
Commits on Jun 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f0a28f9 - Browse repository at this point
Copy the full SHA f0a28f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for dd90323 - Browse repository at this point
Copy the full SHA dd90323View commit details -
Configuration menu - View commit details
-
Copy full SHA for a4af5ff - Browse repository at this point
Copy the full SHA a4af5ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 64bfa57 - Browse repository at this point
Copy the full SHA 64bfa57View commit details