Feature(MInference): add vllm support for 0.4.2 and 0.4.3 (#19) #8
Job | Run time |
---|---|
4s | |
11m 20s | |
11m 25s | |
11m 2s | |
10m 57s | |
11m 39s | |
11m 14s | |
11m 10s | |
10m 49s | |
11m 23s | |
11m 3s | |
11m 16s | |
11m 27s | |
11m 41s | |
11m 19s | |
10m 23s | |
11m 13s | |
11m 2s | |
10m 58s | |
11m 6s | |
11m 28s | |
11m 5s | |
10m 45s | |
10m 55s | |
11m 5s | |
10m 41s | |
11m 33s | |
11m 24s | |
11m 38s | |
7m 51s | |
5h 20m 56s |