Skip to content

AutoTune MoE kernel block sizes for accelerate inference (#18551) #12276

AutoTune MoE kernel block sizes for accelerate inference (#18551)

AutoTune MoE kernel block sizes for accelerate inference (#18551) #12276

Job Run time
34m 32s
47m 34s
20m 5s
21m 29s
19m 45s
19m 16s
36m 10s
21m 15s
36m 41s
1h 9m 28s
25m 15s
34m 15s
34m 1s
31m 29s
25m 27s
24m 0s
26m 14s
35m 50s
24m 56s
35m 30s
29m 4s
31m 31s
4s
24m 42s
22m 37s
22m 34s
31m 50s
17m 12s
31m 56s
18m 35s
17m 27s
17m 32s
19m 23s
16m 54s
18m 48s
32m 38s
16m 55s
31m 51s
16m 54s
39m 55s
18h 1m 34s