AutoTune MoE kernel block sizes for accelerate inference (#18551) #12276
| Job | Run time |
|---|---|
| 34m 32s | |
| 47m 34s | |
| 20m 5s | |
| 21m 29s | |
| 19m 45s | |
| 19m 16s | |
| 36m 10s | |
| 21m 15s | |
| 36m 41s | |
| 1h 9m 28s | |
| 25m 15s | |
| 34m 15s | |
| 34m 1s | |
| 31m 29s | |
| 25m 27s | |
| 24m 0s | |
| 26m 14s | |
| 35m 50s | |
| 24m 56s | |
| 35m 30s | |
| 29m 4s | |
| 31m 31s | |
| 4s | |
| 24m 42s | |
| 22m 37s | |
| 22m 34s | |
| 31m 50s | |
| 17m 12s | |
| 31m 56s | |
| 18m 35s | |
| 17m 27s | |
| 17m 32s | |
| 19m 23s | |
| 16m 54s | |
| 18m 48s | |
| 32m 38s | |
| 16m 55s | |
| 31m 51s | |
| 16m 54s | |
| 39m 55s | |
| 18h 1m 34s |