Add CUDA graph capture/replay for qwen 3.5 moe decode method #381
| Job | Run time |
|---|---|
| 33m 46s | |
| 30m 46s | |
| 31m 21s | |
| 9m 26s | |
| 9m 6s | |
| 34m 8s | |
| 13m 16s | |
| 12m 1s | |
| 9m 56s | |
| 10m 13s | |
| 10m 40s | |
| 10m 6s | |
| 10m 17s | |
| 11m 0s | |
| 11m 56s | |
| 10m 33s | |
| 10m 13s | |
| 12m 19s | |
| 10m 18s | |
| 10m 27s | |
| 11m 1s | |
| 5h 12m 49s |
| Job | Run time |
|---|---|
| 33m 46s | |
| 30m 46s | |
| 31m 21s | |
| 9m 26s | |
| 9m 6s | |
| 34m 8s | |
| 13m 16s | |
| 12m 1s | |
| 9m 56s | |
| 10m 13s | |
| 10m 40s | |
| 10m 6s | |
| 10m 17s | |
| 11m 0s | |
| 11m 56s | |
| 10m 33s | |
| 10m 13s | |
| 12m 19s | |
| 10m 18s | |
| 10m 27s | |
| 11m 1s | |
| 5h 12m 49s |