Skip to content

Commit be9efff

Browse files
aas008cursoragent
andcommitted
[rhaiis] presets: collect all profiles and vLLM profiler traces
Run profile1-4 and enable the vLLM profiler so spec-decoding jobs land on the staging dashboard with traces uploaded to S3. Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent a47a9b6 commit be9efff

2 files changed

Lines changed: 8 additions & 2 deletions

File tree

projects/rhaiis/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -530,7 +530,7 @@ python3 -m projects.rhaiis.orchestration.cli test \
530530
# Spec decoding comparison (H200 Zeus): presets.d/spec-decoding.yaml
531531
# deepseek-v4-baseline | deepseek-v4-mtp | deepseek-v4-dspark | deepseek-v4-dspark-dynamic
532532
python3 -m projects.rhaiis.orchestration.cli test \
533-
--preset deepseek-v4-dspark --preset profile1
533+
--preset deepseek-v4-dspark
534534
```
535535

536536
Per-cluster presets (e.g. `presets.d/mehulvalidation.yaml`) set cluster-specific

projects/rhaiis/orchestration/presets.d/spec-decoding.yaml

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
__multiple: true
22

33
# DeepSeek-V4-Pro-0813 speculative decoding comparison on H200 Zeus (TP=8).
4-
# Combine with a workload preset (profile1/profile2/profile3/profile4).
4+
# Runs all four workload profiles so they land on the staging dashboard.
55
#
66
# Adaptive verification (enable_adaptive_verification) is omitted: DeepSeek-V4
77
# indexer/MLA backends only support the device-side trim + varlen full CUDA
@@ -11,6 +11,12 @@ deepseek-v4-spec-base:
1111
rhaiis.accelerator: nvidia
1212
rhaiis.cluster_tag: zeus
1313
rhaiis.engines.vllm.args.gpu-memory-utilization: 0.9
14+
tests.rhaiis.workload_keys:
15+
- profile1
16+
- profile2
17+
- profile3
18+
- profile4
19+
rhaiis.profiler.enabled: true
1420

1521
# 1. No speculative decoding
1622
deepseek-v4-baseline:

0 commit comments

Comments
 (0)