Skip to content

perf: switch saturation tests to static/1KB logs and reduce loadgen to SUT ratio to 2:1 #2643

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
cijothomas wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

perf: switch saturation tests to static/1KB logs and reduce loadgen to SUT ratio to 2:1 #2643

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
6354a14
perf: switch saturation tests to static/1KB logs and reduce loadgen r…
cijothomas Apr 13, 2026
008e9f8
fix: pass data_source and log_body_size_bytes through test steps temp…
cijothomas Apr 13, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-16cores.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ from_template:
variables:
num_cores: 16
engine_core_range: "0-15"
loadgen_cores: 48
loadgen_core_range: "16-63"
loadgen_cores: 32
loadgen_core_range: "16-47"
backend_cores: 16
backend_core_range: "64-79"
backend_core_range: "48-63"
max_batch_size: 512
6 changes: 3 additions & 3 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-1core.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ from_template:
variables:
num_cores: 1
engine_core_range: "0-0"
loadgen_cores: 3
loadgen_core_range: "1-3"
loadgen_cores: 2
loadgen_core_range: "1-2"
backend_cores: 1
backend_core_range: "4-4"
backend_core_range: "3-3"
max_batch_size: 512
6 changes: 3 additions & 3 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-2cores.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ from_template:
variables:
num_cores: 2
engine_core_range: "0-1"
loadgen_cores: 6
loadgen_core_range: "2-7"
loadgen_cores: 4
loadgen_core_range: "2-5"
backend_cores: 2
backend_core_range: "8-9"
backend_core_range: "6-7"
max_batch_size: 512
11 changes: 11 additions & 0 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-32cores.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
# Saturation test with 32 core df_engine
from_template:
path: test_suites/integration/continuous/saturation-cores-template.yaml.j2
variables:
num_cores: 32
engine_core_range: "0-31"
loadgen_cores: 64
loadgen_core_range: "32-95"
backend_cores: 32
backend_core_range: "96-127"
max_batch_size: 512
6 changes: 3 additions & 3 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-4cores.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ from_template:
variables:
num_cores: 4
engine_core_range: "0-3"
loadgen_cores: 12
loadgen_core_range: "4-15"
loadgen_cores: 8
loadgen_core_range: "4-11"
backend_cores: 4
backend_core_range: "16-19"
backend_core_range: "12-15"
max_batch_size: 512
6 changes: 3 additions & 3 deletions tools/pipeline_perf_test/test_suites/integration/continuous/saturation-8cores.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ from_template:
variables:
num_cores: 8
engine_core_range: "0-7"
loadgen_cores: 24
loadgen_core_range: "8-31"
loadgen_cores: 16
loadgen_core_range: "8-23"
backend_cores: 8
backend_core_range: "32-39"
backend_core_range: "24-31"
max_batch_size: 512
2 changes: 2 additions & 0 deletions ...s/pipeline_perf_test/test_suites/integration/continuous/saturation-cores-template.yaml.j2
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -78,3 +78,5 @@ tests:
observation_interval: 60
signals_per_second: null # Using null means loadgen don't self-cap the rate.
max_batch_size: {{max_batch_size}}
data_source: static
log_body_size_bytes: 1024
Copy link
Copy Markdown
Member

@lalitb lalitb Apr 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pleas check, I think these new saturation variables also need to be added to df-loadgen-steps-docker..yaml, otherwise config.yaml.j2 will keep rendering the old defaults.

Copy link
Copy Markdown
Member Author

@cijothomas cijothomas Apr 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch. I am still hitting other bottlenecks, likely due to docker networking. Investigating them now. Marked PR as draft for now.

3 changes: 2 additions & 1 deletion tools/pipeline_perf_test/test_suites/integration/templates/configs/loadgen/config.yaml.j2
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,14 +16,15 @@ groups:
receiver:
type: "urn:otel:receiver:traffic_generator"
config:
data_source: semantic_conventions
data_source: {{ data_source | default("semantic_conventions") }}
generation_strategy: {{ generation_strategy | default("pre_generated") }}
traffic_config:
max_batch_size: {{ max_batch_size | default(1000) }}
signals_per_second: {% if signals_per_second is none %}null{% else %}{{ signals_per_second | default(100000) }}{% endif %}
metric_weight: {{ metric_weight | default(0) }}
trace_weight: {{ trace_weight | default(0) }}
log_weight: {{ log_weight | default(100) }}
{% if log_body_size_bytes is defined %}log_body_size_bytes: {{ log_body_size_bytes }}{% endif %}

{%- set exporter_type = loadgen_exporter_type | default("otap") %}
{%- set engine_host = engine_hostname | default("localhost") %}
Expand Down
Loading