Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE] check for #6694 #6730

Closed
wants to merge 9 commits into from

Conversation

ygree
Copy link
Contributor

@ygree ygree commented Feb 23, 2024

What Does This Do

Motivation

Run all tests for merged #6694

Additional Notes

Jira ticket: [PROJ-IDENT]

@ygree ygree added tag: do not merge Do not merge changes run-tests: all Run all tests labels Feb 23, 2024
@pr-commenter
Copy link

pr-commenter bot commented Feb 24, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/telemetry-config-standardization-CHECK
git_commit_date 1708728504 1708723831
git_commit_sha 6167d5e 4f7daf4
release_version 1.31.0-SNAPSHOT~6167d5efc0 1.31.0-SNAPSHOT~4f7daf4012
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1708733834 1708733834
ci_job_id 442423615 442423615
ci_pipeline_id 28859170 28859170
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 10 unstable metrics.

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-02-23T23:53:32 2024-02-24T00:12:12
git_branch master ygree/telemetry-config-standardization-CHECK
git_commit_date 1708728504 1708723831
git_commit_sha 6167d5e 4f7daf4
release_version 1.31.0-SNAPSHOT~6167d5efc0 1.31.0-SNAPSHOT~4f7daf4012
start_time 2024-02-23T23:53:19 2024-02-24T00:11:59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1708733834 1708733834
ci_job_id 442423615 442423615
ci_pipeline_id 28859170 28859170
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 14 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.31.0-SNAPSHOT~4f7daf4012, baseline=1.31.0-SNAPSHOT~6167d5efc0
    dateFormat X
    axisFormat %s
section baseline
no_agent (363.504 µs) : 344, 383
.   : milestone, 364,
iast (479.77 µs) : 460, 500
.   : milestone, 480,
iast_FULL (546.461 µs) : 526, 567
.   : milestone, 546,
iast_GLOBAL (498.709 µs) : 478, 520
.   : milestone, 499,
iast_HARDCODED_SECRET_DISABLED (482.335 µs) : 462, 503
.   : milestone, 482,
iast_INACTIVE (460.502 µs) : 439, 482
.   : milestone, 461,
iast_TELEMETRY_OFF (476.562 µs) : 456, 498
.   : milestone, 477,
tracing (445.902 µs) : 425, 467
.   : milestone, 446,
section candidate
no_agent (363.782 µs) : 344, 383
.   : milestone, 364,
iast (475.59 µs) : 455, 496
.   : milestone, 476,
iast_FULL (543.922 µs) : 523, 565
.   : milestone, 544,
iast_GLOBAL (504.767 µs) : 484, 526
.   : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (487.539 µs) : 467, 508
.   : milestone, 488,
iast_INACTIVE (454.733 µs) : 434, 475
.   : milestone, 455,
iast_TELEMETRY_OFF (473.452 µs) : 453, 494
.   : milestone, 473,
tracing (442.861 µs) : 423, 463
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.504 µs [344.072 µs, 382.936 µs] -
iast 479.77 µs [459.53 µs, 500.01 µs] 116.266 µs (32.0%)
iast_FULL 546.461 µs [525.9 µs, 567.022 µs] 182.957 µs (50.3%)
iast_GLOBAL 498.709 µs [477.573 µs, 519.846 µs] 135.205 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 482.335 µs [461.747 µs, 502.924 µs] 118.831 µs (32.7%)
iast_INACTIVE 460.502 µs [438.972 µs, 482.032 µs] 96.998 µs (26.7%)
iast_TELEMETRY_OFF 476.562 µs [455.56 µs, 497.564 µs] 113.058 µs (31.1%)
tracing 445.902 µs [425.068 µs, 466.735 µs] 82.398 µs (22.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.782 µs [344.169 µs, 383.394 µs] -
iast 475.59 µs [455.232 µs, 495.949 µs] 111.808 µs (30.7%)
iast_FULL 543.922 µs [523.342 µs, 564.502 µs] 180.14 µs (49.5%)
iast_GLOBAL 504.767 µs [483.981 µs, 525.554 µs] 140.985 µs (38.8%)
iast_HARDCODED_SECRET_DISABLED 487.539 µs [466.829 µs, 508.249 µs] 123.757 µs (34.0%)
iast_INACTIVE 454.733 µs [434.409 µs, 475.057 µs] 90.951 µs (25.0%)
iast_TELEMETRY_OFF 473.452 µs [452.769 µs, 494.135 µs] 109.67 µs (30.1%)
tracing 442.861 µs [422.82 µs, 462.901 µs] 79.079 µs (21.7%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.31.0-SNAPSHOT~4f7daf4012, baseline=1.31.0-SNAPSHOT~6167d5efc0
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.373 ms) : 1354, 1392
.   : milestone, 1373,
appsec (1.786 ms) : 1762, 1810
.   : milestone, 1786,
iast (1.554 ms) : 1531, 1577
.   : milestone, 1554,
profiling (1.54 ms) : 1516, 1565
.   : milestone, 1540,
tracing (1.527 ms) : 1503, 1551
.   : milestone, 1527,
section candidate
no_agent (1.375 ms) : 1356, 1394
.   : milestone, 1375,
appsec (1.771 ms) : 1746, 1795
.   : milestone, 1771,
iast (1.523 ms) : 1499, 1546
.   : milestone, 1523,
profiling (1.527 ms) : 1504, 1551
.   : milestone, 1527,
tracing (1.534 ms) : 1511, 1557
.   : milestone, 1534,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.373 ms [1.354 ms, 1.392 ms] -
appsec 1.786 ms [1.762 ms, 1.81 ms] 413.19 µs (30.1%)
iast 1.554 ms [1.531 ms, 1.577 ms] 181.145 µs (13.2%)
profiling 1.54 ms [1.516 ms, 1.565 ms] 167.441 µs (12.2%)
tracing 1.527 ms [1.503 ms, 1.551 ms] 154.021 µs (11.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.375 ms [1.356 ms, 1.394 ms] -
appsec 1.771 ms [1.746 ms, 1.795 ms] 395.474 µs (28.8%)
iast 1.523 ms [1.499 ms, 1.546 ms] 147.517 µs (10.7%)
profiling 1.527 ms [1.504 ms, 1.551 ms] 152.314 µs (11.1%)
tracing 1.534 ms [1.511 ms, 1.557 ms] 158.886 µs (11.6%)

@ygree ygree closed this Feb 24, 2024
@ygree ygree deleted the ygree/telemetry-config-standardization-CHECK branch February 24, 2024 03:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run-tests: all Run all tests tag: do not merge Do not merge changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant