Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use default trace protocol version in smoke tests #7258

Merged
merged 1 commit into from
Jul 1, 2024
Merged

Use default trace protocol version in smoke tests #7258

merged 1 commit into from
Jul 1, 2024

Conversation

smola
Copy link
Member

@smola smola commented Jun 28, 2024

What Does This Do

Use the default trace protocol version (v0.4 at the moment) in smoke tests.

Motivation

Support for decoding v0.4 in smoke tests agent was added in 2022, we can now just test the default behavior.

Additional Notes

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jun 28, 2024
@pr-commenter
Copy link

pr-commenter bot commented Jun 28, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/smoke-tests-default-trace-protocol
git_commit_date 1719587548 1719588553
git_commit_sha 11753ca 396e5bd
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~396e5bd119
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719592160 1719592160
ci_job_id 556698313 556698313
ci_pipeline_id 37868331 37868331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 16 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064741
Total [baseline] (10.318 s) : 0, 10318250
Agent [candidate] (1.076 s) : 0, 1076370
Total [candidate] (10.358 s) : 0, 10358078
section appsec
Agent [baseline] (1.185 s) : 0, 1184588
Total [baseline] (10.491 s) : 0, 10491117
Agent [candidate] (1.19 s) : 0, 1190056
Total [candidate] (10.48 s) : 0, 10480393
section iast
Agent [baseline] (1.17 s) : 0, 1169537
Total [baseline] (10.779 s) : 0, 10778826
Agent [candidate] (1.171 s) : 0, 1170530
Total [candidate] (10.785 s) : 0, 10784577
section profiling
Agent [baseline] (1.266 s) : 0, 1265840
Total [baseline] (10.568 s) : 0, 10568431
Agent [candidate] (1.265 s) : 0, 1264680
Total [candidate] (10.601 s) : 0, 10600804
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.185 s 119.848 ms (11.3%)
Agent iast 1.17 s 104.796 ms (9.8%)
Agent profiling 1.266 s 201.099 ms (18.9%)
Total tracing 10.318 s -
Total appsec 10.491 s 172.867 ms (1.7%)
Total iast 10.779 s 460.576 ms (4.5%)
Total profiling 10.568 s 250.181 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.19 s 113.685 ms (10.6%)
Agent iast 1.171 s 94.16 ms (8.7%)
Agent profiling 1.265 s 188.31 ms (17.5%)
Total tracing 10.358 s -
Total appsec 10.48 s 122.315 ms (1.2%)
Total iast 10.785 s 426.499 ms (4.1%)
Total profiling 10.601 s 242.726 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.714 ms) : 0, 666714
BytebuddyAgent [candidate] (675.621 ms) : 0, 675621
GlobalTracer [baseline] (305.252 ms) : 0, 305252
GlobalTracer [candidate] (306.731 ms) : 0, 306731
AppSec [baseline] (49.939 ms) : 0, 49939
AppSec [candidate] (50.537 ms) : 0, 50537
Remote Config [baseline] (743.794 µs) : 0, 744
Remote Config [candidate] (758.356 µs) : 0, 758
Telemetry [baseline] (7.514 ms) : 0, 7514
Telemetry [candidate] (7.682 ms) : 0, 7682
section appsec
BytebuddyAgent [baseline] (677.945 ms) : 0, 677945
BytebuddyAgent [candidate] (681.041 ms) : 0, 681041
GlobalTracer [baseline] (298.006 ms) : 0, 298006
GlobalTracer [candidate] (299.426 ms) : 0, 299426
AppSec [baseline] (154.065 ms) : 0, 154065
AppSec [candidate] (154.437 ms) : 0, 154437
Remote Config [baseline] (633.277 µs) : 0, 633
Remote Config [candidate] (630.851 µs) : 0, 631
Telemetry [baseline] (8.382 ms) : 0, 8382
Telemetry [candidate] (9.408 ms) : 0, 9408
IAST [baseline] (21.826 ms) : 0, 21826
IAST [candidate] (20.417 ms) : 0, 20417
section iast
BytebuddyAgent [baseline] (778.701 ms) : 0, 778701
BytebuddyAgent [candidate] (779.259 ms) : 0, 779259
GlobalTracer [baseline] (294.242 ms) : 0, 294242
GlobalTracer [candidate] (294.016 ms) : 0, 294016
AppSec [baseline] (47.393 ms) : 0, 47393
AppSec [candidate] (47.336 ms) : 0, 47336
Remote Config [baseline] (611.607 µs) : 0, 612
Remote Config [candidate] (588.632 µs) : 0, 589
Telemetry [baseline] (7.027 ms) : 0, 7027
Telemetry [candidate] (6.964 ms) : 0, 6964
IAST [baseline] (28.121 ms) : 0, 28121
IAST [candidate] (28.902 ms) : 0, 28902
section profiling
BytebuddyAgent [baseline] (664.011 ms) : 0, 664011
BytebuddyAgent [candidate] (663.317 ms) : 0, 663317
GlobalTracer [baseline] (388.251 ms) : 0, 388251
GlobalTracer [candidate] (387.287 ms) : 0, 387287
AppSec [baseline] (52.016 ms) : 0, 52016
AppSec [candidate] (52.024 ms) : 0, 52024
Remote Config [baseline] (655.278 µs) : 0, 655
Remote Config [candidate] (652.113 µs) : 0, 652
Telemetry [baseline] (7.357 ms) : 0, 7357
Telemetry [candidate] (7.365 ms) : 0, 7365
ProfilingAgent [baseline] (96.407 ms) : 0, 96407
ProfilingAgent [candidate] (96.822 ms) : 0, 96822
Profiling [baseline] (96.432 ms) : 0, 96432
Profiling [candidate] (96.847 ms) : 0, 96847
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064650
Total [baseline] (8.526 s) : 0, 8526340
Agent [candidate] (1.061 s) : 0, 1060628
Total [candidate] (8.565 s) : 0, 8564803
section iast
Agent [baseline] (1.178 s) : 0, 1178423
Total [baseline] (9.016 s) : 0, 9015782
Agent [candidate] (1.171 s) : 0, 1170727
Total [candidate] (9.008 s) : 0, 9007717
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1178666
Total [baseline] (8.986 s) : 0, 8986178
Agent [candidate] (1.168 s) : 0, 1168032
Total [candidate] (8.997 s) : 0, 8997319
section iast_TELEMETRY_OFF
Agent [baseline] (1.168 s) : 0, 1168436
Total [baseline] (8.993 s) : 0, 8992519
Agent [candidate] (1.167 s) : 0, 1167047
Total [candidate] (8.987 s) : 0, 8987169
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.178 s 113.773 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 114.016 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.168 s 103.786 ms (9.7%)
Total tracing 8.526 s -
Total iast 9.016 s 489.441 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 8.986 s 459.837 ms (5.4%)
Total iast_TELEMETRY_OFF 8.993 s 466.179 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.171 s 110.099 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.168 s 107.404 ms (10.1%)
Agent iast_TELEMETRY_OFF 1.167 s 106.42 ms (10.0%)
Total tracing 8.565 s -
Total iast 9.008 s 442.914 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 8.997 s 432.516 ms (5.0%)
Total iast_TELEMETRY_OFF 8.987 s 422.366 ms (4.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.077 ms) : 0, 667077
BytebuddyAgent [candidate] (663.536 ms) : 0, 663536
GlobalTracer [baseline] (304.448 ms) : 0, 304448
GlobalTracer [candidate] (303.872 ms) : 0, 303872
AppSec [baseline] (50.25 ms) : 0, 50250
AppSec [candidate] (50.358 ms) : 0, 50358
Remote Config [baseline] (746.669 µs) : 0, 747
Remote Config [candidate] (752.536 µs) : 0, 753
Telemetry [baseline] (7.588 ms) : 0, 7588
Telemetry [candidate] (7.617 ms) : 0, 7617
section iast
BytebuddyAgent [baseline] (786.16 ms) : 0, 786160
BytebuddyAgent [candidate] (780.106 ms) : 0, 780106
GlobalTracer [baseline] (296.134 ms) : 0, 296134
GlobalTracer [candidate] (293.999 ms) : 0, 293999
AppSec [baseline] (47.624 ms) : 0, 47624
AppSec [candidate] (47.323 ms) : 0, 47323
Remote Config [baseline] (603.54 µs) : 0, 604
Remote Config [candidate] (646.395 µs) : 0, 646
Telemetry [baseline] (6.999 ms) : 0, 6999
Telemetry [candidate] (7.814 ms) : 0, 7814
IAST [baseline] (27.363 ms) : 0, 27363
IAST [candidate] (27.436 ms) : 0, 27436
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.382 ms) : 0, 786382
BytebuddyAgent [candidate] (777.121 ms) : 0, 777121
GlobalTracer [baseline] (296.291 ms) : 0, 296291
GlobalTracer [candidate] (294.289 ms) : 0, 294289
AppSec [baseline] (47.506 ms) : 0, 47506
AppSec [candidate] (47.446 ms) : 0, 47446
Remote Config [baseline] (603.151 µs) : 0, 603
Remote Config [candidate] (585.556 µs) : 0, 586
Telemetry [baseline] (7.798 ms) : 0, 7798
Telemetry [candidate] (6.983 ms) : 0, 6983
IAST [baseline] (26.531 ms) : 0, 26531
IAST [candidate] (28.174 ms) : 0, 28174
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.991 ms) : 0, 777991
BytebuddyAgent [candidate] (776.775 ms) : 0, 776775
GlobalTracer [baseline] (294.914 ms) : 0, 294914
GlobalTracer [candidate] (294.072 ms) : 0, 294072
AppSec [baseline] (47.021 ms) : 0, 47021
AppSec [candidate] (47.228 ms) : 0, 47228
Remote Config [baseline] (587.044 µs) : 0, 587
Remote Config [candidate] (1.363 ms) : 0, 1363
Telemetry [baseline] (9.826 ms) : 0, 9826
Telemetry [candidate] (8.429 ms) : 0, 8429
IAST [baseline] (24.642 ms) : 0, 24642
IAST [candidate] (25.715 ms) : 0, 25715
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-28T16:00:07 2024-06-28T16:06:58
git_branch master smola/smoke-tests-default-trace-protocol
git_commit_date 1719587548 1719588553
git_commit_sha 11753ca 396e5bd
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~396e5bd119
start_time 2024-06-28T15:59:54 2024-06-28T16:06:44
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719591164 1719591164
ci_job_id 556698315 556698315
ci_pipeline_id 37868331 37868331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.462 µs) : 349, 388
.   : milestone, 368,
iast (479.827 µs) : 459, 501
.   : milestone, 480,
iast_FULL (557.057 µs) : 536, 578
.   : milestone, 557,
iast_GLOBAL (512.973 µs) : 490, 536
.   : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (486.255 µs) : 465, 508
.   : milestone, 486,
iast_INACTIVE (455.207 µs) : 434, 477
.   : milestone, 455,
iast_TELEMETRY_OFF (468.181 µs) : 447, 489
.   : milestone, 468,
tracing (452.753 µs) : 431, 474
.   : milestone, 453,
section candidate
no_agent (369.107 µs) : 349, 389
.   : milestone, 369,
iast (481.408 µs) : 461, 502
.   : milestone, 481,
iast_FULL (559.548 µs) : 538, 581
.   : milestone, 560,
iast_GLOBAL (502.34 µs) : 481, 523
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (483.515 µs) : 462, 505
.   : milestone, 484,
iast_INACTIVE (456.264 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (479.659 µs) : 458, 502
.   : milestone, 480,
tracing (441.224 µs) : 421, 462
.   : milestone, 441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.462 µs [349.006 µs, 387.917 µs] -
iast 479.827 µs [458.901 µs, 500.752 µs] 111.365 µs (30.2%)
iast_FULL 557.057 µs [535.899 µs, 578.214 µs] 188.595 µs (51.2%)
iast_GLOBAL 512.973 µs [490.16 µs, 535.785 µs] 144.511 µs (39.2%)
iast_HARDCODED_SECRET_DISABLED 486.255 µs [464.741 µs, 507.768 µs] 117.793 µs (32.0%)
iast_INACTIVE 455.207 µs [433.891 µs, 476.524 µs] 86.746 µs (23.5%)
iast_TELEMETRY_OFF 468.181 µs [447.379 µs, 488.982 µs] 99.719 µs (27.1%)
tracing 452.753 µs [431.273 µs, 474.234 µs] 84.292 µs (22.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.107 µs [349.053 µs, 389.162 µs] -
iast 481.408 µs [460.579 µs, 502.237 µs] 112.301 µs (30.4%)
iast_FULL 559.548 µs [538.368 µs, 580.728 µs] 190.44 µs (51.6%)
iast_GLOBAL 502.34 µs [481.311 µs, 523.369 µs] 133.233 µs (36.1%)
iast_HARDCODED_SECRET_DISABLED 483.515 µs [462.417 µs, 504.614 µs] 114.408 µs (31.0%)
iast_INACTIVE 456.264 µs [434.727 µs, 477.802 µs] 87.157 µs (23.6%)
iast_TELEMETRY_OFF 479.659 µs [457.706 µs, 501.611 µs] 110.551 µs (30.0%)
tracing 441.224 µs [420.729 µs, 461.719 µs] 72.117 µs (19.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1334, 1373
.   : milestone, 1353,
appsec (1.711 ms) : 1687, 1735
.   : milestone, 1711,
appsec_no_iast (1.73 ms) : 1706, 1753
.   : milestone, 1730,
iast (1.482 ms) : 1460, 1505
.   : milestone, 1482,
profiling (1.539 ms) : 1514, 1564
.   : milestone, 1539,
tracing (1.489 ms) : 1464, 1514
.   : milestone, 1489,
section candidate
no_agent (1.344 ms) : 1326, 1363
.   : milestone, 1344,
appsec (1.723 ms) : 1699, 1746
.   : milestone, 1723,
appsec_no_iast (1.742 ms) : 1718, 1766
.   : milestone, 1742,
iast (1.483 ms) : 1460, 1506
.   : milestone, 1483,
profiling (1.482 ms) : 1458, 1507
.   : milestone, 1482,
tracing (1.47 ms) : 1445, 1494
.   : milestone, 1470,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.334 ms, 1.373 ms] -
appsec 1.711 ms [1.687 ms, 1.735 ms] 357.676 µs (26.4%)
appsec_no_iast 1.73 ms [1.706 ms, 1.753 ms] 376.156 µs (27.8%)
iast 1.482 ms [1.46 ms, 1.505 ms] 129.073 µs (9.5%)
profiling 1.539 ms [1.514 ms, 1.564 ms] 185.968 µs (13.7%)
tracing 1.489 ms [1.464 ms, 1.514 ms] 135.575 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.326 ms, 1.363 ms] -
appsec 1.723 ms [1.699 ms, 1.746 ms] 378.123 µs (28.1%)
appsec_no_iast 1.742 ms [1.718 ms, 1.766 ms] 397.656 µs (29.6%)
iast 1.483 ms [1.46 ms, 1.506 ms] 138.31 µs (10.3%)
profiling 1.482 ms [1.458 ms, 1.507 ms] 137.922 µs (10.3%)
tracing 1.47 ms [1.445 ms, 1.494 ms] 125.048 µs (9.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/smoke-tests-default-trace-protocol
git_commit_date 1719587548 1719588553
git_commit_sha 11753ca 396e5bd
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~396e5bd119
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1719591783 1719591783
ci_job_id 556698316 556698316
ci_pipeline_id 37868331 37868331
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
appsec (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
iast (18.569 s) : 18569000, 18569000
.   : milestone, 18569000,
iast_GLOBAL (17.901 s) : 17901000, 17901000
.   : milestone, 17901000,
profiling (15.196 s) : 15196000, 15196000
.   : milestone, 15196000,
tracing (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
section candidate
no_agent (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
appsec (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
iast (18.909 s) : 18909000, 18909000
.   : milestone, 18909000,
iast_GLOBAL (17.787 s) : 17787000, 17787000
.   : milestone, 17787000,
profiling (15.316 s) : 15316000, 15316000
.   : milestone, 15316000,
tracing (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.862 s [14.862 s, 14.862 s] -
appsec 15.051 s [15.051 s, 15.051 s] 189.0 ms (1.3%)
iast 18.569 s [18.569 s, 18.569 s] 3.707 s (24.9%)
iast_GLOBAL 17.901 s [17.901 s, 17.901 s] 3.039 s (20.4%)
profiling 15.196 s [15.196 s, 15.196 s] 334.0 ms (2.2%)
tracing 14.988 s [14.988 s, 14.988 s] 126.0 ms (0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.981 s [14.981 s, 14.981 s] -
appsec 15.049 s [15.049 s, 15.049 s] 68.0 ms (0.5%)
iast 18.909 s [18.909 s, 18.909 s] 3.928 s (26.2%)
iast_GLOBAL 17.787 s [17.787 s, 17.787 s] 2.806 s (18.7%)
profiling 15.316 s [15.316 s, 15.316 s] 335.0 ms (2.2%)
tracing 14.971 s [14.971 s, 14.971 s] -10.0 ms (-0.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.37.0-SNAPSHOT~396e5bd119, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.465 ms) : 1453, 1476
.   : milestone, 1465,
appsec (2.213 ms) : 2179, 2248
.   : milestone, 2213,
iast (1.957 ms) : 1917, 1998
.   : milestone, 1957,
iast_GLOBAL (2.017 ms) : 1975, 2058
.   : milestone, 2017,
profiling (1.859 ms) : 1824, 1894
.   : milestone, 1859,
tracing (1.834 ms) : 1801, 1867
.   : milestone, 1834,
section candidate
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (2.213 ms) : 2179, 2248
.   : milestone, 2213,
iast (1.968 ms) : 1927, 2009
.   : milestone, 1968,
iast_GLOBAL (2.01 ms) : 1969, 2051
.   : milestone, 2010,
profiling (1.846 ms) : 1814, 1879
.   : milestone, 1846,
tracing (1.834 ms) : 1801, 1866
.   : milestone, 1834,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.453 ms, 1.476 ms] -
appsec 2.213 ms [2.179 ms, 2.248 ms] 748.619 µs (51.1%)
iast 1.957 ms [1.917 ms, 1.998 ms] 492.753 µs (33.6%)
iast_GLOBAL 2.017 ms [1.975 ms, 2.058 ms] 551.916 µs (37.7%)
profiling 1.859 ms [1.824 ms, 1.894 ms] 394.172 µs (26.9%)
tracing 1.834 ms [1.801 ms, 1.867 ms] 369.619 µs (25.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 2.213 ms [2.179 ms, 2.248 ms] 746.714 µs (50.9%)
iast 1.968 ms [1.927 ms, 2.009 ms] 501.305 µs (34.2%)
iast_GLOBAL 2.01 ms [1.969 ms, 2.051 ms] 543.388 µs (37.1%)
profiling 1.846 ms [1.814 ms, 1.879 ms] 379.875 µs (25.9%)
tracing 1.834 ms [1.801 ms, 1.866 ms] 367.155 µs (25.0%)

@smola smola marked this pull request as ready for review July 1, 2024 07:54
@smola smola requested review from a team as code owners July 1, 2024 07:54
@smola smola merged commit 302ed7c into master Jul 1, 2024
84 checks passed
@smola smola deleted the smola/smoke-tests-default-trace-protocol branch July 1, 2024 08:40
@PerfectSlayer PerfectSlayer added this to the 1.37.0 milestone Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jandro996 jandro996 jandro996 approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/asm-java

@ValentinZakharov ValentinZakharov Awaiting requested review from ValentinZakharov ValentinZakharov is a code owner automatically assigned from DataDog/asm-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.37.0
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@smola @jandro996 @PerfectSlayer