Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add /info and /telemetry endpoints to smoke tests agent #7257

Merged
merged 2 commits into from
Jul 1, 2024
Merged

Add /info and /telemetry endpoints to smoke tests agent #7257

merged 2 commits into from
Jul 1, 2024

Conversation

smola
Copy link
Member

@smola smola commented Jun 28, 2024

What Does This Do

  • Add /info and /telemetry endpoints to the test agent used in smoke tests.

Motivation

  • Make it closer to a real agent.
  • Avoid logs noise from telemetry errors.
  • Avoid unnecessary probing for feature discovery, stressing the most usual path with real agent, and reducing noise in logs and debugging.

Additional Notes

Possible future work:

  • Intercept telemetry messages, this would enable better smoke tests for telemetry.
  • Make /info responses configurable to test different scenarios.

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jun 28, 2024
@smola smola changed the title Smola/smoke tests agent Add /info and /telemetry endpoints to smoke tests agent Jun 28, 2024
@smola smola marked this pull request as ready for review June 28, 2024 15:38
@smola smola requested a review from a team as a code owner June 28, 2024 15:38
@smola smola requested review from mcculls and am312 June 28, 2024 15:38
@pr-commenter
Copy link

pr-commenter bot commented Jun 28, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/smoke-tests-agent
git_commit_date 1719587548 1719587537
git_commit_sha 11753ca d8f6da6
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~d8f6da6df0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719590743 1719590743
ci_job_id 556672437 556672437
ci_pipeline_id 37865824 37865824
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 17 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070241
Total [baseline] (10.346 s) : 0, 10346085
Agent [candidate] (1.072 s) : 0, 1072036
Total [candidate] (10.403 s) : 0, 10403213
section appsec
Agent [baseline] (1.188 s) : 0, 1187874
Total [baseline] (10.515 s) : 0, 10515346
Agent [candidate] (1.187 s) : 0, 1187243
Total [candidate] (10.513 s) : 0, 10513088
section iast
Agent [baseline] (1.197 s) : 0, 1196500
Total [baseline] (10.811 s) : 0, 10810862
Agent [candidate] (1.171 s) : 0, 1171098
Total [candidate] (10.71 s) : 0, 10709797
section profiling
Agent [baseline] (1.265 s) : 0, 1265170
Total [baseline] (10.625 s) : 0, 10624661
Agent [candidate] (1.272 s) : 0, 1272368
Total [candidate] (10.599 s) : 0, 10599165
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.188 s 117.633 ms (11.0%)
Agent iast 1.197 s 126.259 ms (11.8%)
Agent profiling 1.265 s 194.93 ms (18.2%)
Total tracing 10.346 s -
Total appsec 10.515 s 169.26 ms (1.6%)
Total iast 10.811 s 464.777 ms (4.5%)
Total profiling 10.625 s 278.576 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.187 s 115.207 ms (10.7%)
Agent iast 1.171 s 99.062 ms (9.2%)
Agent profiling 1.272 s 200.332 ms (18.7%)
Total tracing 10.403 s -
Total appsec 10.513 s 109.875 ms (1.1%)
Total iast 10.71 s 306.584 ms (2.9%)
Total profiling 10.599 s 195.952 ms (1.9%) 
gantt
    title petclinic - break down per module: candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.032 ms) : 0, 670032
BytebuddyAgent [candidate] (671.022 ms) : 0, 671022
GlobalTracer [baseline] (306.315 ms) : 0, 306315
GlobalTracer [candidate] (306.865 ms) : 0, 306865
AppSec [baseline] (50.589 ms) : 0, 50589
AppSec [candidate] (50.834 ms) : 0, 50834
Remote Config [baseline] (756.623 µs) : 0, 757
Remote Config [candidate] (731.721 µs) : 0, 732
Telemetry [baseline] (7.866 ms) : 0, 7866
Telemetry [candidate] (7.72 ms) : 0, 7720
section appsec
BytebuddyAgent [baseline] (678.012 ms) : 0, 678012
BytebuddyAgent [candidate] (678.504 ms) : 0, 678504
GlobalTracer [baseline] (299.899 ms) : 0, 299899
GlobalTracer [candidate] (300.555 ms) : 0, 300555
AppSec [baseline] (154.723 ms) : 0, 154723
AppSec [candidate] (154.521 ms) : 0, 154521
IAST [baseline] (21.658 ms) : 0, 21658
IAST [candidate] (21.679 ms) : 0, 21679
Remote Config [baseline] (633.76 µs) : 0, 634
Remote Config [candidate] (634.161 µs) : 0, 634
Telemetry [baseline] (9.113 ms) : 0, 9113
Telemetry [candidate] (7.483 ms) : 0, 7483
section iast
BytebuddyAgent [baseline] (796.78 ms) : 0, 796780
BytebuddyAgent [candidate] (780.161 ms) : 0, 780161
GlobalTracer [baseline] (301.573 ms) : 0, 301573
GlobalTracer [candidate] (294.286 ms) : 0, 294286
AppSec [baseline] (48.49 ms) : 0, 48490
AppSec [candidate] (47.485 ms) : 0, 47485
IAST [baseline] (28.147 ms) : 0, 28147
IAST [candidate] (27.315 ms) : 0, 27315
Remote Config [baseline] (611.786 µs) : 0, 612
Remote Config [candidate] (618.214 µs) : 0, 618
Telemetry [baseline] (7.203 ms) : 0, 7203
Telemetry [candidate] (7.775 ms) : 0, 7775
section profiling
BytebuddyAgent [baseline] (663.69 ms) : 0, 663690
BytebuddyAgent [candidate] (667.151 ms) : 0, 667151
GlobalTracer [baseline] (387.779 ms) : 0, 387779
GlobalTracer [candidate] (390.136 ms) : 0, 390136
AppSec [baseline] (51.911 ms) : 0, 51911
AppSec [candidate] (52.279 ms) : 0, 52279
Remote Config [baseline] (653.561 µs) : 0, 654
Remote Config [candidate] (653.418 µs) : 0, 653
Telemetry [baseline] (7.41 ms) : 0, 7410
Telemetry [candidate] (7.423 ms) : 0, 7423
ProfilingAgent [baseline] (96.73 ms) : 0, 96730
ProfilingAgent [candidate] (97.323 ms) : 0, 97323
Profiling [baseline] (96.754 ms) : 0, 96754
Profiling [candidate] (97.348 ms) : 0, 97348
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064027
Total [baseline] (8.547 s) : 0, 8547265
Agent [candidate] (1.062 s) : 0, 1062432
Total [candidate] (8.562 s) : 0, 8561668
section iast
Agent [baseline] (1.186 s) : 0, 1186430
Total [baseline] (9.024 s) : 0, 9024273
Agent [candidate] (1.171 s) : 0, 1171252
Total [candidate] (8.991 s) : 0, 8991098
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1179948
Total [baseline] (9.025 s) : 0, 9024557
Agent [candidate] (1.195 s) : 0, 1194996
Total [candidate] (9.09 s) : 0, 9090175
section iast_TELEMETRY_OFF
Agent [baseline] (1.176 s) : 0, 1175903
Total [baseline] (8.994 s) : 0, 8994193
Agent [candidate] (1.175 s) : 0, 1175167
Total [candidate] (8.993 s) : 0, 8993065
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.186 s 122.403 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 115.92 ms (10.9%)
Agent iast_TELEMETRY_OFF 1.176 s 111.875 ms (10.5%)
Total tracing 8.547 s -
Total iast 9.024 s 477.008 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.025 s 477.292 ms (5.6%)
Total iast_TELEMETRY_OFF 8.994 s 446.929 ms (5.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.171 s 108.82 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 132.564 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.175 s 112.735 ms (10.6%)
Total tracing 8.562 s -
Total iast 8.991 s 429.429 ms (5.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.09 s 528.506 ms (6.2%)
Total iast_TELEMETRY_OFF 8.993 s 431.396 ms (5.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.8 ms) : 0, 665800
BytebuddyAgent [candidate] (664.921 ms) : 0, 664921
GlobalTracer [baseline] (304.833 ms) : 0, 304833
GlobalTracer [candidate] (304.454 ms) : 0, 304454
AppSec [baseline] (50.332 ms) : 0, 50332
AppSec [candidate] (50.278 ms) : 0, 50278
Remote Config [baseline] (766.832 µs) : 0, 767
Remote Config [candidate] (711.809 µs) : 0, 712
Telemetry [baseline] (7.632 ms) : 0, 7632
Telemetry [candidate] (7.693 ms) : 0, 7693
section iast
BytebuddyAgent [baseline] (790.343 ms) : 0, 790343
BytebuddyAgent [candidate] (779.737 ms) : 0, 779737
GlobalTracer [baseline] (297.903 ms) : 0, 297903
GlobalTracer [candidate] (294.685 ms) : 0, 294685
AppSec [baseline] (47.942 ms) : 0, 47942
AppSec [candidate] (47.369 ms) : 0, 47369
IAST [baseline] (28.257 ms) : 0, 28257
IAST [candidate] (28.598 ms) : 0, 28598
Remote Config [baseline] (601.864 µs) : 0, 602
Remote Config [candidate] (576.467 µs) : 0, 576
Telemetry [baseline] (7.805 ms) : 0, 7805
Telemetry [candidate] (6.866 ms) : 0, 6866
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.004 ms) : 0, 786004
BytebuddyAgent [candidate] (795.972 ms) : 0, 795972
GlobalTracer [baseline] (296.003 ms) : 0, 296003
GlobalTracer [candidate] (300.386 ms) : 0, 300386
AppSec [baseline] (47.721 ms) : 0, 47721
AppSec [candidate] (48.215 ms) : 0, 48215
IAST [baseline] (29.047 ms) : 0, 29047
IAST [candidate] (28.336 ms) : 0, 28336
Remote Config [baseline] (612.546 µs) : 0, 613
Remote Config [candidate] (588.3 µs) : 0, 588
Telemetry [baseline] (7.035 ms) : 0, 7035
Telemetry [candidate] (7.784 ms) : 0, 7784
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (782.378 ms) : 0, 782378
BytebuddyAgent [candidate] (783.629 ms) : 0, 783629
GlobalTracer [baseline] (296.455 ms) : 0, 296455
GlobalTracer [candidate] (296.492 ms) : 0, 296492
AppSec [baseline] (47.637 ms) : 0, 47637
AppSec [candidate] (47.293 ms) : 0, 47293
IAST [baseline] (25.448 ms) : 0, 25448
IAST [candidate] (26.019 ms) : 0, 26019
Remote Config [baseline] (600.327 µs) : 0, 600
Remote Config [candidate] (581.93 µs) : 0, 582
Telemetry [baseline] (9.869 ms) : 0, 9869
Telemetry [candidate] (7.611 ms) : 0, 7611
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-28T15:34:42 2024-06-28T15:41:30
git_branch master smola/smoke-tests-agent
git_commit_date 1719587548 1719587537
git_commit_sha 11753ca d8f6da6
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~d8f6da6df0
start_time 2024-06-28T15:34:29 2024-06-28T15:41:17
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719589636 1719589636
ci_job_id 556672439 556672439
ci_pipeline_id 37865824 37865824
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (367.142 µs) : 348, 387
.   : milestone, 367,
iast (480.224 µs) : 459, 502
.   : milestone, 480,
iast_FULL (553.191 µs) : 532, 574
.   : milestone, 553,
iast_GLOBAL (508.795 µs) : 488, 529
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (481.941 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (455.882 µs) : 435, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (471.292 µs) : 450, 492
.   : milestone, 471,
tracing (444.929 µs) : 424, 466
.   : milestone, 445,
section candidate
no_agent (369.335 µs) : 350, 389
.   : milestone, 369,
iast (477.079 µs) : 456, 498
.   : milestone, 477,
iast_FULL (551.329 µs) : 530, 573
.   : milestone, 551,
iast_GLOBAL (518.145 µs) : 495, 542
.   : milestone, 518,
iast_HARDCODED_SECRET_DISABLED (479.118 µs) : 458, 500
.   : milestone, 479,
iast_INACTIVE (460.221 µs) : 439, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (473.922 µs) : 452, 496
.   : milestone, 474,
tracing (438.224 µs) : 418, 459
.   : milestone, 438,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.142 µs [347.514 µs, 386.77 µs] -
iast 480.224 µs [458.935 µs, 501.512 µs] 113.082 µs (30.8%)
iast_FULL 553.191 µs [532.171 µs, 574.21 µs] 186.049 µs (50.7%)
iast_GLOBAL 508.795 µs [488.188 µs, 529.402 µs] 141.653 µs (38.6%)
iast_HARDCODED_SECRET_DISABLED 481.941 µs [460.994 µs, 502.888 µs] 114.799 µs (31.3%)
iast_INACTIVE 455.882 µs [434.639 µs, 477.125 µs] 88.74 µs (24.2%)
iast_TELEMETRY_OFF 471.292 µs [450.179 µs, 492.406 µs] 104.151 µs (28.4%)
tracing 444.929 µs [424.315 µs, 465.542 µs] 77.787 µs (21.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.335 µs [349.533 µs, 389.137 µs] -
iast 477.079 µs [456.033 µs, 498.125 µs] 107.744 µs (29.2%)
iast_FULL 551.329 µs [530.097 µs, 572.56 µs] 181.994 µs (49.3%)
iast_GLOBAL 518.145 µs [494.548 µs, 541.742 µs] 148.81 µs (40.3%)
iast_HARDCODED_SECRET_DISABLED 479.118 µs [457.887 µs, 500.349 µs] 109.783 µs (29.7%)
iast_INACTIVE 460.221 µs [438.759 µs, 481.684 µs] 90.887 µs (24.6%)
iast_TELEMETRY_OFF 473.922 µs [452.087 µs, 495.757 µs] 104.587 µs (28.3%)
tracing 438.224 µs [417.505 µs, 458.943 µs] 68.89 µs (18.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.342 ms) : 1321, 1362
.   : milestone, 1342,
appsec (1.72 ms) : 1695, 1744
.   : milestone, 1720,
appsec_no_iast (1.702 ms) : 1677, 1727
.   : milestone, 1702,
iast (1.462 ms) : 1439, 1485
.   : milestone, 1462,
profiling (1.475 ms) : 1450, 1500
.   : milestone, 1475,
tracing (1.459 ms) : 1434, 1484
.   : milestone, 1459,
section candidate
no_agent (1.358 ms) : 1338, 1377
.   : milestone, 1358,
appsec (1.723 ms) : 1697, 1749
.   : milestone, 1723,
appsec_no_iast (1.711 ms) : 1686, 1737
.   : milestone, 1711,
iast (1.484 ms) : 1461, 1506
.   : milestone, 1484,
profiling (1.509 ms) : 1483, 1535
.   : milestone, 1509,
tracing (1.474 ms) : 1449, 1499
.   : milestone, 1474,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.321 ms, 1.362 ms] -
appsec 1.72 ms [1.695 ms, 1.744 ms] 377.687 µs (28.1%)
appsec_no_iast 1.702 ms [1.677 ms, 1.727 ms] 360.123 µs (26.8%)
iast 1.462 ms [1.439 ms, 1.485 ms] 120.01 µs (8.9%)
profiling 1.475 ms [1.45 ms, 1.5 ms] 133.508 µs (9.9%)
tracing 1.459 ms [1.434 ms, 1.484 ms] 116.897 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.338 ms, 1.377 ms] -
appsec 1.723 ms [1.697 ms, 1.749 ms] 365.27 µs (26.9%)
appsec_no_iast 1.711 ms [1.686 ms, 1.737 ms] 353.574 µs (26.0%)
iast 1.484 ms [1.461 ms, 1.506 ms] 125.801 µs (9.3%)
profiling 1.509 ms [1.483 ms, 1.535 ms] 151.323 µs (11.1%)
tracing 1.474 ms [1.449 ms, 1.499 ms] 116.235 µs (8.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/smoke-tests-agent
git_commit_date 1719587548 1719587537
git_commit_sha 11753ca d8f6da6
release_version 1.37.0-SNAPSHOT~11753cac4d 1.37.0-SNAPSHOT~d8f6da6df0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1719590157 1719590157
ci_job_id 556672441 556672441
ci_pipeline_id 37865824 37865824
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.436 s) : 15436000, 15436000
.   : milestone, 15436000,
appsec (15.104 s) : 15104000, 15104000
.   : milestone, 15104000,
iast (18.942 s) : 18942000, 18942000
.   : milestone, 18942000,
iast_GLOBAL (18.115 s) : 18115000, 18115000
.   : milestone, 18115000,
profiling (15.681 s) : 15681000, 15681000
.   : milestone, 15681000,
tracing (15.172 s) : 15172000, 15172000
.   : milestone, 15172000,
section candidate
no_agent (15.486 s) : 15486000, 15486000
.   : milestone, 15486000,
appsec (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
iast (18.682 s) : 18682000, 18682000
.   : milestone, 18682000,
iast_GLOBAL (18.143 s) : 18143000, 18143000
.   : milestone, 18143000,
profiling (15.257 s) : 15257000, 15257000
.   : milestone, 15257000,
tracing (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.436 s [15.436 s, 15.436 s] -
appsec 15.104 s [15.104 s, 15.104 s] -332.0 ms (-2.2%)
iast 18.942 s [18.942 s, 18.942 s] 3.506 s (22.7%)
iast_GLOBAL 18.115 s [18.115 s, 18.115 s] 2.679 s (17.4%)
profiling 15.681 s [15.681 s, 15.681 s] 245.0 ms (1.6%)
tracing 15.172 s [15.172 s, 15.172 s] -264.0 ms (-1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.486 s [15.486 s, 15.486 s] -
appsec 15.005 s [15.005 s, 15.005 s] -481.0 ms (-3.1%)
iast 18.682 s [18.682 s, 18.682 s] 3.196 s (20.6%)
iast_GLOBAL 18.143 s [18.143 s, 18.143 s] 2.657 s (17.2%)
profiling 15.257 s [15.257 s, 15.257 s] -229.0 ms (-1.5%)
tracing 14.968 s [14.968 s, 14.968 s] -518.0 ms (-3.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.37.0-SNAPSHOT~d8f6da6df0, baseline=1.37.0-SNAPSHOT~11753cac4d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1451, 1473
.   : milestone, 1462,
appsec (2.216 ms) : 2182, 2250
.   : milestone, 2216,
iast (1.97 ms) : 1928, 2011
.   : milestone, 1970,
iast_GLOBAL (2.015 ms) : 1974, 2057
.   : milestone, 2015,
profiling (1.858 ms) : 1825, 1891
.   : milestone, 1858,
tracing (1.831 ms) : 1799, 1864
.   : milestone, 1831,
section candidate
no_agent (1.464 ms) : 1453, 1475
.   : milestone, 1464,
appsec (2.211 ms) : 2177, 2245
.   : milestone, 2211,
iast (1.974 ms) : 1933, 2016
.   : milestone, 1974,
iast_GLOBAL (1.994 ms) : 1953, 2036
.   : milestone, 1994,
profiling (1.857 ms) : 1822, 1892
.   : milestone, 1857,
tracing (1.836 ms) : 1803, 1868
.   : milestone, 1836,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.473 ms] -
appsec 2.216 ms [2.182 ms, 2.25 ms] 754.02 µs (51.6%)
iast 1.97 ms [1.928 ms, 2.011 ms] 507.807 µs (34.7%)
iast_GLOBAL 2.015 ms [1.974 ms, 2.057 ms] 553.157 µs (37.8%)
profiling 1.858 ms [1.825 ms, 1.891 ms] 395.99 µs (27.1%)
tracing 1.831 ms [1.799 ms, 1.864 ms] 369.258 µs (25.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.475 ms] -
appsec 2.211 ms [2.177 ms, 2.245 ms] 747.284 µs (51.0%)
iast 1.974 ms [1.933 ms, 2.016 ms] 510.137 µs (34.8%)
iast_GLOBAL 1.994 ms [1.953 ms, 2.036 ms] 530.18 µs (36.2%)
profiling 1.857 ms [1.822 ms, 1.892 ms] 393.06 µs (26.8%)
tracing 1.836 ms [1.803 ms, 1.868 ms] 371.601 µs (25.4%)

@smola smola merged commit b6ba5f6 into master Jul 1, 2024
84 checks passed
@smola smola deleted the smola/smoke-tests-agent branch July 1, 2024 08:37
@PerfectSlayer PerfectSlayer added this to the 1.37.0 milestone Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mcculls mcculls mcculls approved these changes

@am312 am312 Awaiting requested review from am312 am312 is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.37.0
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@smola @mcculls @PerfectSlayer