Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rename Dynamic Instrumentation system tests run name #7233

Merged
merged 1 commit into from
Jun 24, 2024
Merged

Rename Dynamic Instrumentation system tests run name #7233

merged 1 commit into from
Jun 24, 2024

Conversation

shurivich
Copy link
Contributor

What Does This Do

Rename run from Run APM Integrations tests to Run Dynamic Instrumentation system tests

@shurivich shurivich added the comp: debugger Dynamic Instrumentation label Jun 23, 2024
@shurivich shurivich self-assigned this Jun 23, 2024
@shurivich shurivich requested a review from a team as a code owner June 23, 2024 07:14
@shurivich shurivich changed the title [Dynamic Instrumentation] Rename run name [Dynamic Instrumentation] Rename system tests run name Jun 23, 2024
@pr-commenter
Copy link

pr-commenter bot commented Jun 23, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master shurivich/mark_debugger_tests
git_commit_date 1718966972 1719126193
git_commit_sha 901334b 2348748
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~234874885d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719129235 1719129235
ci_job_id 551147127 551147127
ci_pipeline_id 37380168 37380168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060439
Total [baseline] (8.519 s) : 0, 8519265
Agent [candidate] (1.061 s) : 0, 1060868
Total [candidate] (8.549 s) : 0, 8548888
section iast
Agent [baseline] (1.178 s) : 0, 1177766
Total [baseline] (8.995 s) : 0, 8995067
Agent [candidate] (1.17 s) : 0, 1169581
Total [candidate] (9.019 s) : 0, 9018767
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.176 s) : 0, 1176458
Total [baseline] (9.034 s) : 0, 9033750
Agent [candidate] (1.17 s) : 0, 1169640
Total [candidate] (8.998 s) : 0, 8997869
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174237
Total [baseline] (9.021 s) : 0, 9020591
Agent [candidate] (1.174 s) : 0, 1173662
Total [candidate] (9.032 s) : 0, 9032230
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.178 s 117.327 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.176 s 116.019 ms (10.9%)
Agent iast_TELEMETRY_OFF 1.174 s 113.797 ms (10.7%)
Total tracing 8.519 s -
Total iast 8.995 s 475.802 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.034 s 514.486 ms (6.0%)
Total iast_TELEMETRY_OFF 9.021 s 501.326 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.17 s 108.712 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.17 s 108.771 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.174 s 112.794 ms (10.6%)
Total tracing 8.549 s -
Total iast 9.019 s 469.878 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 8.998 s 448.981 ms (5.3%)
Total iast_TELEMETRY_OFF 9.032 s 483.342 ms (5.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.47 ms) : 0, 664470
BytebuddyAgent [candidate] (664.702 ms) : 0, 664702
GlobalTracer [baseline] (303.314 ms) : 0, 303314
GlobalTracer [candidate] (303.386 ms) : 0, 303386
AppSec [baseline] (50.125 ms) : 0, 50125
AppSec [candidate] (50.238 ms) : 0, 50238
Remote Config [baseline] (687.709 µs) : 0, 688
Remote Config [candidate] (686.548 µs) : 0, 687
Telemetry [baseline] (7.589 ms) : 0, 7589
Telemetry [candidate] (7.54 ms) : 0, 7540
section iast
BytebuddyAgent [baseline] (785.67 ms) : 0, 785670
BytebuddyAgent [candidate] (780.11 ms) : 0, 780110
GlobalTracer [baseline] (294.959 ms) : 0, 294959
GlobalTracer [candidate] (292.545 ms) : 0, 292545
AppSec [baseline] (47.389 ms) : 0, 47389
AppSec [candidate] (47.059 ms) : 0, 47059
IAST [baseline] (28.152 ms) : 0, 28152
IAST [candidate] (28.158 ms) : 0, 28158
Remote Config [baseline] (595.077 µs) : 0, 595
Remote Config [candidate] (634.634 µs) : 0, 635
Telemetry [baseline] (7.638 ms) : 0, 7638
Telemetry [candidate] (7.763 ms) : 0, 7763
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (783.995 ms) : 0, 783995
BytebuddyAgent [candidate] (779.1 ms) : 0, 779100
GlobalTracer [baseline] (295.141 ms) : 0, 295141
GlobalTracer [candidate] (293.38 ms) : 0, 293380
AppSec [baseline] (47.642 ms) : 0, 47642
AppSec [candidate] (47.267 ms) : 0, 47267
IAST [baseline] (28.575 ms) : 0, 28575
IAST [candidate] (28.953 ms) : 0, 28953
Remote Config [baseline] (641.528 µs) : 0, 642
Remote Config [candidate] (659.311 µs) : 0, 659
Telemetry [baseline] (7.027 ms) : 0, 7027
Telemetry [candidate] (6.943 ms) : 0, 6943
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (783.171 ms) : 0, 783171
BytebuddyAgent [candidate] (782.89 ms) : 0, 782890
GlobalTracer [baseline] (295.105 ms) : 0, 295105
GlobalTracer [candidate] (294.7 ms) : 0, 294700
AppSec [baseline] (47.371 ms) : 0, 47371
AppSec [candidate] (47.443 ms) : 0, 47443
IAST [baseline] (27.714 ms) : 0, 27714
IAST [candidate] (26.03 ms) : 0, 26030
Remote Config [baseline] (586.015 µs) : 0, 586
Remote Config [candidate] (607.392 µs) : 0, 607
Telemetry [baseline] (6.844 ms) : 0, 6844
Telemetry [candidate] (8.538 ms) : 0, 8538
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062288
Total [baseline] (10.268 s) : 0, 10268056
Agent [candidate] (1.063 s) : 0, 1063016
Total [candidate] (10.347 s) : 0, 10346755
section appsec
Agent [baseline] (1.184 s) : 0, 1184340
Total [baseline] (10.445 s) : 0, 10445383
Agent [candidate] (1.183 s) : 0, 1182606
Total [candidate] (10.462 s) : 0, 10461934
section iast
Agent [baseline] (1.168 s) : 0, 1167647
Total [baseline] (10.658 s) : 0, 10657623
Agent [candidate] (1.181 s) : 0, 1181290
Total [candidate] (10.707 s) : 0, 10706550
section profiling
Agent [baseline] (1.278 s) : 0, 1278473
Total [baseline] (10.646 s) : 0, 10645854
Agent [candidate] (1.262 s) : 0, 1262108
Total [candidate] (10.66 s) : 0, 10660400
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.184 s 122.052 ms (11.5%)
Agent iast 1.168 s 105.359 ms (9.9%)
Agent profiling 1.278 s 216.185 ms (20.4%)
Total tracing 10.268 s -
Total appsec 10.445 s 177.327 ms (1.7%)
Total iast 10.658 s 389.567 ms (3.8%)
Total profiling 10.646 s 377.798 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.183 s 119.59 ms (11.3%)
Agent iast 1.181 s 118.274 ms (11.1%)
Agent profiling 1.262 s 199.092 ms (18.7%)
Total tracing 10.347 s -
Total appsec 10.462 s 115.179 ms (1.1%)
Total iast 10.707 s 359.796 ms (3.5%)
Total profiling 10.66 s 313.646 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.158 ms) : 0, 666158
BytebuddyAgent [candidate] (665.895 ms) : 0, 665895
GlobalTracer [baseline] (303.398 ms) : 0, 303398
GlobalTracer [candidate] (304.119 ms) : 0, 304119
AppSec [baseline] (50.048 ms) : 0, 50048
AppSec [candidate] (50.178 ms) : 0, 50178
Remote Config [baseline] (678.843 µs) : 0, 679
Remote Config [candidate] (684.59 µs) : 0, 685
Telemetry [baseline] (7.516 ms) : 0, 7516
Telemetry [candidate] (7.604 ms) : 0, 7604
section appsec
BytebuddyAgent [baseline] (677.971 ms) : 0, 677971
BytebuddyAgent [candidate] (676.851 ms) : 0, 676851
GlobalTracer [baseline] (297.799 ms) : 0, 297799
GlobalTracer [candidate] (297.38 ms) : 0, 297380
AppSec [baseline] (153.894 ms) : 0, 153894
AppSec [candidate] (154.141 ms) : 0, 154141
Remote Config [baseline] (638.765 µs) : 0, 639
Remote Config [candidate] (639.668 µs) : 0, 640
Telemetry [baseline] (8.42 ms) : 0, 8420
Telemetry [candidate] (8.861 ms) : 0, 8861
IAST [baseline] (22.174 ms) : 0, 22174
IAST [candidate] (20.607 ms) : 0, 20607
section iast
BytebuddyAgent [baseline] (778.94 ms) : 0, 778940
BytebuddyAgent [candidate] (785.894 ms) : 0, 785894
GlobalTracer [baseline] (292.926 ms) : 0, 292926
GlobalTracer [candidate] (297.608 ms) : 0, 297608
AppSec [baseline] (46.976 ms) : 0, 46976
AppSec [candidate] (48.068 ms) : 0, 48068
Remote Config [baseline] (615.498 µs) : 0, 615
Remote Config [candidate] (651.08 µs) : 0, 651
Telemetry [baseline] (6.917 ms) : 0, 6917
Telemetry [candidate] (7.056 ms) : 0, 7056
IAST [baseline] (27.967 ms) : 0, 27967
IAST [candidate] (28.597 ms) : 0, 28597
section profiling
ProfilingAgent [baseline] (97.234 ms) : 0, 97234
ProfilingAgent [candidate] (96.266 ms) : 0, 96266
BytebuddyAgent [baseline] (673.321 ms) : 0, 673321
BytebuddyAgent [candidate] (663.225 ms) : 0, 663225
GlobalTracer [baseline] (390.061 ms) : 0, 390061
GlobalTracer [candidate] (385.716 ms) : 0, 385716
AppSec [baseline] (51.804 ms) : 0, 51804
AppSec [candidate] (51.663 ms) : 0, 51663
Remote Config [baseline] (754.278 µs) : 0, 754
Remote Config [candidate] (759.857 µs) : 0, 760
Telemetry [baseline] (7.473 ms) : 0, 7473
Telemetry [candidate] (7.414 ms) : 0, 7414
Profiling [baseline] (97.258 ms) : 0, 97258
Profiling [candidate] (96.291 ms) : 0, 96291
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-23T07:24:47 2024-06-23T07:31:37
git_branch master shurivich/mark_debugger_tests
git_commit_date 1718966972 1719126193
git_commit_sha 901334b 2348748
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~234874885d
start_time 2024-06-23T07:24:34 2024-06-23T07:31:24
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719128241 1719128241
ci_job_id 551147128 551147128
ci_pipeline_id 37380168 37380168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.167 µs) : 353, 392
.   : milestone, 372,
iast (482.104 µs) : 461, 503
.   : milestone, 482,
iast_FULL (554.513 µs) : 533, 576
.   : milestone, 555,
iast_GLOBAL (524.032 µs) : 501, 547
.   : milestone, 524,
iast_HARDCODED_SECRET_DISABLED (485.828 µs) : 464, 507
.   : milestone, 486,
iast_INACTIVE (454.832 µs) : 434, 476
.   : milestone, 455,
iast_TELEMETRY_OFF (473.927 µs) : 453, 495
.   : milestone, 474,
tracing (445.578 µs) : 425, 466
.   : milestone, 446,
section candidate
no_agent (373.014 µs) : 353, 393
.   : milestone, 373,
iast (484.491 µs) : 463, 506
.   : milestone, 484,
iast_FULL (549.9 µs) : 529, 571
.   : milestone, 550,
iast_GLOBAL (508.628 µs) : 487, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (483.168 µs) : 462, 505
.   : milestone, 483,
iast_INACTIVE (449.622 µs) : 429, 470
.   : milestone, 450,
iast_TELEMETRY_OFF (470.541 µs) : 450, 492
.   : milestone, 471,
tracing (446.424 µs) : 425, 467
.   : milestone, 446,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.167 µs [352.813 µs, 391.521 µs] -
iast 482.104 µs [460.879 µs, 503.329 µs] 109.937 µs (29.5%)
iast_FULL 554.513 µs [533.407 µs, 575.62 µs] 182.346 µs (49.0%)
iast_GLOBAL 524.032 µs [500.607 µs, 547.457 µs] 151.865 µs (40.8%)
iast_HARDCODED_SECRET_DISABLED 485.828 µs [464.432 µs, 507.224 µs] 113.662 µs (30.5%)
iast_INACTIVE 454.832 µs [433.847 µs, 475.817 µs] 82.665 µs (22.2%)
iast_TELEMETRY_OFF 473.927 µs [452.665 µs, 495.19 µs] 101.761 µs (27.3%)
tracing 445.578 µs [425.009 µs, 466.146 µs] 73.411 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.014 µs [353.47 µs, 392.558 µs] -
iast 484.491 µs [463.177 µs, 505.805 µs] 111.478 µs (29.9%)
iast_FULL 549.9 µs [528.876 µs, 570.923 µs] 176.886 µs (47.4%)
iast_GLOBAL 508.628 µs [486.679 µs, 530.577 µs] 135.614 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 483.168 µs [461.767 µs, 504.568 µs] 110.154 µs (29.5%)
iast_INACTIVE 449.622 µs [428.994 µs, 470.249 µs] 76.608 µs (20.5%)
iast_TELEMETRY_OFF 470.541 µs [449.519 µs, 491.563 µs] 97.527 µs (26.1%)
tracing 446.424 µs [425.455 µs, 467.393 µs] 73.411 µs (19.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.357 ms) : 1337, 1376
.   : milestone, 1357,
appsec (1.721 ms) : 1698, 1745
.   : milestone, 1721,
appsec_no_iast (1.713 ms) : 1688, 1737
.   : milestone, 1713,
iast (1.468 ms) : 1445, 1490
.   : milestone, 1468,
profiling (1.484 ms) : 1459, 1508
.   : milestone, 1484,
tracing (1.47 ms) : 1445, 1494
.   : milestone, 1470,
section candidate
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.718 ms) : 1693, 1743
.   : milestone, 1718,
appsec_no_iast (1.742 ms) : 1718, 1766
.   : milestone, 1742,
iast (1.475 ms) : 1453, 1498
.   : milestone, 1475,
profiling (1.496 ms) : 1471, 1521
.   : milestone, 1496,
tracing (1.446 ms) : 1421, 1470
.   : milestone, 1446,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.357 ms [1.337 ms, 1.376 ms] -
appsec 1.721 ms [1.698 ms, 1.745 ms] 364.253 µs (26.8%)
appsec_no_iast 1.713 ms [1.688 ms, 1.737 ms] 356.046 µs (26.2%)
iast 1.468 ms [1.445 ms, 1.49 ms] 110.726 µs (8.2%)
profiling 1.484 ms [1.459 ms, 1.508 ms] 126.691 µs (9.3%)
tracing 1.47 ms [1.445 ms, 1.494 ms] 112.645 µs (8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.365 ms] -
appsec 1.718 ms [1.693 ms, 1.743 ms] 372.349 µs (27.7%)
appsec_no_iast 1.742 ms [1.718 ms, 1.766 ms] 396.423 µs (29.5%)
iast 1.475 ms [1.453 ms, 1.498 ms] 130.14 µs (9.7%)
profiling 1.496 ms [1.471 ms, 1.521 ms] 150.514 µs (11.2%)
tracing 1.446 ms [1.421 ms, 1.47 ms] 100.19 µs (7.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master shurivich/mark_debugger_tests
git_commit_date 1718966972 1719126193
git_commit_sha 901334b 2348748
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~234874885d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1719128750 1719128750
ci_job_id 551147129 551147129
ci_pipeline_id 37380168 37380168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
appsec (15.052 s) : 15052000, 15052000
.   : milestone, 15052000,
iast (18.578 s) : 18578000, 18578000
.   : milestone, 18578000,
iast_GLOBAL (17.857 s) : 17857000, 17857000
.   : milestone, 17857000,
profiling (15.182 s) : 15182000, 15182000
.   : milestone, 15182000,
tracing (14.759 s) : 14759000, 14759000
.   : milestone, 14759000,
section candidate
no_agent (15.647 s) : 15647000, 15647000
.   : milestone, 15647000,
appsec (15.27 s) : 15270000, 15270000
.   : milestone, 15270000,
iast (18.459 s) : 18459000, 18459000
.   : milestone, 18459000,
iast_GLOBAL (17.833 s) : 17833000, 17833000
.   : milestone, 17833000,
profiling (15.127 s) : 15127000, 15127000
.   : milestone, 15127000,
tracing (14.877 s) : 14877000, 14877000
.   : milestone, 14877000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.065 s [15.065 s, 15.065 s] -
appsec 15.052 s [15.052 s, 15.052 s] -13.0 ms (-0.1%)
iast 18.578 s [18.578 s, 18.578 s] 3.513 s (23.3%)
iast_GLOBAL 17.857 s [17.857 s, 17.857 s] 2.792 s (18.5%)
profiling 15.182 s [15.182 s, 15.182 s] 117.0 ms (0.8%)
tracing 14.759 s [14.759 s, 14.759 s] -306.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.647 s [15.647 s, 15.647 s] -
appsec 15.27 s [15.27 s, 15.27 s] -377.0 ms (-2.4%)
iast 18.459 s [18.459 s, 18.459 s] 2.812 s (18.0%)
iast_GLOBAL 17.833 s [17.833 s, 17.833 s] 2.186 s (14.0%)
profiling 15.127 s [15.127 s, 15.127 s] -520.0 ms (-3.3%)
tracing 14.877 s [14.877 s, 14.877 s] -770.0 ms (-4.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~234874885d, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.458 ms) : 1446, 1469
.   : milestone, 1458,
appsec (2.198 ms) : 2164, 2232
.   : milestone, 2198,
iast (1.968 ms) : 1927, 2010
.   : milestone, 1968,
iast_GLOBAL (2.005 ms) : 1963, 2046
.   : milestone, 2005,
profiling (1.857 ms) : 1822, 1892
.   : milestone, 1857,
tracing (1.822 ms) : 1791, 1854
.   : milestone, 1822,
section candidate
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.201 ms) : 2167, 2235
.   : milestone, 2201,
iast (1.962 ms) : 1922, 2003
.   : milestone, 1962,
iast_GLOBAL (2.012 ms) : 1970, 2053
.   : milestone, 2012,
profiling (1.841 ms) : 1809, 1874
.   : milestone, 1841,
tracing (1.831 ms) : 1799, 1863
.   : milestone, 1831,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.458 ms [1.446 ms, 1.469 ms] -
appsec 2.198 ms [2.164 ms, 2.232 ms] 740.275 µs (50.8%)
iast 1.968 ms [1.927 ms, 2.01 ms] 510.772 µs (35.0%)
iast_GLOBAL 2.005 ms [1.963 ms, 2.046 ms] 547.12 µs (37.5%)
profiling 1.857 ms [1.822 ms, 1.892 ms] 399.576 µs (27.4%)
tracing 1.822 ms [1.791 ms, 1.854 ms] 364.814 µs (25.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.201 ms [2.167 ms, 2.235 ms] 738.719 µs (50.5%)
iast 1.962 ms [1.922 ms, 2.003 ms] 499.935 µs (34.2%)
iast_GLOBAL 2.012 ms [1.97 ms, 2.053 ms] 549.161 µs (37.6%)
profiling 1.841 ms [1.809 ms, 1.874 ms] 378.89 µs (25.9%)
tracing 1.831 ms [1.799 ms, 1.863 ms] 368.554 µs (25.2%)

PerfectSlayer
PerfectSlayer approved these changes Jun 24, 2024
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix!

@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 24, 2024
@PerfectSlayer PerfectSlayer changed the title [Dynamic Instrumentation] Rename system tests run name Rename Dynamic Instrumentation system tests run name Jun 24, 2024
@PerfectSlayer PerfectSlayer merged commit f0da9fb into master Jun 24, 2024
84 checks passed
@PerfectSlayer PerfectSlayer deleted the shurivich/mark_debugger_tests branch June 24, 2024 05:26
@github-actions github-actions bot added this to the 1.36.0 milestone Jun 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@am312 am312 Awaiting requested review from am312 am312 is a code owner automatically assigned from DataDog/apm-java

Assignees

@shurivich shurivich

Labels
comp: debugger Dynamic Instrumentation comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.36.0
Development

Successfully merging this pull request may close these issues.
2 participants
@shurivich @PerfectSlayer