Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix nightly deploys #7370

Merged
merged 4 commits into from
Jul 31, 2024
Merged

Fix nightly deploys #7370

merged 4 commits into from
Jul 31, 2024

Conversation

randomanderson
Copy link
Contributor

What Does This Do

Fixes the schedule deploy:

  • The previous SKIP_SHARED_PIPELINE: $POPULATE_CACHE variable assignment doesn't work. It needs to be done as a workflow rule
  • The macrobenchmarks and deploy_to_sonatype jobs depended on build which was not available during nightly jobs

Additionally:

  • I changed the nightly to run build in addition to build_with_cache so any dependency issues won't bork the build in the future

Motivation

The nightly deploy has been broken for months despite occasional efforts to fix it

Additional Notes

I tested this be creating a scheduled job with POPULATE_CACHE=true and ensuring everything works as expected

Contributor Checklist

@randomanderson randomanderson added type: bug tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 30, 2024
@randomanderson randomanderson requested a review from a team as a code owner July 30, 2024 17:54
@pr-commenter
Copy link

pr-commenter bot commented Jul 30, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/fix-nightly-deploy
git_commit_date 1722355686 1722372106
git_commit_sha 7028eaf 5cda1d1
release_version 1.38.0-SNAPSHOT~7028eafd9d 1.38.0-SNAPSHOT~5cda1d145d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722375240 1722375240
ci_job_id 589633009 589633009
ci_pipeline_id 40513622 40513622
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.552 s) : 0, 1551992
Total [baseline] (14.316 s) : 0, 14315569
Agent [candidate] (1.542 s) : 0, 1542448
Total [candidate] (14.223 s) : 0, 14222636
section appsec
Agent [baseline] (1.728 s) : 0, 1728429
Total [baseline] (14.386 s) : 0, 14385638
Agent [candidate] (1.728 s) : 0, 1728475
Total [candidate] (14.43 s) : 0, 14429548
section iast
Agent [baseline] (1.717 s) : 0, 1716750
Total [baseline] (14.83 s) : 0, 14829552
Agent [candidate] (1.717 s) : 0, 1717310
Total [candidate] (14.796 s) : 0, 14795746
section profiling
Agent [baseline] (1.862 s) : 0, 1861605
Total [baseline] (14.635 s) : 0, 14634919
Agent [candidate] (1.863 s) : 0, 1862943
Total [candidate] (14.53 s) : 0, 14530216
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.552 s -
Agent appsec 1.728 s 176.438 ms (11.4%)
Agent iast 1.717 s 164.759 ms (10.6%)
Agent profiling 1.862 s 309.614 ms (19.9%)
Total tracing 14.316 s -
Total appsec 14.386 s 70.07 ms (0.5%)
Total iast 14.83 s 513.983 ms (3.6%)
Total profiling 14.635 s 319.35 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.542 s -
Agent appsec 1.728 s 186.027 ms (12.1%)
Agent iast 1.717 s 174.862 ms (11.3%)
Agent profiling 1.863 s 320.495 ms (20.8%)
Total tracing 14.223 s -
Total appsec 14.43 s 206.912 ms (1.5%)
Total iast 14.796 s 573.11 ms (4.0%)
Total profiling 14.53 s 307.58 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (996.508 ms) : 0, 996508
BytebuddyAgent [candidate] (990.396 ms) : 0, 990396
GlobalTracer [baseline] (453.623 ms) : 0, 453623
GlobalTracer [candidate] (451.113 ms) : 0, 451113
AppSec [baseline] (71.054 ms) : 0, 71054
AppSec [candidate] (70.289 ms) : 0, 70289
Remote Config [baseline] (894.744 µs) : 0, 895
Remote Config [candidate] (866.093 µs) : 0, 866
Telemetry [baseline] (9.865 ms) : 0, 9865
Telemetry [candidate] (9.751 ms) : 0, 9751
section appsec
BytebuddyAgent [baseline] (1.007 s) : 0, 1006962
BytebuddyAgent [candidate] (1.007 s) : 0, 1006594
GlobalTracer [baseline] (445.232 ms) : 0, 445232
GlobalTracer [candidate] (445.848 ms) : 0, 445848
AppSec [baseline] (231.204 ms) : 0, 231204
AppSec [candidate] (231.464 ms) : 0, 231464
IAST [baseline] (27.67 ms) : 0, 27670
IAST [candidate] (25.737 ms) : 0, 25737
Remote Config [baseline] (784.355 µs) : 0, 784
Remote Config [candidate] (781.113 µs) : 0, 781
Telemetry [baseline] (10.424 ms) : 0, 10424
Telemetry [candidate] (10.81 ms) : 0, 10810
section iast
BytebuddyAgent [baseline] (1.151 s) : 0, 1151375
BytebuddyAgent [candidate] (1.153 s) : 0, 1152661
GlobalTracer [baseline] (434.26 ms) : 0, 434260
GlobalTracer [candidate] (433.726 ms) : 0, 433726
AppSec [baseline] (68.567 ms) : 0, 68567
AppSec [candidate] (70.006 ms) : 0, 70006
IAST [baseline] (31.735 ms) : 0, 31735
IAST [candidate] (30.922 ms) : 0, 30922
Remote Config [baseline] (729.885 µs) : 0, 730
Remote Config [candidate] (723.416 µs) : 0, 723
Telemetry [baseline] (10.057 ms) : 0, 10057
Telemetry [candidate] (9.186 ms) : 0, 9186
section profiling
BytebuddyAgent [baseline] (988.928 ms) : 0, 988928
BytebuddyAgent [candidate] (989.262 ms) : 0, 989262
GlobalTracer [baseline] (586.056 ms) : 0, 586056
GlobalTracer [candidate] (586.445 ms) : 0, 586445
AppSec [baseline] (72.133 ms) : 0, 72133
AppSec [candidate] (72.298 ms) : 0, 72298
Remote Config [baseline] (862.142 µs) : 0, 862
Remote Config [candidate] (868.78 µs) : 0, 869
Telemetry [baseline] (9.396 ms) : 0, 9396
Telemetry [candidate] (9.367 ms) : 0, 9367
ProfilingAgent [baseline] (149.26 ms) : 0, 149260
ProfilingAgent [candidate] (149.685 ms) : 0, 149685
Profiling [baseline] (149.335 ms) : 0, 149335
Profiling [candidate] (149.759 ms) : 0, 149759
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.548 s) : 0, 1547755
Total [baseline] (11.821 s) : 0, 11821076
Agent [candidate] (1.542 s) : 0, 1541689
Total [candidate] (11.795 s) : 0, 11795068
section iast
Agent [baseline] (1.713 s) : 0, 1713382
Total [baseline] (12.467 s) : 0, 12467273
Agent [candidate] (1.716 s) : 0, 1716251
Total [candidate] (12.479 s) : 0, 12479183
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.715 s) : 0, 1714852
Total [baseline] (12.42 s) : 0, 12419854
Agent [candidate] (1.715 s) : 0, 1715364
Total [candidate] (12.462 s) : 0, 12461774
section iast_TELEMETRY_OFF
Agent [baseline] (1.708 s) : 0, 1708107
Total [baseline] (12.461 s) : 0, 12460879
Agent [candidate] (1.71 s) : 0, 1710057
Total [candidate] (12.476 s) : 0, 12476240
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.548 s -
Agent iast 1.713 s 165.627 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.715 s 167.097 ms (10.8%)
Agent iast_TELEMETRY_OFF 1.708 s 160.352 ms (10.4%)
Total tracing 11.821 s -
Total iast 12.467 s 646.196 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 12.42 s 598.778 ms (5.1%)
Total iast_TELEMETRY_OFF 12.461 s 639.802 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.542 s -
Agent iast 1.716 s 174.562 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.715 s 173.675 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.71 s 168.368 ms (10.9%)
Total tracing 11.795 s -
Total iast 12.479 s 684.115 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 12.462 s 666.706 ms (5.7%)
Total iast_TELEMETRY_OFF 12.476 s 681.172 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (993.789 ms) : 0, 993789
BytebuddyAgent [candidate] (989.585 ms) : 0, 989585
GlobalTracer [baseline] (452.301 ms) : 0, 452301
GlobalTracer [candidate] (451.047 ms) : 0, 451047
AppSec [baseline] (70.956 ms) : 0, 70956
AppSec [candidate] (70.479 ms) : 0, 70479
Remote Config [baseline] (886.242 µs) : 0, 886
Remote Config [candidate] (880.487 µs) : 0, 880
Telemetry [baseline] (9.858 ms) : 0, 9858
Telemetry [candidate] (9.724 ms) : 0, 9724
section iast
BytebuddyAgent [baseline] (1.15 s) : 0, 1149789
BytebuddyAgent [candidate] (1.151 s) : 0, 1150961
GlobalTracer [baseline] (433.339 ms) : 0, 433339
GlobalTracer [candidate] (434.126 ms) : 0, 434126
AppSec [baseline] (71.341 ms) : 0, 71341
AppSec [candidate] (73.103 ms) : 0, 73103
IAST [baseline] (29.14 ms) : 0, 29140
IAST [candidate] (28.238 ms) : 0, 28238
Remote Config [baseline] (739.5 µs) : 0, 740
Remote Config [candidate] (724.732 µs) : 0, 725
Telemetry [baseline] (9.114 ms) : 0, 9114
Telemetry [candidate] (9.075 ms) : 0, 9075
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.151 s) : 0, 1151130
BytebuddyAgent [candidate] (1.15 s) : 0, 1149993
GlobalTracer [baseline] (434.182 ms) : 0, 434182
GlobalTracer [candidate] (434.793 ms) : 0, 434793
AppSec [baseline] (69.312 ms) : 0, 69312
AppSec [candidate] (71.812 ms) : 0, 71812
IAST [baseline] (29.408 ms) : 0, 29408
IAST [candidate] (28.586 ms) : 0, 28586
Remote Config [baseline] (768.253 µs) : 0, 768
Remote Config [candidate] (755.874 µs) : 0, 756
Telemetry [baseline] (9.982 ms) : 0, 9982
Telemetry [candidate] (9.24 ms) : 0, 9240
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.146 s) : 0, 1145985
BytebuddyAgent [candidate] (1.145 s) : 0, 1144848
GlobalTracer [baseline] (432.988 ms) : 0, 432988
GlobalTracer [candidate] (434.578 ms) : 0, 434578
AppSec [baseline] (66.85 ms) : 0, 66850
AppSec [candidate] (67.042 ms) : 0, 67042
IAST [baseline] (32.705 ms) : 0, 32705
IAST [candidate] (33.892 ms) : 0, 33892
Remote Config [baseline] (709.815 µs) : 0, 710
Remote Config [candidate] (720.73 µs) : 0, 721
Telemetry [baseline] (8.918 ms) : 0, 8918
Telemetry [candidate] (8.9 ms) : 0, 8900
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-07-30T20:52:15 2024-07-30T20:59:02
git_branch master landerson/fix-nightly-deploy
git_commit_date 1722355686 1722372106
git_commit_sha 7028eaf 5cda1d1
release_version 1.38.0-SNAPSHOT~7028eafd9d 1.38.0-SNAPSHOT~5cda1d145d
start_time 2024-07-30T20:52:02 2024-07-30T20:58:49
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722373487 1722373487
ci_job_id 589633010 589633010
ci_pipeline_id 40513622 40513622
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+35.843µs; +90.794µs] or [+2.419%; +6.127%]		 unstable
[-657.248op/s; +411.094op/s] or [-20.539%; +12.847%]		 1.545ms 3076.923op/s 1.482ms 3200.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.343 ms) : 1323, 1362
.   : milestone, 1343,
appsec (1.7 ms) : 1676, 1725
.   : milestone, 1700,
appsec_no_iast (1.708 ms) : 1684, 1732
.   : milestone, 1708,
iast (1.472 ms) : 1449, 1495
.   : milestone, 1472,
profiling (1.482 ms) : 1457, 1507
.   : milestone, 1482,
tracing (1.452 ms) : 1429, 1476
.   : milestone, 1452,
section candidate
no_agent (1.34 ms) : 1321, 1359
.   : milestone, 1340,
appsec (1.727 ms) : 1704, 1751
.   : milestone, 1727,
appsec_no_iast (1.726 ms) : 1702, 1750
.   : milestone, 1726,
iast (1.493 ms) : 1471, 1515
.   : milestone, 1493,
profiling (1.545 ms) : 1519, 1571
.   : milestone, 1545,
tracing (1.462 ms) : 1438, 1486
.   : milestone, 1462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.343 ms [1.323 ms, 1.362 ms] -
appsec 1.7 ms [1.676 ms, 1.725 ms] 357.759 µs (26.6%)
appsec_no_iast 1.708 ms [1.684 ms, 1.732 ms] 365.081 µs (27.2%)
iast 1.472 ms [1.449 ms, 1.495 ms] 129.198 µs (9.6%)
profiling 1.482 ms [1.457 ms, 1.507 ms] 139.247 µs (10.4%)
tracing 1.452 ms [1.429 ms, 1.476 ms] 109.84 µs (8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.34 ms [1.321 ms, 1.359 ms] -
appsec 1.727 ms [1.704 ms, 1.751 ms] 387.508 µs (28.9%)
appsec_no_iast 1.726 ms [1.702 ms, 1.75 ms] 386.518 µs (28.9%)
iast 1.493 ms [1.471 ms, 1.515 ms] 153.306 µs (11.4%)
profiling 1.545 ms [1.519 ms, 1.571 ms] 205.36 µs (15.3%)
tracing 1.462 ms [1.438 ms, 1.486 ms] 122.281 µs (9.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (360.845 µs) : 341, 380
.   : milestone, 361,
iast (482.914 µs) : 461, 505
.   : milestone, 483,
iast_FULL (547.5 µs) : 526, 569
.   : milestone, 548,
iast_GLOBAL (501.306 µs) : 480, 522
.   : milestone, 501,
iast_HARDCODED_SECRET_DISABLED (477.82 µs) : 457, 499
.   : milestone, 478,
iast_INACTIVE (448.288 µs) : 426, 470
.   : milestone, 448,
iast_TELEMETRY_OFF (473.271 µs) : 452, 494
.   : milestone, 473,
tracing (440.101 µs) : 414, 467
.   : milestone, 440,
section candidate
no_agent (359.899 µs) : 340, 379
.   : milestone, 360,
iast (475.458 µs) : 454, 496
.   : milestone, 475,
iast_FULL (548.223 µs) : 527, 569
.   : milestone, 548,
iast_GLOBAL (504.332 µs) : 483, 526
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (475.477 µs) : 455, 496
.   : milestone, 475,
iast_INACTIVE (447.981 µs) : 426, 470
.   : milestone, 448,
iast_TELEMETRY_OFF (469.459 µs) : 448, 490
.   : milestone, 469,
tracing (435.779 µs) : 415, 457
.   : milestone, 436,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 360.845 µs [341.291 µs, 380.4 µs] -
iast 482.914 µs [461.109 µs, 504.718 µs] 122.068 µs (33.8%)
iast_FULL 547.5 µs [526.449 µs, 568.551 µs] 186.655 µs (51.7%)
iast_GLOBAL 501.306 µs [480.224 µs, 522.389 µs] 140.461 µs (38.9%)
iast_HARDCODED_SECRET_DISABLED 477.82 µs [456.66 µs, 498.981 µs] 116.975 µs (32.4%)
iast_INACTIVE 448.288 µs [426.322 µs, 470.254 µs] 87.443 µs (24.2%)
iast_TELEMETRY_OFF 473.271 µs [452.261 µs, 494.282 µs] 112.426 µs (31.2%)
tracing 440.101 µs [413.575 µs, 466.628 µs] 79.256 µs (22.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 359.899 µs [340.345 µs, 379.453 µs] -
iast 475.458 µs [454.483 µs, 496.433 µs] 115.559 µs (32.1%)
iast_FULL 548.223 µs [527.112 µs, 569.334 µs] 188.324 µs (52.3%)
iast_GLOBAL 504.332 µs [482.913 µs, 525.75 µs] 144.433 µs (40.1%)
iast_HARDCODED_SECRET_DISABLED 475.477 µs [454.748 µs, 496.206 µs] 115.578 µs (32.1%)
iast_INACTIVE 447.981 µs [426.421 µs, 469.541 µs] 88.082 µs (24.5%)
iast_TELEMETRY_OFF 469.459 µs [448.453 µs, 490.465 µs] 109.559 µs (30.4%)
tracing 435.779 µs [414.866 µs, 456.692 µs] 75.88 µs (21.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/fix-nightly-deploy
git_commit_date 1722355686 1722372106
git_commit_sha 7028eaf 5cda1d1
release_version 1.38.0-SNAPSHOT~7028eafd9d 1.38.0-SNAPSHOT~5cda1d145d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1722374724 1722374724
ci_job_id 589633011 589633011
ci_pipeline_id 40513622 40513622
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.544 ms) : 1531, 1557
.   : milestone, 1544,
appsec (2.71 ms) : 2648, 2773
.   : milestone, 2710,
iast (2.391 ms) : 2317, 2466
.   : milestone, 2391,
iast_GLOBAL (2.416 ms) : 2342, 2490
.   : milestone, 2416,
profiling (2.231 ms) : 2167, 2296
.   : milestone, 2231,
tracing (2.174 ms) : 2115, 2233
.   : milestone, 2174,
section candidate
no_agent (1.544 ms) : 1532, 1557
.   : milestone, 1544,
appsec (2.711 ms) : 2649, 2773
.   : milestone, 2711,
iast (2.368 ms) : 2295, 2440
.   : milestone, 2368,
iast_GLOBAL (2.414 ms) : 2341, 2486
.   : milestone, 2414,
profiling (2.217 ms) : 2154, 2280
.   : milestone, 2217,
tracing (2.177 ms) : 2118, 2236
.   : milestone, 2177,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.544 ms [1.531 ms, 1.557 ms] -
appsec 2.71 ms [2.648 ms, 2.773 ms] 1.166 ms (75.5%)
iast 2.391 ms [2.317 ms, 2.466 ms] 847.536 µs (54.9%)
iast_GLOBAL 2.416 ms [2.342 ms, 2.49 ms] 871.932 µs (56.5%)
profiling 2.231 ms [2.167 ms, 2.296 ms] 687.522 µs (44.5%)
tracing 2.174 ms [2.115 ms, 2.233 ms] 629.831 µs (40.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.544 ms [1.532 ms, 1.557 ms] -
appsec 2.711 ms [2.649 ms, 2.773 ms] 1.167 ms (75.5%)
iast 2.368 ms [2.295 ms, 2.44 ms] 823.527 µs (53.3%)
iast_GLOBAL 2.414 ms [2.341 ms, 2.486 ms] 869.257 µs (56.3%)
profiling 2.217 ms [2.154 ms, 2.28 ms] 672.71 µs (43.6%)
tracing 2.177 ms [2.118 ms, 2.236 ms] 632.657 µs (41.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~5cda1d145d, baseline=1.38.0-SNAPSHOT~7028eafd9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (20.458 s) : 20458000, 20458000
.   : milestone, 20458000,
appsec (21.708 s) : 21708000, 21708000
.   : milestone, 21708000,
iast (24.797 s) : 24797000, 24797000
.   : milestone, 24797000,
iast_GLOBAL (24.467 s) : 24467000, 24467000
.   : milestone, 24467000,
profiling (21.353 s) : 21353000, 21353000
.   : milestone, 21353000,
tracing (21.175 s) : 21175000, 21175000
.   : milestone, 21175000,
section candidate
no_agent (20.273 s) : 20273000, 20273000
.   : milestone, 20273000,
appsec (20.876 s) : 20876000, 20876000
.   : milestone, 20876000,
iast (24.05 s) : 24050000, 24050000
.   : milestone, 24050000,
iast_GLOBAL (24.953 s) : 24953000, 24953000
.   : milestone, 24953000,
profiling (21.473 s) : 21473000, 21473000
.   : milestone, 21473000,
tracing (20.733 s) : 20733000, 20733000
.   : milestone, 20733000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 20.458 s [20.458 s, 20.458 s] -
appsec 21.708 s [21.708 s, 21.708 s] 1.25 s (6.1%)
iast 24.797 s [24.797 s, 24.797 s] 4.339 s (21.2%)
iast_GLOBAL 24.467 s [24.467 s, 24.467 s] 4.009 s (19.6%)
profiling 21.353 s [21.353 s, 21.353 s] 895.0 ms (4.4%)
tracing 21.175 s [21.175 s, 21.175 s] 717.0 ms (3.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 20.273 s [20.273 s, 20.273 s] -
appsec 20.876 s [20.876 s, 20.876 s] 603.0 ms (3.0%)
iast 24.05 s [24.05 s, 24.05 s] 3.777 s (18.6%)
iast_GLOBAL 24.953 s [24.953 s, 24.953 s] 4.68 s (23.1%)
profiling 21.473 s [21.473 s, 21.473 s] 1.2 s (5.9%)
tracing 20.733 s [20.733 s, 20.733 s] 460.0 ms (2.3%)

@randomanderson randomanderson merged commit 3700064 into master Jul 31, 2024
78 of 80 checks passed
@randomanderson randomanderson deleted the landerson/fix-nightly-deploy branch July 31, 2024 13:29
@github-actions github-actions bot added this to the 1.38.0 milestone Jul 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug
Projects
None yet
Milestone
1.38.0
Development

Successfully merging this pull request may close these issues.
2 participants
@randomanderson @PerfectSlayer