Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade builds to latest JDK versions #7390

Merged
merged 1 commit into from
Aug 22, 2024
Merged

Upgrade builds to latest JDK versions #7390

merged 1 commit into from
Aug 22, 2024

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Aug 6, 2024 •
edited
Loading

What Does This Do

This PR upgrades to docker build image to https://github.com/DataDog/dd-trace-java-docker-build/actions/runs/10056908860

Motivation

Use update versions to build dd-trace-java

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added type: enhancement tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Aug 6, 2024
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner August 6, 2024 14:47
@mcculls
Copy link
Contributor

mcculls commented Aug 8, 2024 •
edited
Loading

+1 once the CI issues have been resolved

The CI errors look similar to those seen in the nightly CI builds (the ones with "Timeout has been exceeded")

Solving these failures should therefore also fix those nightly runs.

@PerfectSlayer
Copy link
Contributor Author

Thanks for having a look at it. I haven't paid attention yet.

Isn't weird that upgrading JDKs lead to the same kind of than nightly? Upgrading JDK should not have an impact of which dependency version is used, right? 🤔 (if it's the root cause of the timeouts)

@smola
Copy link
Member

smola commented Aug 12, 2024

@PerfectSlayer Isn't weird that upgrading JDKs lead to the same kind of than nightly

Nightlies currently run with latest docker images.

@PerfectSlayer PerfectSlayer enabled auto-merge (squash) August 16, 2024 06:47
@pr-commenter
Copy link

pr-commenter bot commented Aug 16, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-jdk
git_commit_date 1723788232 1723790746
git_commit_sha 2fa95bf 6417822
release_version 1.39.0-SNAPSHOT~2fa95bf182 1.39.0-SNAPSHOT~64178225f0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1723793010 1723793010
ci_job_id 606871405 606871405
ci_pipeline_id 41949043 41949043
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052070
Total [baseline] (10.317 s) : 0, 10316896
Agent [candidate] (1.053 s) : 0, 1053192
Total [candidate] (10.34 s) : 0, 10339963
section appsec
Agent [baseline] (1.17 s) : 0, 1169827
Total [baseline] (10.436 s) : 0, 10436079
Agent [candidate] (1.169 s) : 0, 1168934
Total [candidate] (10.472 s) : 0, 10472430
section iast
Agent [baseline] (1.186 s) : 0, 1185731
Total [baseline] (10.838 s) : 0, 10838456
Agent [candidate] (1.179 s) : 0, 1179069
Total [candidate] (10.804 s) : 0, 10803536
section profiling
Agent [baseline] (1.25 s) : 0, 1250444
Total [baseline] (10.561 s) : 0, 10561196
Agent [candidate] (1.26 s) : 0, 1259640
Total [candidate] (10.615 s) : 0, 10614638
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.17 s 117.757 ms (11.2%)
Agent iast 1.186 s 133.661 ms (12.7%)
Agent profiling 1.25 s 198.374 ms (18.9%)
Total tracing 10.317 s -
Total appsec 10.436 s 119.183 ms (1.2%)
Total iast 10.838 s 521.559 ms (5.1%)
Total profiling 10.561 s 244.3 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.169 s 115.741 ms (11.0%)
Agent iast 1.179 s 125.876 ms (12.0%)
Agent profiling 1.26 s 206.447 ms (19.6%)
Total tracing 10.34 s -
Total appsec 10.472 s 132.467 ms (1.3%)
Total iast 10.804 s 463.574 ms (4.5%)
Total profiling 10.615 s 274.675 ms (2.7%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.706 ms) : 0, 672706
BytebuddyAgent [candidate] (672.068 ms) : 0, 672068
GlobalTracer [baseline] (306.484 ms) : 0, 306484
GlobalTracer [candidate] (308.168 ms) : 0, 308168
AppSec [baseline] (51.175 ms) : 0, 51175
AppSec [candidate] (51.27 ms) : 0, 51270
Remote Config [baseline] (683.665 µs) : 0, 684
Remote Config [candidate] (684.474 µs) : 0, 684
Telemetry [baseline] (7.504 ms) : 0, 7504
Telemetry [candidate] (7.464 ms) : 0, 7464
section appsec
BytebuddyAgent [baseline] (678.791 ms) : 0, 678791
BytebuddyAgent [candidate] (678.162 ms) : 0, 678162
GlobalTracer [baseline] (300.147 ms) : 0, 300147
GlobalTracer [candidate] (299.578 ms) : 0, 299578
AppSec [baseline] (157.227 ms) : 0, 157227
AppSec [candidate] (157.361 ms) : 0, 157361
Remote Config [baseline] (603.556 µs) : 0, 604
Remote Config [candidate] (600.444 µs) : 0, 600
Telemetry [baseline] (9.463 ms) : 0, 9463
Telemetry [candidate] (8.679 ms) : 0, 8679
IAST [baseline] (20.255 ms) : 0, 20255
IAST [candidate] (22.111 ms) : 0, 22111
section iast
BytebuddyAgent [baseline] (788.938 ms) : 0, 788938
BytebuddyAgent [candidate] (783.905 ms) : 0, 783905
GlobalTracer [baseline] (298.133 ms) : 0, 298133
GlobalTracer [candidate] (297.393 ms) : 0, 297393
AppSec [baseline] (52.169 ms) : 0, 52169
AppSec [candidate] (52.53 ms) : 0, 52530
Remote Config [baseline] (612.055 µs) : 0, 612
Remote Config [candidate] (579.03 µs) : 0, 579
Telemetry [baseline] (9.603 ms) : 0, 9603
Telemetry [candidate] (8.607 ms) : 0, 8607
IAST [baseline] (22.712 ms) : 0, 22712
IAST [candidate] (22.53 ms) : 0, 22530
section profiling
ProfilingAgent [baseline] (95.221 ms) : 0, 95221
ProfilingAgent [candidate] (95.523 ms) : 0, 95523
BytebuddyAgent [baseline] (664.207 ms) : 0, 664207
BytebuddyAgent [candidate] (671.032 ms) : 0, 671032
GlobalTracer [baseline] (393.219 ms) : 0, 393219
GlobalTracer [candidate] (394.305 ms) : 0, 394305
AppSec [baseline] (52.497 ms) : 0, 52497
AppSec [candidate] (52.962 ms) : 0, 52962
Remote Config [baseline] (686.503 µs) : 0, 687
Remote Config [candidate] (686.321 µs) : 0, 686
Telemetry [baseline] (7.471 ms) : 0, 7471
Telemetry [candidate] (7.546 ms) : 0, 7546
Profiling [baseline] (95.246 ms) : 0, 95246
Profiling [candidate] (95.549 ms) : 0, 95549
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043808
Total [baseline] (8.539 s) : 0, 8538680
Agent [candidate] (1.047 s) : 0, 1046548
Total [candidate] (8.501 s) : 0, 8500574
section iast
Agent [baseline] (1.175 s) : 0, 1175411
Total [baseline] (8.991 s) : 0, 8991138
Agent [candidate] (1.173 s) : 0, 1173113
Total [candidate] (8.971 s) : 0, 8971320
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1173423
Total [baseline] (9.007 s) : 0, 9006803
Agent [candidate] (1.173 s) : 0, 1173349
Total [candidate] (9.014 s) : 0, 9014145
section iast_TELEMETRY_OFF
Agent [baseline] (1.178 s) : 0, 1177958
Total [baseline] (8.984 s) : 0, 8984177
Agent [candidate] (1.181 s) : 0, 1180811
Total [candidate] (8.987 s) : 0, 8986581
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent iast 1.175 s 131.603 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 129.615 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.178 s 134.15 ms (12.9%)
Total tracing 8.539 s -
Total iast 8.991 s 452.458 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.007 s 468.123 ms (5.5%)
Total iast_TELEMETRY_OFF 8.984 s 445.497 ms (5.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.173 s 126.565 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 126.801 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.181 s 134.263 ms (12.8%)
Total tracing 8.501 s -
Total iast 8.971 s 470.746 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.014 s 513.571 ms (6.0%)
Total iast_TELEMETRY_OFF 8.987 s 486.007 ms (5.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.571 ms) : 0, 665571
BytebuddyAgent [candidate] (667.558 ms) : 0, 667558
GlobalTracer [baseline] (305.682 ms) : 0, 305682
GlobalTracer [candidate] (306.105 ms) : 0, 306105
AppSec [baseline] (51.051 ms) : 0, 51051
AppSec [candidate] (51.315 ms) : 0, 51315
Remote Config [baseline] (678.01 µs) : 0, 678
Remote Config [candidate] (685.876 µs) : 0, 686
Telemetry [baseline] (7.432 ms) : 0, 7432
Telemetry [candidate] (7.494 ms) : 0, 7494
section iast
BytebuddyAgent [baseline] (782.486 ms) : 0, 782486
BytebuddyAgent [candidate] (780.75 ms) : 0, 780750
GlobalTracer [baseline] (295.814 ms) : 0, 295814
GlobalTracer [candidate] (295.574 ms) : 0, 295574
AppSec [baseline] (51.903 ms) : 0, 51903
AppSec [candidate] (53.562 ms) : 0, 53562
Remote Config [baseline] (583.292 µs) : 0, 583
Remote Config [candidate] (568.344 µs) : 0, 568
Telemetry [baseline] (7.83 ms) : 0, 7830
Telemetry [candidate] (7.81 ms) : 0, 7810
IAST [baseline] (23.299 ms) : 0, 23299
IAST [candidate] (21.414 ms) : 0, 21414
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.987 ms) : 0, 780987
BytebuddyAgent [candidate] (781.357 ms) : 0, 781357
GlobalTracer [baseline] (296.227 ms) : 0, 296227
GlobalTracer [candidate] (296.479 ms) : 0, 296479
AppSec [baseline] (50.064 ms) : 0, 50064
AppSec [candidate] (49.964 ms) : 0, 49964
Remote Config [baseline] (576.396 µs) : 0, 576
Remote Config [candidate] (572.337 µs) : 0, 572
Telemetry [baseline] (8.757 ms) : 0, 8757
Telemetry [candidate] (7.991 ms) : 0, 7991
IAST [baseline] (23.294 ms) : 0, 23294
IAST [candidate] (23.45 ms) : 0, 23450
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (784.214 ms) : 0, 784214
BytebuddyAgent [candidate] (785.244 ms) : 0, 785244
GlobalTracer [baseline] (298.363 ms) : 0, 298363
GlobalTracer [candidate] (298.688 ms) : 0, 298688
AppSec [baseline] (51.396 ms) : 0, 51396
AppSec [candidate] (53.215 ms) : 0, 53215
Remote Config [baseline] (603.665 µs) : 0, 604
Remote Config [candidate] (625.854 µs) : 0, 626
Telemetry [baseline] (6.984 ms) : 0, 6984
Telemetry [candidate] (7.122 ms) : 0, 7122
IAST [baseline] (22.816 ms) : 0, 22816
IAST [candidate] (22.312 ms) : 0, 22312
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-16T06:56:15 2024-08-16T07:03:02
git_branch master bbujon/ci-jdk
git_commit_date 1723788232 1723790746
git_commit_sha 2fa95bf 6417822
release_version 1.39.0-SNAPSHOT~2fa95bf182 1.39.0-SNAPSHOT~64178225f0
start_time 2024-08-16T06:56:02 2024-08-16T07:02:49
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1723792125 1723792125
ci_job_id 606871406 606871406
ci_pipeline_id 41949043 41949043
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-94.907µs; -31.745µs] or [-6.174%; -2.065%]		 unstable
[-431.635op/s; +677.789op/s] or [-14.028%; +22.028%]		 1.474ms 3200.000op/s 1.537ms 3076.923op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.344 ms) : 1324, 1364
.   : milestone, 1344,
appsec (1.715 ms) : 1692, 1738
.   : milestone, 1715,
appsec_no_iast (1.699 ms) : 1675, 1723
.   : milestone, 1699,
iast (1.467 ms) : 1444, 1490
.   : milestone, 1467,
profiling (1.537 ms) : 1504, 1571
.   : milestone, 1537,
tracing (1.46 ms) : 1436, 1484
.   : milestone, 1460,
section candidate
no_agent (1.342 ms) : 1323, 1361
.   : milestone, 1342,
appsec (1.714 ms) : 1690, 1738
.   : milestone, 1714,
appsec_no_iast (1.723 ms) : 1698, 1747
.   : milestone, 1723,
iast (1.463 ms) : 1441, 1486
.   : milestone, 1463,
profiling (1.474 ms) : 1449, 1498
.   : milestone, 1474,
tracing (1.462 ms) : 1436, 1488
.   : milestone, 1462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.324 ms, 1.364 ms] -
appsec 1.715 ms [1.692 ms, 1.738 ms] 370.602 µs (27.6%)
appsec_no_iast 1.699 ms [1.675 ms, 1.723 ms] 354.517 µs (26.4%)
iast 1.467 ms [1.444 ms, 1.49 ms] 122.863 µs (9.1%)
profiling 1.537 ms [1.504 ms, 1.571 ms] 193.018 µs (14.4%)
tracing 1.46 ms [1.436 ms, 1.484 ms] 115.646 µs (8.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.323 ms, 1.361 ms] -
appsec 1.714 ms [1.69 ms, 1.738 ms] 371.915 µs (27.7%)
appsec_no_iast 1.723 ms [1.698 ms, 1.747 ms] 380.295 µs (28.3%)
iast 1.463 ms [1.441 ms, 1.486 ms] 121.084 µs (9.0%)
profiling 1.474 ms [1.449 ms, 1.498 ms] 131.637 µs (9.8%)
tracing 1.462 ms [1.436 ms, 1.488 ms] 119.585 µs (8.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182
    dateFormat X
    axisFormat %s
section baseline
no_agent (360.201 µs) : 340, 381
.   : milestone, 360,
iast (471.86 µs) : 451, 493
.   : milestone, 472,
iast_FULL (538.541 µs) : 516, 561
.   : milestone, 539,
iast_GLOBAL (507.0 µs) : 484, 530
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (482.126 µs) : 460, 504
.   : milestone, 482,
iast_INACTIVE (444.329 µs) : 422, 466
.   : milestone, 444,
iast_TELEMETRY_OFF (467.939 µs) : 446, 490
.   : milestone, 468,
tracing (434.06 µs) : 414, 454
.   : milestone, 434,
section candidate
no_agent (357.232 µs) : 338, 377
.   : milestone, 357,
iast (472.577 µs) : 451, 494
.   : milestone, 473,
iast_FULL (540.618 µs) : 518, 563
.   : milestone, 541,
iast_GLOBAL (506.113 µs) : 483, 529
.   : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (482.197 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (450.815 µs) : 429, 473
.   : milestone, 451,
iast_TELEMETRY_OFF (464.278 µs) : 443, 485
.   : milestone, 464,
tracing (435.354 µs) : 415, 456
.   : milestone, 435,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 360.201 µs [339.601 µs, 380.801 µs] -
iast 471.86 µs [450.822 µs, 492.897 µs] 111.659 µs (31.0%)
iast_FULL 538.541 µs [516.405 µs, 560.677 µs] 178.34 µs (49.5%)
iast_GLOBAL 507.0 µs [483.926 µs, 530.073 µs] 146.798 µs (40.8%)
iast_HARDCODED_SECRET_DISABLED 482.126 µs [459.959 µs, 504.292 µs] 121.924 µs (33.8%)
iast_INACTIVE 444.329 µs [422.285 µs, 466.374 µs] 84.128 µs (23.4%)
iast_TELEMETRY_OFF 467.939 µs [446.282 µs, 489.597 µs] 107.738 µs (29.9%)
tracing 434.06 µs [414.013 µs, 454.107 µs] 73.859 µs (20.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 357.232 µs [337.84 µs, 376.624 µs] -
iast 472.577 µs [451.16 µs, 493.995 µs] 115.346 µs (32.3%)
iast_FULL 540.618 µs [518.435 µs, 562.801 µs] 183.386 µs (51.3%)
iast_GLOBAL 506.113 µs [483.06 µs, 529.165 µs] 148.881 µs (41.7%)
iast_HARDCODED_SECRET_DISABLED 482.197 µs [460.894 µs, 503.499 µs] 124.965 µs (35.0%)
iast_INACTIVE 450.815 µs [428.681 µs, 472.949 µs] 93.583 µs (26.2%)
iast_TELEMETRY_OFF 464.278 µs [443.122 µs, 485.434 µs] 107.046 µs (30.0%)
tracing 435.354 µs [414.533 µs, 456.175 µs] 78.122 µs (21.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci-jdk
git_commit_date 1723788232 1723790746
git_commit_sha 2fa95bf 6417822
release_version 1.39.0-SNAPSHOT~2fa95bf182 1.39.0-SNAPSHOT~64178225f0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1723792635 1723792635
ci_job_id 606871407 606871407
ci_pipeline_id 41949043 41949043
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
appsec (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
iast (18.826 s) : 18826000, 18826000
.   : milestone, 18826000,
iast_GLOBAL (18.019 s) : 18019000, 18019000
.   : milestone, 18019000,
profiling (15.778 s) : 15778000, 15778000
.   : milestone, 15778000,
tracing (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
section candidate
no_agent (15.176 s) : 15176000, 15176000
.   : milestone, 15176000,
appsec (15.206 s) : 15206000, 15206000
.   : milestone, 15206000,
iast (18.981 s) : 18981000, 18981000
.   : milestone, 18981000,
iast_GLOBAL (18.07 s) : 18070000, 18070000
.   : milestone, 18070000,
profiling (15.122 s) : 15122000, 15122000
.   : milestone, 15122000,
tracing (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.017 s [15.017 s, 15.017 s] -
appsec 14.96 s [14.96 s, 14.96 s] -57.0 ms (-0.4%)
iast 18.826 s [18.826 s, 18.826 s] 3.809 s (25.4%)
iast_GLOBAL 18.019 s [18.019 s, 18.019 s] 3.002 s (20.0%)
profiling 15.778 s [15.778 s, 15.778 s] 761.0 ms (5.1%)
tracing 15.103 s [15.103 s, 15.103 s] 86.0 ms (0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.176 s [15.176 s, 15.176 s] -
appsec 15.206 s [15.206 s, 15.206 s] 30.0 ms (0.2%)
iast 18.981 s [18.981 s, 18.981 s] 3.805 s (25.1%)
iast_GLOBAL 18.07 s [18.07 s, 18.07 s] 2.894 s (19.1%)
profiling 15.122 s [15.122 s, 15.122 s] -54.0 ms (-0.4%)
tracing 15.019 s [15.019 s, 15.019 s] -157.0 ms (-1.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~64178225f0, baseline=1.39.0-SNAPSHOT~2fa95bf182
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1481
.   : milestone, 1469,
appsec (2.242 ms) : 2207, 2278
.   : milestone, 2242,
iast (1.976 ms) : 1934, 2018
.   : milestone, 1976,
iast_GLOBAL (2.026 ms) : 1983, 2069
.   : milestone, 2026,
profiling (1.869 ms) : 1834, 1903
.   : milestone, 1869,
tracing (1.851 ms) : 1818, 1885
.   : milestone, 1851,
section candidate
no_agent (1.463 ms) : 1452, 1475
.   : milestone, 1463,
appsec (2.245 ms) : 2209, 2280
.   : milestone, 2245,
iast (1.985 ms) : 1942, 2028
.   : milestone, 1985,
iast_GLOBAL (2.025 ms) : 1982, 2069
.   : milestone, 2025,
profiling (1.865 ms) : 1831, 1899
.   : milestone, 1865,
tracing (1.845 ms) : 1812, 1878
.   : milestone, 1845,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.481 ms] -
appsec 2.242 ms [2.207 ms, 2.278 ms] 773.315 µs (52.6%)
iast 1.976 ms [1.934 ms, 2.018 ms] 506.807 µs (34.5%)
iast_GLOBAL 2.026 ms [1.983 ms, 2.069 ms] 556.863 µs (37.9%)
profiling 1.869 ms [1.834 ms, 1.903 ms] 399.596 µs (27.2%)
tracing 1.851 ms [1.818 ms, 1.885 ms] 382.519 µs (26.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.475 ms] -
appsec 2.245 ms [2.209 ms, 2.28 ms] 781.49 µs (53.4%)
iast 1.985 ms [1.942 ms, 2.028 ms] 521.955 µs (35.7%)
iast_GLOBAL 2.025 ms [1.982 ms, 2.069 ms] 561.992 µs (38.4%)
profiling 1.865 ms [1.831 ms, 1.899 ms] 401.735 µs (27.5%)
tracing 1.845 ms [1.812 ms, 1.878 ms] 381.411 µs (26.1%)

@PerfectSlayer PerfectSlayer merged commit f6c87de into master Aug 22, 2024
78 of 79 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci-jdk branch August 22, 2024 14:24
@github-actions github-actions bot added this to the 1.39.0 milestone Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@mcculls mcculls mcculls approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement
Projects
None yet
Milestone
1.39.0
Development

Successfully merging this pull request may close these issues.
3 participants
@PerfectSlayer @mcculls @smola