-
Notifications
You must be signed in to change notification settings - Fork 288
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Partition build steps and caches #7112
Draft
smola
wants to merge
3
commits into
master
Choose a base branch
from
smola/concurrent-builds
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
smola
added
tag: no release notes
Changes to exclude from release notes
comp: tooling
Build & Tooling
labels
Jun 3, 2024
smola
force-pushed
the
smola/concurrent-builds
branch
2 times, most recently
from
June 3, 2024 12:36
cda5819
to
86afc89
Compare
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059349
Total [baseline] (10.351 s) : 0, 10350850
Agent [candidate] (1.046 s) : 0, 1045596
Total [candidate] (10.434 s) : 0, 10434077
section appsec
Agent [baseline] (1.169 s) : 0, 1168861
Total [baseline] (10.478 s) : 0, 10478057
Agent [candidate] (1.172 s) : 0, 1171753
Total [candidate] (10.424 s) : 0, 10423709
section iast
Agent [baseline] (1.172 s) : 0, 1172109
Total [baseline] (10.836 s) : 0, 10836002
Agent [candidate] (1.174 s) : 0, 1174160
Total [candidate] (10.847 s) : 0, 10847408
section profiling
Agent [baseline] (1.241 s) : 0, 1241044
Total [baseline] (10.54 s) : 0, 10539951
Agent [candidate] (1.255 s) : 0, 1255455
Total [candidate] (10.573 s) : 0, 10573366
gantt
title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (675.972 ms) : 0, 675972
BytebuddyAgent [candidate] (667.175 ms) : 0, 667175
GlobalTracer [baseline] (309.706 ms) : 0, 309706
GlobalTracer [candidate] (306.054 ms) : 0, 306054
AppSec [baseline] (51.786 ms) : 0, 51786
AppSec [candidate] (50.862 ms) : 0, 50862
Remote Config [baseline] (701.372 µs) : 0, 701
Remote Config [candidate] (684.218 µs) : 0, 684
Telemetry [baseline] (7.611 ms) : 0, 7611
Telemetry [candidate] (7.405 ms) : 0, 7405
section appsec
BytebuddyAgent [baseline] (678.405 ms) : 0, 678405
BytebuddyAgent [candidate] (681.537 ms) : 0, 681537
GlobalTracer [baseline] (300.015 ms) : 0, 300015
GlobalTracer [candidate] (300.439 ms) : 0, 300439
AppSec [baseline] (157.13 ms) : 0, 157130
AppSec [candidate] (157.303 ms) : 0, 157303
IAST [baseline] (21.673 ms) : 0, 21673
IAST [candidate] (19.693 ms) : 0, 19693
Remote Config [baseline] (603.363 µs) : 0, 603
Remote Config [candidate] (607.229 µs) : 0, 607
Telemetry [baseline] (8.405 ms) : 0, 8405
Telemetry [candidate] (8.484 ms) : 0, 8484
section iast
BytebuddyAgent [baseline] (779.967 ms) : 0, 779967
BytebuddyAgent [candidate] (780.981 ms) : 0, 780981
GlobalTracer [baseline] (295.158 ms) : 0, 295158
GlobalTracer [candidate] (296.111 ms) : 0, 296111
AppSec [baseline] (55.246 ms) : 0, 55246
AppSec [candidate] (52.789 ms) : 0, 52789
IAST [baseline] (20.631 ms) : 0, 20631
IAST [candidate] (23.153 ms) : 0, 23153
Remote Config [baseline] (579.936 µs) : 0, 580
Remote Config [candidate] (566.743 µs) : 0, 567
Telemetry [baseline] (7.081 ms) : 0, 7081
Telemetry [candidate] (7.067 ms) : 0, 7067
section profiling
BytebuddyAgent [baseline] (662.022 ms) : 0, 662022
BytebuddyAgent [candidate] (671.428 ms) : 0, 671428
GlobalTracer [baseline] (387.524 ms) : 0, 387524
GlobalTracer [candidate] (390.27 ms) : 0, 390270
AppSec [baseline] (51.727 ms) : 0, 51727
AppSec [candidate] (52.313 ms) : 0, 52313
Remote Config [baseline] (691.144 µs) : 0, 691
Remote Config [candidate] (705.66 µs) : 0, 706
Telemetry [baseline] (7.448 ms) : 0, 7448
Telemetry [candidate] (7.477 ms) : 0, 7477
ProfilingAgent [baseline] (94.502 ms) : 0, 94502
ProfilingAgent [candidate] (95.558 ms) : 0, 95558
Profiling [baseline] (94.526 ms) : 0, 94526
Profiling [candidate] (95.582 ms) : 0, 95582
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044611
Total [baseline] (8.48 s) : 0, 8480444
Agent [candidate] (1.043 s) : 0, 1042807
Total [candidate] (8.473 s) : 0, 8473227
section iast
Agent [baseline] (1.179 s) : 0, 1178850
Total [baseline] (8.986 s) : 0, 8985654
Agent [candidate] (1.172 s) : 0, 1172469
Total [candidate] (8.952 s) : 0, 8951741
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1181798
Total [baseline] (8.943 s) : 0, 8943173
Agent [candidate] (1.181 s) : 0, 1181047
Total [candidate] (8.932 s) : 0, 8932040
section iast_TELEMETRY_OFF
Agent [baseline] (1.169 s) : 0, 1169276
Total [baseline] (8.966 s) : 0, 8965573
Agent [candidate] (1.167 s) : 0, 1166743
Total [candidate] (8.974 s) : 0, 8974092
gantt
title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.162 ms) : 0, 667162
BytebuddyAgent [candidate] (665.212 ms) : 0, 665212
GlobalTracer [baseline] (304.954 ms) : 0, 304954
GlobalTracer [candidate] (305.233 ms) : 0, 305233
AppSec [baseline] (50.922 ms) : 0, 50922
AppSec [candidate] (50.787 ms) : 0, 50787
Remote Config [baseline] (678.389 µs) : 0, 678
Remote Config [candidate] (686.74 µs) : 0, 687
Telemetry [baseline] (7.426 ms) : 0, 7426
Telemetry [candidate] (7.447 ms) : 0, 7447
section iast
BytebuddyAgent [baseline] (784.785 ms) : 0, 784785
BytebuddyAgent [candidate] (780.462 ms) : 0, 780462
GlobalTracer [baseline] (296.246 ms) : 0, 296246
GlobalTracer [candidate] (294.983 ms) : 0, 294983
AppSec [baseline] (54.017 ms) : 0, 54017
AppSec [candidate] (52.954 ms) : 0, 52954
IAST [baseline] (21.752 ms) : 0, 21752
IAST [candidate] (22.27 ms) : 0, 22270
Remote Config [baseline] (582.302 µs) : 0, 582
Remote Config [candidate] (571.531 µs) : 0, 572
Telemetry [baseline] (8.006 ms) : 0, 8006
Telemetry [candidate] (7.773 ms) : 0, 7773
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.135 ms) : 0, 786135
BytebuddyAgent [candidate] (785.548 ms) : 0, 785548
GlobalTracer [baseline] (297.277 ms) : 0, 297277
GlobalTracer [candidate] (297.918 ms) : 0, 297918
AppSec [baseline] (51.214 ms) : 0, 51214
AppSec [candidate] (50.246 ms) : 0, 50246
IAST [baseline] (24.197 ms) : 0, 24197
IAST [candidate] (24.447 ms) : 0, 24447
Remote Config [baseline] (570.772 µs) : 0, 571
Remote Config [candidate] (581.14 µs) : 0, 581
Telemetry [baseline] (8.837 ms) : 0, 8837
Telemetry [candidate] (8.709 ms) : 0, 8709
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.478 ms) : 0, 777478
BytebuddyAgent [candidate] (778.294 ms) : 0, 778294
GlobalTracer [baseline] (295.986 ms) : 0, 295986
GlobalTracer [candidate] (296.06 ms) : 0, 296060
AppSec [baseline] (52.156 ms) : 0, 52156
AppSec [candidate] (50.595 ms) : 0, 50595
IAST [baseline] (21.874 ms) : 0, 21874
IAST [candidate] (20.591 ms) : 0, 20591
Remote Config [baseline] (605.663 µs) : 0, 606
Remote Config [candidate] (623.961 µs) : 0, 624
Telemetry [baseline] (7.745 ms) : 0, 7745
Telemetry [candidate] (7.12 ms) : 0, 7120
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section baseline
no_agent (358.048 µs) : 339, 378
. : milestone, 358,
iast (486.912 µs) : 465, 508
. : milestone, 487,
iast_FULL (551.529 µs) : 529, 574
. : milestone, 552,
iast_GLOBAL (501.802 µs) : 480, 524
. : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (474.868 µs) : 454, 496
. : milestone, 475,
iast_INACTIVE (463.249 µs) : 440, 487
. : milestone, 463,
iast_TELEMETRY_OFF (474.0 µs) : 452, 496
. : milestone, 474,
tracing (445.181 µs) : 425, 465
. : milestone, 445,
section candidate
no_agent (361.269 µs) : 342, 381
. : milestone, 361,
iast (481.017 µs) : 460, 502
. : milestone, 481,
iast_FULL (545.589 µs) : 523, 568
. : milestone, 546,
iast_GLOBAL (501.895 µs) : 480, 524
. : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (480.82 µs) : 459, 502
. : milestone, 481,
iast_INACTIVE (450.374 µs) : 428, 472
. : milestone, 450,
iast_TELEMETRY_OFF (471.953 µs) : 450, 493
. : milestone, 472,
tracing (445.266 µs) : 424, 466
. : milestone, 445,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1374
. : milestone, 1355,
appsec (1.715 ms) : 1691, 1739
. : milestone, 1715,
appsec_no_iast (1.723 ms) : 1700, 1747
. : milestone, 1723,
iast (1.464 ms) : 1442, 1487
. : milestone, 1464,
profiling (1.484 ms) : 1458, 1509
. : milestone, 1484,
tracing (1.476 ms) : 1452, 1500
. : milestone, 1476,
section candidate
no_agent (1.352 ms) : 1333, 1372
. : milestone, 1352,
appsec (1.719 ms) : 1695, 1743
. : milestone, 1719,
appsec_no_iast (1.725 ms) : 1701, 1748
. : milestone, 1725,
iast (1.487 ms) : 1464, 1510
. : milestone, 1487,
profiling (1.474 ms) : 1449, 1499
. : milestone, 1474,
tracing (1.458 ms) : 1433, 1483
. : milestone, 1458,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section baseline
no_agent (1.461 ms) : 1450, 1472
. : milestone, 1461,
appsec (2.226 ms) : 2191, 2261
. : milestone, 2226,
iast (1.976 ms) : 1934, 2018
. : milestone, 1976,
iast_GLOBAL (2.029 ms) : 1985, 2072
. : milestone, 2029,
profiling (1.862 ms) : 1827, 1898
. : milestone, 1862,
tracing (1.853 ms) : 1820, 1886
. : milestone, 1853,
section candidate
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.232 ms) : 2197, 2268
. : milestone, 2232,
iast (1.969 ms) : 1928, 2011
. : milestone, 1969,
iast_GLOBAL (2.003 ms) : 1961, 2045
. : milestone, 2003,
profiling (1.857 ms) : 1823, 1891
. : milestone, 1857,
tracing (1.844 ms) : 1812, 1877
. : milestone, 1844,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~855604c019, baseline=1.39.0-SNAPSHOT~ce8ac446e0
dateFormat X
axisFormat %s
section baseline
no_agent (14.719 s) : 14719000, 14719000
. : milestone, 14719000,
appsec (15.158 s) : 15158000, 15158000
. : milestone, 15158000,
iast (18.805 s) : 18805000, 18805000
. : milestone, 18805000,
iast_GLOBAL (17.885 s) : 17885000, 17885000
. : milestone, 17885000,
profiling (15.135 s) : 15135000, 15135000
. : milestone, 15135000,
tracing (15.153 s) : 15153000, 15153000
. : milestone, 15153000,
section candidate
no_agent (15.48 s) : 15480000, 15480000
. : milestone, 15480000,
appsec (15.112 s) : 15112000, 15112000
. : milestone, 15112000,
iast (18.933 s) : 18933000, 18933000
. : milestone, 18933000,
iast_GLOBAL (17.957 s) : 17957000, 17957000
. : milestone, 17957000,
profiling (15.69 s) : 15690000, 15690000
. : milestone, 15690000,
tracing (15.158 s) : 15158000, 15158000
. : milestone, 15158000,
|
smola
force-pushed
the
smola/concurrent-builds
branch
2 times, most recently
from
June 3, 2024 15:17
2d176bc
to
e390744
Compare
smola
force-pushed
the
smola/concurrent-builds
branch
from
August 21, 2024 13:43
830633b
to
f6dcef8
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Motivation
Additional Notes
Jira ticket: [PROJ-IDENT]