-
Notifications
You must be signed in to change notification settings - Fork 288
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix checkSmoke #7384
Merged
Merged
Fix checkSmoke #7384
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.548 s) : 0, 1547552
Total [baseline] (11.818 s) : 0, 11817639
Agent [candidate] (1.544 s) : 0, 1544032
Total [candidate] (11.804 s) : 0, 11803895
section iast
Agent [baseline] (1.717 s) : 0, 1717453
Total [baseline] (12.517 s) : 0, 12517071
Agent [candidate] (1.719 s) : 0, 1719292
Total [candidate] (12.558 s) : 0, 12558490
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.716 s) : 0, 1716496
Total [baseline] (12.522 s) : 0, 12521644
Agent [candidate] (1.725 s) : 0, 1725377
Total [candidate] (12.441 s) : 0, 12440538
section iast_TELEMETRY_OFF
Agent [baseline] (1.709 s) : 0, 1708868
Total [baseline] (12.508 s) : 0, 12507679
Agent [candidate] (1.719 s) : 0, 1718576
Total [candidate] (12.474 s) : 0, 12474055
gantt
title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.316 ms) : 0, 991316
BytebuddyAgent [candidate] (990.135 ms) : 0, 990135
GlobalTracer [baseline] (454.88 ms) : 0, 454880
GlobalTracer [candidate] (452.61 ms) : 0, 452610
AppSec [baseline] (70.986 ms) : 0, 70986
AppSec [candidate] (70.797 ms) : 0, 70797
Remote Config [baseline] (846.288 µs) : 0, 846
Remote Config [candidate] (852.637 µs) : 0, 853
Telemetry [baseline] (9.596 ms) : 0, 9596
Telemetry [candidate] (9.613 ms) : 0, 9613
section iast
BytebuddyAgent [baseline] (1.153 s) : 0, 1152774
BytebuddyAgent [candidate] (1.154 s) : 0, 1154063
GlobalTracer [baseline] (433.297 ms) : 0, 433297
GlobalTracer [candidate] (434.414 ms) : 0, 434414
AppSec [baseline] (73.171 ms) : 0, 73171
AppSec [candidate] (71.866 ms) : 0, 71866
IAST [baseline] (28.254 ms) : 0, 28254
IAST [candidate] (29.064 ms) : 0, 29064
Remote Config [baseline] (807.394 µs) : 0, 807
Remote Config [candidate] (725.56 µs) : 0, 726
Telemetry [baseline] (9.169 ms) : 0, 9169
Telemetry [candidate] (9.045 ms) : 0, 9045
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.152 s) : 0, 1151528
BytebuddyAgent [candidate] (1.159 s) : 0, 1158634
GlobalTracer [baseline] (435.02 ms) : 0, 435020
GlobalTracer [candidate] (436.577 ms) : 0, 436577
AppSec [baseline] (71.99 ms) : 0, 71990
AppSec [candidate] (70.094 ms) : 0, 70094
IAST [baseline] (28.136 ms) : 0, 28136
IAST [candidate] (29.706 ms) : 0, 29706
Remote Config [baseline] (717.866 µs) : 0, 718
Remote Config [candidate] (766.917 µs) : 0, 767
Telemetry [baseline] (8.966 ms) : 0, 8966
Telemetry [candidate] (9.306 ms) : 0, 9306
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.146 s) : 0, 1146458
BytebuddyAgent [candidate] (1.152 s) : 0, 1151728
GlobalTracer [baseline] (433.825 ms) : 0, 433825
GlobalTracer [candidate] (435.124 ms) : 0, 435124
AppSec [baseline] (67.185 ms) : 0, 67185
AppSec [candidate] (66.754 ms) : 0, 66754
IAST [baseline] (31.532 ms) : 0, 31532
IAST [candidate] (35.052 ms) : 0, 35052
Remote Config [baseline] (771.488 µs) : 0, 771
Remote Config [candidate] (787.73 µs) : 0, 788
Telemetry [baseline] (8.999 ms) : 0, 8999
Telemetry [candidate] (8.953 ms) : 0, 8953
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.546 s) : 0, 1545809
Total [baseline] (14.263 s) : 0, 14262611
Agent [candidate] (1.546 s) : 0, 1546329
Total [candidate] (14.283 s) : 0, 14283420
section appsec
Agent [baseline] (1.735 s) : 0, 1734804
Total [baseline] (14.385 s) : 0, 14385401
Agent [candidate] (1.732 s) : 0, 1732398
Total [candidate] (14.431 s) : 0, 14430921
section iast
Agent [baseline] (1.716 s) : 0, 1716145
Total [baseline] (14.736 s) : 0, 14735933
Agent [candidate] (1.71 s) : 0, 1709660
Total [candidate] (14.821 s) : 0, 14820704
section profiling
Agent [baseline] (1.855 s) : 0, 1855216
Total [baseline] (14.755 s) : 0, 14754772
Agent [candidate] (1.857 s) : 0, 1857305
Total [candidate] (14.663 s) : 0, 14663421
gantt
title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.755 ms) : 0, 991755
BytebuddyAgent [candidate] (991.906 ms) : 0, 991906
GlobalTracer [baseline] (452.976 ms) : 0, 452976
GlobalTracer [candidate] (453.243 ms) : 0, 453243
AppSec [baseline] (70.748 ms) : 0, 70748
AppSec [candidate] (70.697 ms) : 0, 70697
Remote Config [baseline] (848.109 µs) : 0, 848
Remote Config [candidate] (845.385 µs) : 0, 845
Telemetry [baseline] (9.528 ms) : 0, 9528
Telemetry [candidate] (9.602 ms) : 0, 9602
section appsec
BytebuddyAgent [baseline] (1.012 s) : 0, 1012045
BytebuddyAgent [candidate] (1.009 s) : 0, 1009496
GlobalTracer [baseline] (446.765 ms) : 0, 446765
GlobalTracer [candidate] (446.62 ms) : 0, 446620
AppSec [baseline] (233.381 ms) : 0, 233381
AppSec [candidate] (232.891 ms) : 0, 232891
Remote Config [baseline] (767.136 µs) : 0, 767
Remote Config [candidate] (765.896 µs) : 0, 766
Telemetry [baseline] (9.046 ms) : 0, 9046
Telemetry [candidate] (9.762 ms) : 0, 9762
IAST [baseline] (25.474 ms) : 0, 25474
IAST [candidate] (25.532 ms) : 0, 25532
section iast
BytebuddyAgent [baseline] (1.152 s) : 0, 1151932
BytebuddyAgent [candidate] (1.149 s) : 0, 1149044
GlobalTracer [baseline] (433.9 ms) : 0, 433900
GlobalTracer [candidate] (432.468 ms) : 0, 432468
AppSec [baseline] (71.41 ms) : 0, 71410
AppSec [candidate] (68.809 ms) : 0, 68809
Remote Config [baseline] (719.777 µs) : 0, 720
Remote Config [candidate] (758.101 µs) : 0, 758
Telemetry [baseline] (9.039 ms) : 0, 9039
Telemetry [candidate] (10.108 ms) : 0, 10108
IAST [baseline] (29.165 ms) : 0, 29165
IAST [candidate] (28.434 ms) : 0, 28434
section profiling
BytebuddyAgent [baseline] (985.239 ms) : 0, 985239
BytebuddyAgent [candidate] (984.012 ms) : 0, 984012
GlobalTracer [baseline] (583.955 ms) : 0, 583955
GlobalTracer [candidate] (584.695 ms) : 0, 584695
AppSec [baseline] (72.221 ms) : 0, 72221
AppSec [candidate] (72.253 ms) : 0, 72253
Remote Config [baseline] (922.794 µs) : 0, 923
Remote Config [candidate] (945.009 µs) : 0, 945
Telemetry [baseline] (9.253 ms) : 0, 9253
Telemetry [candidate] (9.288 ms) : 0, 9288
ProfilingAgent [baseline] (147.895 ms) : 0, 147895
ProfilingAgent [candidate] (150.36 ms) : 0, 150360
Profiling [baseline] (147.969 ms) : 0, 147969
Profiling [candidate] (150.459 ms) : 0, 150459
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section baseline
no_agent (373.37 µs) : 353, 394
. : milestone, 373,
iast (483.046 µs) : 462, 504
. : milestone, 483,
iast_FULL (547.241 µs) : 526, 568
. : milestone, 547,
iast_GLOBAL (502.288 µs) : 481, 523
. : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (477.796 µs) : 457, 499
. : milestone, 478,
iast_INACTIVE (453.338 µs) : 431, 475
. : milestone, 453,
iast_TELEMETRY_OFF (470.583 µs) : 450, 492
. : milestone, 471,
tracing (442.393 µs) : 422, 463
. : milestone, 442,
section candidate
no_agent (366.091 µs) : 344, 388
. : milestone, 366,
iast (484.466 µs) : 463, 506
. : milestone, 484,
iast_FULL (546.333 µs) : 525, 567
. : milestone, 546,
iast_GLOBAL (514.998 µs) : 493, 537
. : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (481.719 µs) : 461, 503
. : milestone, 482,
iast_INACTIVE (452.357 µs) : 431, 474
. : milestone, 452,
iast_TELEMETRY_OFF (471.445 µs) : 450, 493
. : milestone, 471,
tracing (441.826 µs) : 421, 462
. : milestone, 442,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section baseline
no_agent (1.328 ms) : 1308, 1347
. : milestone, 1328,
appsec (1.708 ms) : 1683, 1733
. : milestone, 1708,
appsec_no_iast (1.699 ms) : 1674, 1723
. : milestone, 1699,
iast (1.49 ms) : 1469, 1512
. : milestone, 1490,
profiling (1.533 ms) : 1506, 1559
. : milestone, 1533,
tracing (1.459 ms) : 1435, 1483
. : milestone, 1459,
section candidate
no_agent (1.328 ms) : 1309, 1347
. : milestone, 1328,
appsec (1.72 ms) : 1697, 1744
. : milestone, 1720,
appsec_no_iast (1.695 ms) : 1669, 1720
. : milestone, 1695,
iast (1.467 ms) : 1445, 1489
. : milestone, 1467,
profiling (1.529 ms) : 1503, 1555
. : milestone, 1529,
tracing (1.457 ms) : 1433, 1481
. : milestone, 1457,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section baseline
no_agent (15.015 s) : 15015000, 15015000
. : milestone, 15015000,
appsec (15.346 s) : 15346000, 15346000
. : milestone, 15346000,
iast (18.87 s) : 18870000, 18870000
. : milestone, 18870000,
iast_GLOBAL (17.769 s) : 17769000, 17769000
. : milestone, 17769000,
profiling (15.55 s) : 15550000, 15550000
. : milestone, 15550000,
tracing (15.075 s) : 15075000, 15075000
. : milestone, 15075000,
section candidate
no_agent (15.033 s) : 15033000, 15033000
. : milestone, 15033000,
appsec (14.941 s) : 14941000, 14941000
. : milestone, 14941000,
iast (18.724 s) : 18724000, 18724000
. : milestone, 18724000,
iast_GLOBAL (17.846 s) : 17846000, 17846000
. : milestone, 17846000,
profiling (15.049 s) : 15049000, 15049000
. : milestone, 15049000,
tracing (14.914 s) : 14914000, 14914000
. : milestone, 14914000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
dateFormat X
axisFormat %s
section baseline
no_agent (1.463 ms) : 1451, 1474
. : milestone, 1463,
appsec (2.215 ms) : 2180, 2250
. : milestone, 2215,
iast (1.971 ms) : 1928, 2013
. : milestone, 1971,
iast_GLOBAL (2.001 ms) : 1959, 2044
. : milestone, 2001,
profiling (1.859 ms) : 1823, 1895
. : milestone, 1859,
tracing (1.831 ms) : 1798, 1863
. : milestone, 1831,
section candidate
no_agent (1.447 ms) : 1436, 1459
. : milestone, 1447,
appsec (2.215 ms) : 2179, 2250
. : milestone, 2215,
iast (1.966 ms) : 1924, 2008
. : milestone, 1966,
iast_GLOBAL (2.011 ms) : 1968, 2055
. : milestone, 2011,
profiling (1.847 ms) : 1812, 1882
. : milestone, 1847,
tracing (1.83 ms) : 1797, 1863
. : milestone, 1830,
|
jandro996
approved these changes
Aug 5, 2024
nayeem-kamal
added
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
labels
Aug 5, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Fix the checkSmoke pipeline by correcting a test
Motivation
Make green the checkSmoke
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]