-
Notifications
You must be signed in to change notification settings - Fork 288
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add separate test suite for Avro for java 8 #7393
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nayeem-kamal
added
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
labels
Aug 6, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.546 s) : 0, 1546115
Total [baseline] (14.247 s) : 0, 14246794
Agent [candidate] (1.547 s) : 0, 1546774
Total [candidate] (14.324 s) : 0, 14324074
section appsec
Agent [baseline] (1.732 s) : 0, 1732130
Total [baseline] (14.427 s) : 0, 14427248
Agent [candidate] (1.73 s) : 0, 1729882
Total [candidate] (14.412 s) : 0, 14411950
section iast
Agent [baseline] (1.729 s) : 0, 1729290
Total [baseline] (14.825 s) : 0, 14824674
Agent [candidate] (1.724 s) : 0, 1723946
Total [candidate] (14.965 s) : 0, 14964613
section profiling
Agent [baseline] (1.862 s) : 0, 1862041
Total [baseline] (14.701 s) : 0, 14701133
Agent [candidate] (1.861 s) : 0, 1861155
Total [candidate] (14.675 s) : 0, 14674970
gantt
title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (992.24 ms) : 0, 992240
BytebuddyAgent [candidate] (991.581 ms) : 0, 991581
GlobalTracer [baseline] (452.801 ms) : 0, 452801
GlobalTracer [candidate] (453.838 ms) : 0, 453838
AppSec [baseline] (70.747 ms) : 0, 70747
AppSec [candidate] (70.899 ms) : 0, 70899
Remote Config [baseline] (841.389 µs) : 0, 841
Remote Config [candidate] (851.815 µs) : 0, 852
Telemetry [baseline] (9.527 ms) : 0, 9527
Telemetry [candidate] (9.573 ms) : 0, 9573
section appsec
BytebuddyAgent [baseline] (1.009 s) : 0, 1008785
BytebuddyAgent [candidate] (1.007 s) : 0, 1007183
GlobalTracer [baseline] (446.614 ms) : 0, 446614
GlobalTracer [candidate] (445.384 ms) : 0, 445384
AppSec [baseline] (233.248 ms) : 0, 233248
AppSec [candidate] (233.031 ms) : 0, 233031
IAST [baseline] (25.158 ms) : 0, 25158
IAST [candidate] (26.71 ms) : 0, 26710
Remote Config [baseline] (772.028 µs) : 0, 772
Remote Config [candidate] (760.845 µs) : 0, 761
Telemetry [baseline] (10.115 ms) : 0, 10115
Telemetry [candidate] (10.092 ms) : 0, 10092
section iast
BytebuddyAgent [baseline] (1.162 s) : 0, 1162024
BytebuddyAgent [candidate] (1.157 s) : 0, 1156557
GlobalTracer [baseline] (437.005 ms) : 0, 437005
GlobalTracer [candidate] (435.1 ms) : 0, 435100
AppSec [baseline] (70.365 ms) : 0, 70365
AppSec [candidate] (74.017 ms) : 0, 74017
IAST [baseline] (29.705 ms) : 0, 29705
IAST [candidate] (28.271 ms) : 0, 28271
Remote Config [baseline] (762.936 µs) : 0, 763
Remote Config [candidate] (731.425 µs) : 0, 731
Telemetry [baseline] (9.279 ms) : 0, 9279
Telemetry [candidate] (9.093 ms) : 0, 9093
section profiling
BytebuddyAgent [baseline] (987.075 ms) : 0, 987075
BytebuddyAgent [candidate] (985.391 ms) : 0, 985391
GlobalTracer [baseline] (585.757 ms) : 0, 585757
GlobalTracer [candidate] (584.815 ms) : 0, 584815
AppSec [baseline] (72.409 ms) : 0, 72409
AppSec [candidate] (72.377 ms) : 0, 72377
Remote Config [baseline] (930.371 µs) : 0, 930
Remote Config [candidate] (938.889 µs) : 0, 939
Telemetry [baseline] (9.326 ms) : 0, 9326
Telemetry [candidate] (9.271 ms) : 0, 9271
ProfilingAgent [baseline] (150.656 ms) : 0, 150656
ProfilingAgent [candidate] (152.503 ms) : 0, 152503
Profiling [baseline] (150.736 ms) : 0, 150736
Profiling [candidate] (152.574 ms) : 0, 152574
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.547 s) : 0, 1547020
Total [baseline] (11.802 s) : 0, 11801989
Agent [candidate] (1.55 s) : 0, 1549793
Total [candidate] (11.836 s) : 0, 11835723
section iast
Agent [baseline] (1.718 s) : 0, 1718172
Total [baseline] (12.524 s) : 0, 12523603
Agent [candidate] (1.717 s) : 0, 1717150
Total [candidate] (12.488 s) : 0, 12487901
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.718 s) : 0, 1718446
Total [baseline] (12.426 s) : 0, 12425979
Agent [candidate] (1.713 s) : 0, 1713238
Total [candidate] (12.448 s) : 0, 12447883
section iast_TELEMETRY_OFF
Agent [baseline] (1.717 s) : 0, 1717415
Total [baseline] (12.472 s) : 0, 12472014
Agent [candidate] (1.712 s) : 0, 1711519
Total [candidate] (12.456 s) : 0, 12456403
gantt
title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.933 ms) : 0, 991933
BytebuddyAgent [candidate] (994.082 ms) : 0, 994082
GlobalTracer [baseline] (453.706 ms) : 0, 453706
GlobalTracer [candidate] (453.98 ms) : 0, 453980
AppSec [baseline] (70.963 ms) : 0, 70963
AppSec [candidate] (71.176 ms) : 0, 71176
Remote Config [baseline] (845.056 µs) : 0, 845
Remote Config [candidate] (857.989 µs) : 0, 858
Telemetry [baseline] (9.611 ms) : 0, 9611
Telemetry [candidate] (9.618 ms) : 0, 9618
section iast
BytebuddyAgent [baseline] (1.153 s) : 0, 1153450
BytebuddyAgent [candidate] (1.152 s) : 0, 1151775
GlobalTracer [baseline] (434.36 ms) : 0, 434360
GlobalTracer [candidate] (434.064 ms) : 0, 434064
AppSec [baseline] (73.295 ms) : 0, 73295
AppSec [candidate] (71.693 ms) : 0, 71693
IAST [baseline] (27.237 ms) : 0, 27237
IAST [candidate] (29.721 ms) : 0, 29721
Remote Config [baseline] (728.834 µs) : 0, 729
Remote Config [candidate] (814.146 µs) : 0, 814
Telemetry [baseline] (9.075 ms) : 0, 9075
Telemetry [candidate] (9.007 ms) : 0, 9007
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.154 s) : 0, 1153502
BytebuddyAgent [candidate] (1.151 s) : 0, 1150634
GlobalTracer [baseline] (434.977 ms) : 0, 434977
GlobalTracer [candidate] (434.709 ms) : 0, 434709
AppSec [baseline] (69.877 ms) : 0, 69877
AppSec [candidate] (68.685 ms) : 0, 68685
IAST [baseline] (30.138 ms) : 0, 30138
IAST [candidate] (29.171 ms) : 0, 29171
Remote Config [baseline] (743.724 µs) : 0, 744
Remote Config [candidate] (737.073 µs) : 0, 737
Telemetry [baseline] (9.079 ms) : 0, 9079
Telemetry [candidate] (9.14 ms) : 0, 9140
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.152 s) : 0, 1152481
BytebuddyAgent [candidate] (1.148 s) : 0, 1147846
GlobalTracer [baseline] (435.208 ms) : 0, 435208
GlobalTracer [candidate] (434.429 ms) : 0, 434429
AppSec [baseline] (68.234 ms) : 0, 68234
AppSec [candidate] (67.053 ms) : 0, 67053
IAST [baseline] (30.703 ms) : 0, 30703
IAST [candidate] (31.268 ms) : 0, 31268
Remote Config [baseline] (791.802 µs) : 0, 792
Remote Config [candidate] (777.205 µs) : 0, 777
Telemetry [baseline] (9.858 ms) : 0, 9858
Telemetry [candidate] (9.961 ms) : 0, 9961
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section baseline
no_agent (364.743 µs) : 345, 385
. : milestone, 365,
iast (483.747 µs) : 462, 505
. : milestone, 484,
iast_FULL (549.46 µs) : 528, 571
. : milestone, 549,
iast_GLOBAL (504.072 µs) : 483, 525
. : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (484.355 µs) : 463, 506
. : milestone, 484,
iast_INACTIVE (454.297 µs) : 432, 476
. : milestone, 454,
iast_TELEMETRY_OFF (471.567 µs) : 450, 493
. : milestone, 472,
tracing (442.98 µs) : 422, 464
. : milestone, 443,
section candidate
no_agent (366.108 µs) : 346, 386
. : milestone, 366,
iast (494.104 µs) : 473, 516
. : milestone, 494,
iast_FULL (558.941 µs) : 538, 580
. : milestone, 559,
iast_GLOBAL (507.991 µs) : 487, 529
. : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (485.673 µs) : 465, 507
. : milestone, 486,
iast_INACTIVE (458.512 µs) : 437, 481
. : milestone, 459,
iast_TELEMETRY_OFF (482.169 µs) : 459, 505
. : milestone, 482,
tracing (442.72 µs) : 422, 463
. : milestone, 443,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section baseline
no_agent (1.344 ms) : 1325, 1363
. : milestone, 1344,
appsec (1.728 ms) : 1705, 1752
. : milestone, 1728,
appsec_no_iast (1.721 ms) : 1697, 1744
. : milestone, 1721,
iast (1.469 ms) : 1447, 1491
. : milestone, 1469,
profiling (1.476 ms) : 1451, 1501
. : milestone, 1476,
tracing (1.468 ms) : 1443, 1492
. : milestone, 1468,
section candidate
no_agent (1.348 ms) : 1329, 1367
. : milestone, 1348,
appsec (1.725 ms) : 1700, 1749
. : milestone, 1725,
appsec_no_iast (1.705 ms) : 1681, 1730
. : milestone, 1705,
iast (1.477 ms) : 1455, 1499
. : milestone, 1477,
profiling (1.535 ms) : 1510, 1561
. : milestone, 1535,
tracing (1.449 ms) : 1425, 1474
. : milestone, 1449,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section baseline
no_agent (1.456 ms) : 1444, 1467
. : milestone, 1456,
appsec (2.205 ms) : 2171, 2240
. : milestone, 2205,
iast (1.953 ms) : 1911, 1994
. : milestone, 1953,
iast_GLOBAL (2.018 ms) : 1975, 2061
. : milestone, 2018,
profiling (1.853 ms) : 1819, 1887
. : milestone, 1853,
tracing (1.837 ms) : 1803, 1870
. : milestone, 1837,
section candidate
no_agent (1.458 ms) : 1446, 1469
. : milestone, 1458,
appsec (2.219 ms) : 2184, 2254
. : milestone, 2219,
iast (1.968 ms) : 1927, 2010
. : milestone, 1968,
iast_GLOBAL (2.009 ms) : 1966, 2051
. : milestone, 2009,
profiling (1.863 ms) : 1829, 1897
. : milestone, 1863,
tracing (1.829 ms) : 1797, 1862
. : milestone, 1829,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
dateFormat X
axisFormat %s
section baseline
no_agent (15.145 s) : 15145000, 15145000
. : milestone, 15145000,
appsec (15.1 s) : 15100000, 15100000
. : milestone, 15100000,
iast (18.915 s) : 18915000, 18915000
. : milestone, 18915000,
iast_GLOBAL (18.111 s) : 18111000, 18111000
. : milestone, 18111000,
profiling (15.42 s) : 15420000, 15420000
. : milestone, 15420000,
tracing (15.127 s) : 15127000, 15127000
. : milestone, 15127000,
section candidate
no_agent (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
appsec (15.185 s) : 15185000, 15185000
. : milestone, 15185000,
iast (18.681 s) : 18681000, 18681000
. : milestone, 18681000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
. : milestone, 17938000,
profiling (15.211 s) : 15211000, 15211000
. : milestone, 15211000,
tracing (14.918 s) : 14918000, 14918000
. : milestone, 14918000,
|
amarziali
approved these changes
Aug 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Creates a separate test suite for Java 8 for Avro because there are class version errors after version 1.11.3 of Avro.
Motivation
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]