Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add separate test suite for Avro for java 8 #7393

Merged
merged 1 commit into from
Aug 7, 2024
Merged

Add separate test suite for Avro for java 8 #7393

merged 1 commit into from
Aug 7, 2024

Conversation

nayeem-kamal
Copy link
Contributor

@nayeem-kamal nayeem-kamal commented Aug 6, 2024 •
edited
Loading

What Does This Do

Creates a separate test suite for Java 8 for Avro because there are class version errors after version 1.11.3 of Avro.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nayeem-kamal nayeem-kamal added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 6, 2024
@nayeem-kamal nayeem-kamal requested a review from a team as a code owner August 6, 2024 17:32
@pr-commenter
Copy link

pr-commenter bot commented Aug 6, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/avro-test-fix-2
git_commit_date 1722960232 1722965311
git_commit_sha 42eee08 c5dbdd8
release_version 1.39.0-SNAPSHOT~42eee0817d 1.39.0-SNAPSHOT~c5dbdd8cab
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722968431 1722968431
ci_job_id 596458593 596458593
ci_pipeline_id 41030552 41030552
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.546 s) : 0, 1546115
Total [baseline] (14.247 s) : 0, 14246794
Agent [candidate] (1.547 s) : 0, 1546774
Total [candidate] (14.324 s) : 0, 14324074
section appsec
Agent [baseline] (1.732 s) : 0, 1732130
Total [baseline] (14.427 s) : 0, 14427248
Agent [candidate] (1.73 s) : 0, 1729882
Total [candidate] (14.412 s) : 0, 14411950
section iast
Agent [baseline] (1.729 s) : 0, 1729290
Total [baseline] (14.825 s) : 0, 14824674
Agent [candidate] (1.724 s) : 0, 1723946
Total [candidate] (14.965 s) : 0, 14964613
section profiling
Agent [baseline] (1.862 s) : 0, 1862041
Total [baseline] (14.701 s) : 0, 14701133
Agent [candidate] (1.861 s) : 0, 1861155
Total [candidate] (14.675 s) : 0, 14674970
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.546 s -
Agent appsec 1.732 s 186.015 ms (12.0%)
Agent iast 1.729 s 183.174 ms (11.8%)
Agent profiling 1.862 s 315.926 ms (20.4%)
Total tracing 14.247 s -
Total appsec 14.427 s 180.454 ms (1.3%)
Total iast 14.825 s 577.88 ms (4.1%)
Total profiling 14.701 s 454.339 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.547 s -
Agent appsec 1.73 s 183.108 ms (11.8%)
Agent iast 1.724 s 177.172 ms (11.5%)
Agent profiling 1.861 s 314.381 ms (20.3%)
Total tracing 14.324 s -
Total appsec 14.412 s 87.876 ms (0.6%)
Total iast 14.965 s 640.539 ms (4.5%)
Total profiling 14.675 s 350.896 ms (2.4%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (992.24 ms) : 0, 992240
BytebuddyAgent [candidate] (991.581 ms) : 0, 991581
GlobalTracer [baseline] (452.801 ms) : 0, 452801
GlobalTracer [candidate] (453.838 ms) : 0, 453838
AppSec [baseline] (70.747 ms) : 0, 70747
AppSec [candidate] (70.899 ms) : 0, 70899
Remote Config [baseline] (841.389 µs) : 0, 841
Remote Config [candidate] (851.815 µs) : 0, 852
Telemetry [baseline] (9.527 ms) : 0, 9527
Telemetry [candidate] (9.573 ms) : 0, 9573
section appsec
BytebuddyAgent [baseline] (1.009 s) : 0, 1008785
BytebuddyAgent [candidate] (1.007 s) : 0, 1007183
GlobalTracer [baseline] (446.614 ms) : 0, 446614
GlobalTracer [candidate] (445.384 ms) : 0, 445384
AppSec [baseline] (233.248 ms) : 0, 233248
AppSec [candidate] (233.031 ms) : 0, 233031
IAST [baseline] (25.158 ms) : 0, 25158
IAST [candidate] (26.71 ms) : 0, 26710
Remote Config [baseline] (772.028 µs) : 0, 772
Remote Config [candidate] (760.845 µs) : 0, 761
Telemetry [baseline] (10.115 ms) : 0, 10115
Telemetry [candidate] (10.092 ms) : 0, 10092
section iast
BytebuddyAgent [baseline] (1.162 s) : 0, 1162024
BytebuddyAgent [candidate] (1.157 s) : 0, 1156557
GlobalTracer [baseline] (437.005 ms) : 0, 437005
GlobalTracer [candidate] (435.1 ms) : 0, 435100
AppSec [baseline] (70.365 ms) : 0, 70365
AppSec [candidate] (74.017 ms) : 0, 74017
IAST [baseline] (29.705 ms) : 0, 29705
IAST [candidate] (28.271 ms) : 0, 28271
Remote Config [baseline] (762.936 µs) : 0, 763
Remote Config [candidate] (731.425 µs) : 0, 731
Telemetry [baseline] (9.279 ms) : 0, 9279
Telemetry [candidate] (9.093 ms) : 0, 9093
section profiling
BytebuddyAgent [baseline] (987.075 ms) : 0, 987075
BytebuddyAgent [candidate] (985.391 ms) : 0, 985391
GlobalTracer [baseline] (585.757 ms) : 0, 585757
GlobalTracer [candidate] (584.815 ms) : 0, 584815
AppSec [baseline] (72.409 ms) : 0, 72409
AppSec [candidate] (72.377 ms) : 0, 72377
Remote Config [baseline] (930.371 µs) : 0, 930
Remote Config [candidate] (938.889 µs) : 0, 939
Telemetry [baseline] (9.326 ms) : 0, 9326
Telemetry [candidate] (9.271 ms) : 0, 9271
ProfilingAgent [baseline] (150.656 ms) : 0, 150656
ProfilingAgent [candidate] (152.503 ms) : 0, 152503
Profiling [baseline] (150.736 ms) : 0, 150736
Profiling [candidate] (152.574 ms) : 0, 152574
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.547 s) : 0, 1547020
Total [baseline] (11.802 s) : 0, 11801989
Agent [candidate] (1.55 s) : 0, 1549793
Total [candidate] (11.836 s) : 0, 11835723
section iast
Agent [baseline] (1.718 s) : 0, 1718172
Total [baseline] (12.524 s) : 0, 12523603
Agent [candidate] (1.717 s) : 0, 1717150
Total [candidate] (12.488 s) : 0, 12487901
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.718 s) : 0, 1718446
Total [baseline] (12.426 s) : 0, 12425979
Agent [candidate] (1.713 s) : 0, 1713238
Total [candidate] (12.448 s) : 0, 12447883
section iast_TELEMETRY_OFF
Agent [baseline] (1.717 s) : 0, 1717415
Total [baseline] (12.472 s) : 0, 12472014
Agent [candidate] (1.712 s) : 0, 1711519
Total [candidate] (12.456 s) : 0, 12456403
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.547 s -
Agent iast 1.718 s 171.153 ms (11.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.718 s 171.427 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.717 s 170.395 ms (11.0%)
Total tracing 11.802 s -
Total iast 12.524 s 721.614 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 12.426 s 623.99 ms (5.3%)
Total iast_TELEMETRY_OFF 12.472 s 670.025 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.55 s -
Agent iast 1.717 s 167.357 ms (10.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.713 s 163.445 ms (10.5%)
Agent iast_TELEMETRY_OFF 1.712 s 161.726 ms (10.4%)
Total tracing 11.836 s -
Total iast 12.488 s 652.178 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 12.448 s 612.161 ms (5.2%)
Total iast_TELEMETRY_OFF 12.456 s 620.68 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.933 ms) : 0, 991933
BytebuddyAgent [candidate] (994.082 ms) : 0, 994082
GlobalTracer [baseline] (453.706 ms) : 0, 453706
GlobalTracer [candidate] (453.98 ms) : 0, 453980
AppSec [baseline] (70.963 ms) : 0, 70963
AppSec [candidate] (71.176 ms) : 0, 71176
Remote Config [baseline] (845.056 µs) : 0, 845
Remote Config [candidate] (857.989 µs) : 0, 858
Telemetry [baseline] (9.611 ms) : 0, 9611
Telemetry [candidate] (9.618 ms) : 0, 9618
section iast
BytebuddyAgent [baseline] (1.153 s) : 0, 1153450
BytebuddyAgent [candidate] (1.152 s) : 0, 1151775
GlobalTracer [baseline] (434.36 ms) : 0, 434360
GlobalTracer [candidate] (434.064 ms) : 0, 434064
AppSec [baseline] (73.295 ms) : 0, 73295
AppSec [candidate] (71.693 ms) : 0, 71693
IAST [baseline] (27.237 ms) : 0, 27237
IAST [candidate] (29.721 ms) : 0, 29721
Remote Config [baseline] (728.834 µs) : 0, 729
Remote Config [candidate] (814.146 µs) : 0, 814
Telemetry [baseline] (9.075 ms) : 0, 9075
Telemetry [candidate] (9.007 ms) : 0, 9007
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.154 s) : 0, 1153502
BytebuddyAgent [candidate] (1.151 s) : 0, 1150634
GlobalTracer [baseline] (434.977 ms) : 0, 434977
GlobalTracer [candidate] (434.709 ms) : 0, 434709
AppSec [baseline] (69.877 ms) : 0, 69877
AppSec [candidate] (68.685 ms) : 0, 68685
IAST [baseline] (30.138 ms) : 0, 30138
IAST [candidate] (29.171 ms) : 0, 29171
Remote Config [baseline] (743.724 µs) : 0, 744
Remote Config [candidate] (737.073 µs) : 0, 737
Telemetry [baseline] (9.079 ms) : 0, 9079
Telemetry [candidate] (9.14 ms) : 0, 9140
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.152 s) : 0, 1152481
BytebuddyAgent [candidate] (1.148 s) : 0, 1147846
GlobalTracer [baseline] (435.208 ms) : 0, 435208
GlobalTracer [candidate] (434.429 ms) : 0, 434429
AppSec [baseline] (68.234 ms) : 0, 68234
AppSec [candidate] (67.053 ms) : 0, 67053
IAST [baseline] (30.703 ms) : 0, 30703
IAST [candidate] (31.268 ms) : 0, 31268
Remote Config [baseline] (791.802 µs) : 0, 792
Remote Config [candidate] (777.205 µs) : 0, 777
Telemetry [baseline] (9.858 ms) : 0, 9858
Telemetry [candidate] (9.961 ms) : 0, 9961
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-06T17:42:00 2024-08-06T17:48:48
git_branch master nayeem-kamal/avro-test-fix-2
git_commit_date 1722960232 1722965311
git_commit_sha 42eee08 c5dbdd8
release_version 1.39.0-SNAPSHOT~42eee0817d 1.39.0-SNAPSHOT~c5dbdd8cab
start_time 2024-08-06T17:41:46 2024-08-06T17:48:34
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722966875 1722966875
ci_job_id 596458594 596458594
ci_pipeline_id 41030552 41030552
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+32.192µs; +86.128µs] or [+2.181%; +5.834%]		 unstable
[-657.007op/s; +410.854op/s] or [-20.531%; +12.839%]		 1.535ms 3076.923op/s 1.476ms 3200.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.743 µs) : 345, 385
.   : milestone, 365,
iast (483.747 µs) : 462, 505
.   : milestone, 484,
iast_FULL (549.46 µs) : 528, 571
.   : milestone, 549,
iast_GLOBAL (504.072 µs) : 483, 525
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (484.355 µs) : 463, 506
.   : milestone, 484,
iast_INACTIVE (454.297 µs) : 432, 476
.   : milestone, 454,
iast_TELEMETRY_OFF (471.567 µs) : 450, 493
.   : milestone, 472,
tracing (442.98 µs) : 422, 464
.   : milestone, 443,
section candidate
no_agent (366.108 µs) : 346, 386
.   : milestone, 366,
iast (494.104 µs) : 473, 516
.   : milestone, 494,
iast_FULL (558.941 µs) : 538, 580
.   : milestone, 559,
iast_GLOBAL (507.991 µs) : 487, 529
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (485.673 µs) : 465, 507
.   : milestone, 486,
iast_INACTIVE (458.512 µs) : 437, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (482.169 µs) : 459, 505
.   : milestone, 482,
tracing (442.72 µs) : 422, 463
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.743 µs [344.683 µs, 384.802 µs] -
iast 483.747 µs [462.469 µs, 505.025 µs] 119.004 µs (32.6%)
iast_FULL 549.46 µs [528.406 µs, 570.515 µs] 184.718 µs (50.6%)
iast_GLOBAL 504.072 µs [482.949 µs, 525.194 µs] 139.329 µs (38.2%)
iast_HARDCODED_SECRET_DISABLED 484.355 µs [463.107 µs, 505.604 µs] 119.613 µs (32.8%)
iast_INACTIVE 454.297 µs [432.245 µs, 476.35 µs] 89.555 µs (24.6%)
iast_TELEMETRY_OFF 471.567 µs [450.492 µs, 492.642 µs] 106.825 µs (29.3%)
tracing 442.98 µs [422.365 µs, 463.595 µs] 78.238 µs (21.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.108 µs [345.717 µs, 386.498 µs] -
iast 494.104 µs [472.516 µs, 515.691 µs] 127.996 µs (35.0%)
iast_FULL 558.941 µs [537.827 µs, 580.054 µs] 192.833 µs (52.7%)
iast_GLOBAL 507.991 µs [487.016 µs, 528.966 µs] 141.884 µs (38.8%)
iast_HARDCODED_SECRET_DISABLED 485.673 µs [464.52 µs, 506.825 µs] 119.565 µs (32.7%)
iast_INACTIVE 458.512 µs [436.514 µs, 480.511 µs] 92.405 µs (25.2%)
iast_TELEMETRY_OFF 482.169 µs [459.479 µs, 504.859 µs] 116.061 µs (31.7%)
tracing 442.72 µs [422.144 µs, 463.296 µs] 76.612 µs (20.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.344 ms) : 1325, 1363
.   : milestone, 1344,
appsec (1.728 ms) : 1705, 1752
.   : milestone, 1728,
appsec_no_iast (1.721 ms) : 1697, 1744
.   : milestone, 1721,
iast (1.469 ms) : 1447, 1491
.   : milestone, 1469,
profiling (1.476 ms) : 1451, 1501
.   : milestone, 1476,
tracing (1.468 ms) : 1443, 1492
.   : milestone, 1468,
section candidate
no_agent (1.348 ms) : 1329, 1367
.   : milestone, 1348,
appsec (1.725 ms) : 1700, 1749
.   : milestone, 1725,
appsec_no_iast (1.705 ms) : 1681, 1730
.   : milestone, 1705,
iast (1.477 ms) : 1455, 1499
.   : milestone, 1477,
profiling (1.535 ms) : 1510, 1561
.   : milestone, 1535,
tracing (1.449 ms) : 1425, 1474
.   : milestone, 1449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.325 ms, 1.363 ms] -
appsec 1.728 ms [1.705 ms, 1.752 ms] 384.356 µs (28.6%)
appsec_no_iast 1.721 ms [1.697 ms, 1.744 ms] 376.721 µs (28.0%)
iast 1.469 ms [1.447 ms, 1.491 ms] 125.199 µs (9.3%)
profiling 1.476 ms [1.451 ms, 1.501 ms] 132.383 µs (9.9%)
tracing 1.468 ms [1.443 ms, 1.492 ms] 123.711 µs (9.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.329 ms, 1.367 ms] -
appsec 1.725 ms [1.7 ms, 1.749 ms] 376.432 µs (27.9%)
appsec_no_iast 1.705 ms [1.681 ms, 1.73 ms] 356.853 µs (26.5%)
iast 1.477 ms [1.455 ms, 1.499 ms] 128.849 µs (9.6%)
profiling 1.535 ms [1.51 ms, 1.561 ms] 187.067 µs (13.9%)
tracing 1.449 ms [1.425 ms, 1.474 ms] 101.014 µs (7.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/avro-test-fix-2
git_commit_date 1722960232 1722965311
git_commit_sha 42eee08 c5dbdd8
release_version 1.39.0-SNAPSHOT~42eee0817d 1.39.0-SNAPSHOT~c5dbdd8cab
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1722967233 1722967233
ci_job_id 596458595 596458595
ci_pipeline_id 41030552 41030552
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.456 ms) : 1444, 1467
.   : milestone, 1456,
appsec (2.205 ms) : 2171, 2240
.   : milestone, 2205,
iast (1.953 ms) : 1911, 1994
.   : milestone, 1953,
iast_GLOBAL (2.018 ms) : 1975, 2061
.   : milestone, 2018,
profiling (1.853 ms) : 1819, 1887
.   : milestone, 1853,
tracing (1.837 ms) : 1803, 1870
.   : milestone, 1837,
section candidate
no_agent (1.458 ms) : 1446, 1469
.   : milestone, 1458,
appsec (2.219 ms) : 2184, 2254
.   : milestone, 2219,
iast (1.968 ms) : 1927, 2010
.   : milestone, 1968,
iast_GLOBAL (2.009 ms) : 1966, 2051
.   : milestone, 2009,
profiling (1.863 ms) : 1829, 1897
.   : milestone, 1863,
tracing (1.829 ms) : 1797, 1862
.   : milestone, 1829,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.444 ms, 1.467 ms] -
appsec 2.205 ms [2.171 ms, 2.24 ms] 749.714 µs (51.5%)
iast 1.953 ms [1.911 ms, 1.994 ms] 497.116 µs (34.2%)
iast_GLOBAL 2.018 ms [1.975 ms, 2.061 ms] 562.251 µs (38.6%)
profiling 1.853 ms [1.819 ms, 1.887 ms] 397.574 µs (27.3%)
tracing 1.837 ms [1.803 ms, 1.87 ms] 380.956 µs (26.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.458 ms [1.446 ms, 1.469 ms] -
appsec 2.219 ms [2.184 ms, 2.254 ms] 761.242 µs (52.2%)
iast 1.968 ms [1.927 ms, 2.01 ms] 510.484 µs (35.0%)
iast_GLOBAL 2.009 ms [1.966 ms, 2.051 ms] 550.918 µs (37.8%)
profiling 1.863 ms [1.829 ms, 1.897 ms] 405.533 µs (27.8%)
tracing 1.829 ms [1.797 ms, 1.862 ms] 371.801 µs (25.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c5dbdd8cab, baseline=1.39.0-SNAPSHOT~42eee0817d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
appsec (15.1 s) : 15100000, 15100000
.   : milestone, 15100000,
iast (18.915 s) : 18915000, 18915000
.   : milestone, 18915000,
iast_GLOBAL (18.111 s) : 18111000, 18111000
.   : milestone, 18111000,
profiling (15.42 s) : 15420000, 15420000
.   : milestone, 15420000,
tracing (15.127 s) : 15127000, 15127000
.   : milestone, 15127000,
section candidate
no_agent (14.849 s) : 14849000, 14849000
.   : milestone, 14849000,
appsec (15.185 s) : 15185000, 15185000
.   : milestone, 15185000,
iast (18.681 s) : 18681000, 18681000
.   : milestone, 18681000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.211 s) : 15211000, 15211000
.   : milestone, 15211000,
tracing (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.145 s [15.145 s, 15.145 s] -
appsec 15.1 s [15.1 s, 15.1 s] -45.0 ms (-0.3%)
iast 18.915 s [18.915 s, 18.915 s] 3.77 s (24.9%)
iast_GLOBAL 18.111 s [18.111 s, 18.111 s] 2.966 s (19.6%)
profiling 15.42 s [15.42 s, 15.42 s] 275.0 ms (1.8%)
tracing 15.127 s [15.127 s, 15.127 s] -18.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.849 s [14.849 s, 14.849 s] -
appsec 15.185 s [15.185 s, 15.185 s] 336.0 ms (2.3%)
iast 18.681 s [18.681 s, 18.681 s] 3.832 s (25.8%)
iast_GLOBAL 17.938 s [17.938 s, 17.938 s] 3.089 s (20.8%)
profiling 15.211 s [15.211 s, 15.211 s] 362.0 ms (2.4%)
tracing 14.918 s [14.918 s, 14.918 s] 69.0 ms (0.5%)

@nayeem-kamal nayeem-kamal enabled auto-merge (squash) August 7, 2024 22:10
@nayeem-kamal nayeem-kamal merged commit 567c4e9 into master Aug 7, 2024
82 checks passed
@nayeem-kamal nayeem-kamal deleted the nayeem-kamal/avro-test-fix-2 branch August 7, 2024 22:32
@github-actions github-actions bot added this to the 1.39.0 milestone Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@amarziali amarziali amarziali approved these changes

@vandonr vandonr Awaiting requested review from vandonr

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.39.0
Development

Successfully merging this pull request may close these issues.
2 participants
@nayeem-kamal @amarziali