Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test branch #7203

Closed
wants to merge 1 commit into from
Closed

Test branch #7203

wants to merge 1 commit into from

Conversation

nenadnoveljic
Copy link

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Jun 17, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb 255b6a2
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718612941 1718612941
ci_job_id 544734802 544734802
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 52 metrics, 18 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Logs Intake worse
[+23.869µs; +55.371µs] or [+7.055%; +16.366%]		 377.950µs 338.330µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1073436
Total [baseline] (10.349 s) : 0, 10349268
Agent [candidate] (1.066 s) : 0, 1065779
Total [candidate] (10.47 s) : 0, 10469960
section appsec
Agent [baseline] (1.185 s) : 0, 1184781
Total [baseline] (10.458 s) : 0, 10458229
Agent [candidate] (1.183 s) : 0, 1182652
Total [candidate] (10.446 s) : 0, 10446416
section iast
Agent [baseline] (1.172 s) : 0, 1171788
Total [baseline] (10.727 s) : 0, 10727155
Agent [candidate] (1.175 s) : 0, 1174966
Total [candidate] (10.687 s) : 0, 10686910
section profiling
Agent [baseline] (1.26 s) : 0, 1260496
Total [baseline] (10.623 s) : 0, 10623165
Agent [candidate] (1.26 s) : 0, 1260491
Total [candidate] (10.614 s) : 0, 10613634
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.185 s 111.345 ms (10.4%)
Agent iast 1.172 s 98.352 ms (9.2%)
Agent profiling 1.26 s 187.06 ms (17.4%)
Total tracing 10.349 s -
Total appsec 10.458 s 108.961 ms (1.1%)
Total iast 10.727 s 377.887 ms (3.7%)
Total profiling 10.623 s 273.897 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.183 s 116.873 ms (11.0%)
Agent iast 1.175 s 109.187 ms (10.2%)
Agent profiling 1.26 s 194.712 ms (18.3%)
Total tracing 10.47 s -
Total appsec 10.446 s -23.545 ms (-0.2%)
Total iast 10.687 s 216.949 ms (2.1%)
Total profiling 10.614 s 143.673 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.709 ms) : 0, 673709
BytebuddyAgent [candidate] (666.743 ms) : 0, 666743
GlobalTracer [baseline] (305.857 ms) : 0, 305857
GlobalTracer [candidate] (305.659 ms) : 0, 305659
AppSec [baseline] (50.489 ms) : 0, 50489
AppSec [candidate] (50.29 ms) : 0, 50290
Logs Intake [baseline] (339.084 µs) : 0, 339
Logs Intake [candidate] (411.183 µs) : 0, 411
Remote Config [baseline] (673.318 µs) : 0, 673
Remote Config [candidate] (672.915 µs) : 0, 673
Telemetry [baseline] (7.605 ms) : 0, 7605
Telemetry [candidate] (7.617 ms) : 0, 7617
section appsec
BytebuddyAgent [baseline] (677.273 ms) : 0, 677273
BytebuddyAgent [candidate] (677.905 ms) : 0, 677905
GlobalTracer [baseline] (297.141 ms) : 0, 297141
GlobalTracer [candidate] (297.529 ms) : 0, 297529
AppSec [baseline] (154.285 ms) : 0, 154285
AppSec [candidate] (153.115 ms) : 0, 153115
Logs Intake [baseline] (327.891 µs) : 0, 328
Logs Intake [candidate] (320.565 µs) : 0, 321
Remote Config [baseline] (639.26 µs) : 0, 639
Remote Config [candidate] (653.818 µs) : 0, 654
Telemetry [baseline] (9.092 ms) : 0, 9092
Telemetry [candidate] (7.542 ms) : 0, 7542
IAST [baseline] (23.13 ms) : 0, 23130
IAST [candidate] (22.23 ms) : 0, 22230
section iast
BytebuddyAgent [baseline] (780.669 ms) : 0, 780669
BytebuddyAgent [candidate] (785.357 ms) : 0, 785357
GlobalTracer [baseline] (295.05 ms) : 0, 295050
GlobalTracer [candidate] (293.657 ms) : 0, 293657
AppSec [baseline] (47.491 ms) : 0, 47491
AppSec [candidate] (46.826 ms) : 0, 46826
Logs Intake [baseline] (321.113 µs) : 0, 321
Logs Intake [candidate] (306.248 µs) : 0, 306
Remote Config [baseline] (624.659 µs) : 0, 625
Remote Config [candidate] (577.057 µs) : 0, 577
Telemetry [baseline] (9.237 ms) : 0, 9237
Telemetry [candidate] (9.322 ms) : 0, 9322
IAST [baseline] (25.142 ms) : 0, 25142
IAST [candidate] (25.548 ms) : 0, 25548
section profiling
ProfilingAgent [baseline] (95.919 ms) : 0, 95919
ProfilingAgent [candidate] (96.703 ms) : 0, 96703
BytebuddyAgent [baseline] (662.433 ms) : 0, 662433
BytebuddyAgent [candidate] (662.468 ms) : 0, 662468
GlobalTracer [baseline] (385.463 ms) : 0, 385463
GlobalTracer [candidate] (385.193 ms) : 0, 385193
AppSec [baseline] (51.485 ms) : 0, 51485
AppSec [candidate] (50.742 ms) : 0, 50742
Logs Intake [baseline] (345.163 µs) : 0, 345
Logs Intake [candidate] (333.843 µs) : 0, 334
Remote Config [baseline] (708.623 µs) : 0, 709
Remote Config [candidate] (736.727 µs) : 0, 737
Telemetry [baseline] (7.357 ms) : 0, 7357
Telemetry [candidate] (7.316 ms) : 0, 7316
Profiling [baseline] (95.943 ms) : 0, 95943
Profiling [candidate] (96.729 ms) : 0, 96729
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064229
Total [baseline] (8.549 s) : 0, 8549308
Agent [candidate] (1.062 s) : 0, 1062401
Total [candidate] (8.558 s) : 0, 8557690
section iast
Agent [baseline] (1.173 s) : 0, 1172920
Total [baseline] (8.986 s) : 0, 8985761
Agent [candidate] (1.17 s) : 0, 1170139
Total [candidate] (9.038 s) : 0, 9037860
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1171770
Total [baseline] (8.957 s) : 0, 8957324
Agent [candidate] (1.165 s) : 0, 1165261
Total [candidate] (8.976 s) : 0, 8976479
section iast_TELEMETRY_OFF
Agent [baseline] (1.167 s) : 0, 1166926
Total [baseline] (9.014 s) : 0, 9013996
Agent [candidate] (1.163 s) : 0, 1163397
Total [candidate] (8.968 s) : 0, 8968457
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.173 s 108.691 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 107.54 ms (10.1%)
Agent iast_TELEMETRY_OFF 1.167 s 102.696 ms (9.6%)
Total tracing 8.549 s -
Total iast 8.986 s 436.453 ms (5.1%)
Total iast_HARDCODED_SECRET_DISABLED 8.957 s 408.017 ms (4.8%)
Total iast_TELEMETRY_OFF 9.014 s 464.688 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.17 s 107.738 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.165 s 102.861 ms (9.7%)
Agent iast_TELEMETRY_OFF 1.163 s 100.997 ms (9.5%)
Total tracing 8.558 s -
Total iast 9.038 s 480.171 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 8.976 s 418.79 ms (4.9%)
Total iast_TELEMETRY_OFF 8.968 s 410.767 ms (4.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.791 ms) : 0, 666791
BytebuddyAgent [candidate] (665.679 ms) : 0, 665679
GlobalTracer [baseline] (303.863 ms) : 0, 303863
GlobalTracer [candidate] (303.565 ms) : 0, 303565
AppSec [baseline] (50.458 ms) : 0, 50458
AppSec [candidate] (50.104 ms) : 0, 50104
Logs Intake [baseline] (338.33 µs) : 0, 338
Logs Intake [candidate] (377.95 µs) : 0, 378
Remote Config [baseline] (672.508 µs) : 0, 673
Remote Config [candidate] (688.157 µs) : 0, 688
Telemetry [baseline] (7.544 ms) : 0, 7544
Telemetry [candidate] (7.495 ms) : 0, 7495
section iast
BytebuddyAgent [baseline] (784.059 ms) : 0, 784059
BytebuddyAgent [candidate] (779.651 ms) : 0, 779651
GlobalTracer [baseline] (292.973 ms) : 0, 292973
GlobalTracer [candidate] (293.767 ms) : 0, 293767
AppSec [baseline] (47.042 ms) : 0, 47042
AppSec [candidate] (46.823 ms) : 0, 46823
IAST [baseline] (27.649 ms) : 0, 27649
IAST [candidate] (27.249 ms) : 0, 27249
Logs Intake [baseline] (310.948 µs) : 0, 311
Logs Intake [candidate] (301.472 µs) : 0, 301
Remote Config [baseline] (593.227 µs) : 0, 593
Remote Config [candidate] (573.628 µs) : 0, 574
Telemetry [baseline] (6.911 ms) : 0, 6911
Telemetry [candidate] (8.438 ms) : 0, 8438
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.213 ms) : 0, 780213
BytebuddyAgent [candidate] (776.796 ms) : 0, 776796
GlobalTracer [baseline] (293.843 ms) : 0, 293843
GlobalTracer [candidate] (292.448 ms) : 0, 292448
AppSec [baseline] (47.406 ms) : 0, 47406
AppSec [candidate] (46.306 ms) : 0, 46306
IAST [baseline] (28.295 ms) : 0, 28295
IAST [candidate] (26.289 ms) : 0, 26289
Logs Intake [baseline] (301.012 µs) : 0, 301
Logs Intake [candidate] (308.563 µs) : 0, 309
Remote Config [baseline] (577.232 µs) : 0, 577
Remote Config [candidate] (570.594 µs) : 0, 571
Telemetry [baseline] (7.751 ms) : 0, 7751
Telemetry [candidate] (9.215 ms) : 0, 9215
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.427 ms) : 0, 777427
BytebuddyAgent [candidate] (776.354 ms) : 0, 776354
GlobalTracer [baseline] (293.576 ms) : 0, 293576
GlobalTracer [candidate] (293.268 ms) : 0, 293268
AppSec [baseline] (47.242 ms) : 0, 47242
AppSec [candidate] (50.143 ms) : 0, 50143
IAST [baseline] (27.531 ms) : 0, 27531
IAST [candidate] (21.825 ms) : 0, 21825
Logs Intake [baseline] (300.175 µs) : 0, 300
Logs Intake [candidate] (302.253 µs) : 0, 302
Remote Config [baseline] (576.067 µs) : 0, 576
Remote Config [candidate] (569.254 µs) : 0, 569
Telemetry [baseline] (6.907 ms) : 0, 6907
Telemetry [candidate] (7.575 ms) : 0, 7575
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-17T07:59:50 2024-06-17T08:06:40
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb 255b6a2
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
start_time 2024-06-17T07:59:36 2024-06-17T08:06:26
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718611946 1718611946
ci_job_id 544734803 544734803
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.763 µs) : 349, 388
.   : milestone, 369,
iast (485.978 µs) : 465, 507
.   : milestone, 486,
iast_FULL (551.258 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (503.161 µs) : 482, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (484.95 µs) : 464, 506
.   : milestone, 485,
iast_INACTIVE (456.261 µs) : 434, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (472.828 µs) : 452, 494
.   : milestone, 473,
tracing (445.931 µs) : 425, 467
.   : milestone, 446,
section candidate
no_agent (377.22 µs) : 357, 397
.   : milestone, 377,
iast (481.992 µs) : 461, 503
.   : milestone, 482,
iast_FULL (552.299 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (509.011 µs) : 487, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (485.776 µs) : 464, 507
.   : milestone, 486,
iast_INACTIVE (453.169 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (475.194 µs) : 454, 497
.   : milestone, 475,
tracing (442.774 µs) : 422, 464
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.763 µs [349.299 µs, 388.227 µs] -
iast 485.978 µs [464.93 µs, 507.026 µs] 117.215 µs (31.8%)
iast_FULL 551.258 µs [530.04 µs, 572.477 µs] 182.496 µs (49.5%)
iast_GLOBAL 503.161 µs [482.033 µs, 524.289 µs] 134.398 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 484.95 µs [463.718 µs, 506.182 µs] 116.187 µs (31.5%)
iast_INACTIVE 456.261 µs [434.492 µs, 478.029 µs] 87.498 µs (23.7%)
iast_TELEMETRY_OFF 472.828 µs [451.536 µs, 494.121 µs] 104.065 µs (28.2%)
tracing 445.931 µs [424.667 µs, 467.195 µs] 77.168 µs (20.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.22 µs [357.116 µs, 397.323 µs] -
iast 481.992 µs [460.677 µs, 503.307 µs] 104.773 µs (27.8%)
iast_FULL 552.299 µs [531.157 µs, 573.441 µs] 175.079 µs (46.4%)
iast_GLOBAL 509.011 µs [486.921 µs, 531.101 µs] 131.792 µs (34.9%)
iast_HARDCODED_SECRET_DISABLED 485.776 µs [464.35 µs, 507.203 µs] 108.557 µs (28.8%)
iast_INACTIVE 453.169 µs [431.955 µs, 474.383 µs] 75.949 µs (20.1%)
iast_TELEMETRY_OFF 475.194 µs [453.614 µs, 496.774 µs] 97.975 µs (26.0%)
tracing 442.774 µs [421.982 µs, 463.566 µs] 65.554 µs (17.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1371
.   : milestone, 1352,
appsec (1.723 ms) : 1699, 1748
.   : milestone, 1723,
appsec_no_iast (1.7 ms) : 1675, 1726
.   : milestone, 1700,
iast (1.463 ms) : 1441, 1486
.   : milestone, 1463,
profiling (1.552 ms) : 1527, 1577
.   : milestone, 1552,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
section candidate
no_agent (1.35 ms) : 1331, 1370
.   : milestone, 1350,
appsec (1.706 ms) : 1681, 1731
.   : milestone, 1706,
appsec_no_iast (1.732 ms) : 1707, 1756
.   : milestone, 1732,
iast (1.494 ms) : 1469, 1518
.   : milestone, 1494,
profiling (1.561 ms) : 1536, 1586
.   : milestone, 1561,
tracing (1.484 ms) : 1461, 1508
.   : milestone, 1484,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.371 ms] -
appsec 1.723 ms [1.699 ms, 1.748 ms] 370.968 µs (27.4%)
appsec_no_iast 1.7 ms [1.675 ms, 1.726 ms] 348.083 µs (25.7%)
iast 1.463 ms [1.441 ms, 1.486 ms] 111.121 µs (8.2%)
profiling 1.552 ms [1.527 ms, 1.577 ms] 199.733 µs (14.8%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 120.733 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.37 ms] -
appsec 1.706 ms [1.681 ms, 1.731 ms] 355.488 µs (26.3%)
appsec_no_iast 1.732 ms [1.707 ms, 1.756 ms] 381.412 µs (28.3%)
iast 1.494 ms [1.469 ms, 1.518 ms] 143.388 µs (10.6%)
profiling 1.561 ms [1.536 ms, 1.586 ms] 210.978 µs (15.6%)
tracing 1.484 ms [1.461 ms, 1.508 ms] 134.096 µs (9.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb 255b6a2
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718612443 1718612443
ci_job_id 544734804 544734804
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.433 s) : 15433000, 15433000
.   : milestone, 15433000,
appsec (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
iast (18.786 s) : 18786000, 18786000
.   : milestone, 18786000,
iast_GLOBAL (18.05 s) : 18050000, 18050000
.   : milestone, 18050000,
profiling (15.72 s) : 15720000, 15720000
.   : milestone, 15720000,
tracing (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
section candidate
no_agent (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
appsec (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
iast (18.767 s) : 18767000, 18767000
.   : milestone, 18767000,
iast_GLOBAL (17.822 s) : 17822000, 17822000
.   : milestone, 17822000,
profiling (15.697 s) : 15697000, 15697000
.   : milestone, 15697000,
tracing (15.192 s) : 15192000, 15192000
.   : milestone, 15192000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.433 s [15.433 s, 15.433 s] -
appsec 15.177 s [15.177 s, 15.177 s] -256.0 ms (-1.7%)
iast 18.786 s [18.786 s, 18.786 s] 3.353 s (21.7%)
iast_GLOBAL 18.05 s [18.05 s, 18.05 s] 2.617 s (17.0%)
profiling 15.72 s [15.72 s, 15.72 s] 287.0 ms (1.9%)
tracing 15.036 s [15.036 s, 15.036 s] -397.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.945 s [14.945 s, 14.945 s] -
appsec 14.805 s [14.805 s, 14.805 s] -140.0 ms (-0.9%)
iast 18.767 s [18.767 s, 18.767 s] 3.822 s (25.6%)
iast_GLOBAL 17.822 s [17.822 s, 17.822 s] 2.877 s (19.3%)
profiling 15.697 s [15.697 s, 15.697 s] 752.0 ms (5.0%)
tracing 15.192 s [15.192 s, 15.192 s] 247.0 ms (1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.454 ms) : 1442, 1465
.   : milestone, 1454,
appsec (2.194 ms) : 2160, 2228
.   : milestone, 2194,
iast (1.959 ms) : 1918, 2001
.   : milestone, 1959,
iast_GLOBAL (2.001 ms) : 1960, 2043
.   : milestone, 2001,
profiling (1.847 ms) : 1814, 1880
.   : milestone, 1847,
tracing (1.818 ms) : 1786, 1849
.   : milestone, 1818,
section candidate
no_agent (1.461 ms) : 1450, 1472
.   : milestone, 1461,
appsec (2.193 ms) : 2159, 2227
.   : milestone, 2193,
iast (1.956 ms) : 1915, 1997
.   : milestone, 1956,
iast_GLOBAL (1.978 ms) : 1938, 2018
.   : milestone, 1978,
profiling (1.856 ms) : 1822, 1890
.   : milestone, 1856,
tracing (1.828 ms) : 1796, 1860
.   : milestone, 1828,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.454 ms [1.442 ms, 1.465 ms] -
appsec 2.194 ms [2.16 ms, 2.228 ms] 740.102 µs (50.9%)
iast 1.959 ms [1.918 ms, 2.001 ms] 505.406 µs (34.8%)
iast_GLOBAL 2.001 ms [1.96 ms, 2.043 ms] 547.35 µs (37.7%)
profiling 1.847 ms [1.814 ms, 1.88 ms] 393.663 µs (27.1%)
tracing 1.818 ms [1.786 ms, 1.849 ms] 363.791 µs (25.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.45 ms, 1.472 ms] -
appsec 2.193 ms [2.159 ms, 2.227 ms] 731.975 µs (50.1%)
iast 1.956 ms [1.915 ms, 1.997 ms] 494.653 µs (33.9%)
iast_GLOBAL 1.978 ms [1.938 ms, 2.018 ms] 517.192 µs (35.4%)
profiling 1.856 ms [1.822 ms, 1.89 ms] 395.073 µs (27.0%)
tracing 1.828 ms [1.796 ms, 1.86 ms] 367.222 µs (25.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@nenadnoveljic