Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix checkSmoke #7384

Merged
merged 1 commit into from
Aug 5, 2024
Merged

Fix checkSmoke #7384

merged 1 commit into from
Aug 5, 2024

Conversation

Mariovido
Copy link
Contributor

What Does This Do

Fix the checkSmoke pipeline by correcting a test

Motivation

Make green the checkSmoke

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@Mariovido Mariovido marked this pull request as ready for review August 5, 2024 10:58
@Mariovido Mariovido requested a review from a team as a code owner August 5, 2024 10:58
@pr-commenter
Copy link

pr-commenter bot commented Aug 5, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/fix_smoke_test_check
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722856560 1722856560
ci_job_id 594442582 594442582
ci_pipeline_id 40885489 40885489
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
git_commit_date 1722850028 1722850028
git_commit_sha e0d4e22 e0d4e22
module Agent Agent
parent None None
release_version 1.38.0-SNAPSHOT~e0d4e2291b 1.38.0-SNAPSHOT~e0d4e2291b
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.548 s) : 0, 1547552
Total [baseline] (11.818 s) : 0, 11817639
Agent [candidate] (1.544 s) : 0, 1544032
Total [candidate] (11.804 s) : 0, 11803895
section iast
Agent [baseline] (1.717 s) : 0, 1717453
Total [baseline] (12.517 s) : 0, 12517071
Agent [candidate] (1.719 s) : 0, 1719292
Total [candidate] (12.558 s) : 0, 12558490
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.716 s) : 0, 1716496
Total [baseline] (12.522 s) : 0, 12521644
Agent [candidate] (1.725 s) : 0, 1725377
Total [candidate] (12.441 s) : 0, 12440538
section iast_TELEMETRY_OFF
Agent [baseline] (1.709 s) : 0, 1708868
Total [baseline] (12.508 s) : 0, 12507679
Agent [candidate] (1.719 s) : 0, 1718576
Total [candidate] (12.474 s) : 0, 12474055
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.548 s -
Agent iast 1.717 s 169.901 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.716 s 168.944 ms (10.9%)
Agent iast_TELEMETRY_OFF 1.709 s 161.316 ms (10.4%)
Total tracing 11.818 s -
Total iast 12.517 s 699.432 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 12.522 s 704.005 ms (6.0%)
Total iast_TELEMETRY_OFF 12.508 s 690.04 ms (5.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.544 s -
Agent iast 1.719 s 175.26 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.725 s 181.345 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.719 s 174.544 ms (11.3%)
Total tracing 11.804 s -
Total iast 12.558 s 754.595 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 12.441 s 636.643 ms (5.4%)
Total iast_TELEMETRY_OFF 12.474 s 670.16 ms (5.7%)
gantt
    title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.316 ms) : 0, 991316
BytebuddyAgent [candidate] (990.135 ms) : 0, 990135
GlobalTracer [baseline] (454.88 ms) : 0, 454880
GlobalTracer [candidate] (452.61 ms) : 0, 452610
AppSec [baseline] (70.986 ms) : 0, 70986
AppSec [candidate] (70.797 ms) : 0, 70797
Remote Config [baseline] (846.288 µs) : 0, 846
Remote Config [candidate] (852.637 µs) : 0, 853
Telemetry [baseline] (9.596 ms) : 0, 9596
Telemetry [candidate] (9.613 ms) : 0, 9613
section iast
BytebuddyAgent [baseline] (1.153 s) : 0, 1152774
BytebuddyAgent [candidate] (1.154 s) : 0, 1154063
GlobalTracer [baseline] (433.297 ms) : 0, 433297
GlobalTracer [candidate] (434.414 ms) : 0, 434414
AppSec [baseline] (73.171 ms) : 0, 73171
AppSec [candidate] (71.866 ms) : 0, 71866
IAST [baseline] (28.254 ms) : 0, 28254
IAST [candidate] (29.064 ms) : 0, 29064
Remote Config [baseline] (807.394 µs) : 0, 807
Remote Config [candidate] (725.56 µs) : 0, 726
Telemetry [baseline] (9.169 ms) : 0, 9169
Telemetry [candidate] (9.045 ms) : 0, 9045
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (1.152 s) : 0, 1151528
BytebuddyAgent [candidate] (1.159 s) : 0, 1158634
GlobalTracer [baseline] (435.02 ms) : 0, 435020
GlobalTracer [candidate] (436.577 ms) : 0, 436577
AppSec [baseline] (71.99 ms) : 0, 71990
AppSec [candidate] (70.094 ms) : 0, 70094
IAST [baseline] (28.136 ms) : 0, 28136
IAST [candidate] (29.706 ms) : 0, 29706
Remote Config [baseline] (717.866 µs) : 0, 718
Remote Config [candidate] (766.917 µs) : 0, 767
Telemetry [baseline] (8.966 ms) : 0, 8966
Telemetry [candidate] (9.306 ms) : 0, 9306
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (1.146 s) : 0, 1146458
BytebuddyAgent [candidate] (1.152 s) : 0, 1151728
GlobalTracer [baseline] (433.825 ms) : 0, 433825
GlobalTracer [candidate] (435.124 ms) : 0, 435124
AppSec [baseline] (67.185 ms) : 0, 67185
AppSec [candidate] (66.754 ms) : 0, 66754
IAST [baseline] (31.532 ms) : 0, 31532
IAST [candidate] (35.052 ms) : 0, 35052
Remote Config [baseline] (771.488 µs) : 0, 771
Remote Config [candidate] (787.73 µs) : 0, 788
Telemetry [baseline] (8.999 ms) : 0, 8999
Telemetry [candidate] (8.953 ms) : 0, 8953
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.546 s) : 0, 1545809
Total [baseline] (14.263 s) : 0, 14262611
Agent [candidate] (1.546 s) : 0, 1546329
Total [candidate] (14.283 s) : 0, 14283420
section appsec
Agent [baseline] (1.735 s) : 0, 1734804
Total [baseline] (14.385 s) : 0, 14385401
Agent [candidate] (1.732 s) : 0, 1732398
Total [candidate] (14.431 s) : 0, 14430921
section iast
Agent [baseline] (1.716 s) : 0, 1716145
Total [baseline] (14.736 s) : 0, 14735933
Agent [candidate] (1.71 s) : 0, 1709660
Total [candidate] (14.821 s) : 0, 14820704
section profiling
Agent [baseline] (1.855 s) : 0, 1855216
Total [baseline] (14.755 s) : 0, 14754772
Agent [candidate] (1.857 s) : 0, 1857305
Total [candidate] (14.663 s) : 0, 14663421
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.546 s -
Agent appsec 1.735 s 188.995 ms (12.2%)
Agent iast 1.716 s 170.336 ms (11.0%)
Agent profiling 1.855 s 309.407 ms (20.0%)
Total tracing 14.263 s -
Total appsec 14.385 s 122.789 ms (0.9%)
Total iast 14.736 s 473.322 ms (3.3%)
Total profiling 14.755 s 492.161 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.546 s -
Agent appsec 1.732 s 186.069 ms (12.0%)
Agent iast 1.71 s 163.331 ms (10.6%)
Agent profiling 1.857 s 310.976 ms (20.1%)
Total tracing 14.283 s -
Total appsec 14.431 s 147.502 ms (1.0%)
Total iast 14.821 s 537.284 ms (3.8%)
Total profiling 14.663 s 380.002 ms (2.7%)
gantt
    title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (991.755 ms) : 0, 991755
BytebuddyAgent [candidate] (991.906 ms) : 0, 991906
GlobalTracer [baseline] (452.976 ms) : 0, 452976
GlobalTracer [candidate] (453.243 ms) : 0, 453243
AppSec [baseline] (70.748 ms) : 0, 70748
AppSec [candidate] (70.697 ms) : 0, 70697
Remote Config [baseline] (848.109 µs) : 0, 848
Remote Config [candidate] (845.385 µs) : 0, 845
Telemetry [baseline] (9.528 ms) : 0, 9528
Telemetry [candidate] (9.602 ms) : 0, 9602
section appsec
BytebuddyAgent [baseline] (1.012 s) : 0, 1012045
BytebuddyAgent [candidate] (1.009 s) : 0, 1009496
GlobalTracer [baseline] (446.765 ms) : 0, 446765
GlobalTracer [candidate] (446.62 ms) : 0, 446620
AppSec [baseline] (233.381 ms) : 0, 233381
AppSec [candidate] (232.891 ms) : 0, 232891
Remote Config [baseline] (767.136 µs) : 0, 767
Remote Config [candidate] (765.896 µs) : 0, 766
Telemetry [baseline] (9.046 ms) : 0, 9046
Telemetry [candidate] (9.762 ms) : 0, 9762
IAST [baseline] (25.474 ms) : 0, 25474
IAST [candidate] (25.532 ms) : 0, 25532
section iast
BytebuddyAgent [baseline] (1.152 s) : 0, 1151932
BytebuddyAgent [candidate] (1.149 s) : 0, 1149044
GlobalTracer [baseline] (433.9 ms) : 0, 433900
GlobalTracer [candidate] (432.468 ms) : 0, 432468
AppSec [baseline] (71.41 ms) : 0, 71410
AppSec [candidate] (68.809 ms) : 0, 68809
Remote Config [baseline] (719.777 µs) : 0, 720
Remote Config [candidate] (758.101 µs) : 0, 758
Telemetry [baseline] (9.039 ms) : 0, 9039
Telemetry [candidate] (10.108 ms) : 0, 10108
IAST [baseline] (29.165 ms) : 0, 29165
IAST [candidate] (28.434 ms) : 0, 28434
section profiling
BytebuddyAgent [baseline] (985.239 ms) : 0, 985239
BytebuddyAgent [candidate] (984.012 ms) : 0, 984012
GlobalTracer [baseline] (583.955 ms) : 0, 583955
GlobalTracer [candidate] (584.695 ms) : 0, 584695
AppSec [baseline] (72.221 ms) : 0, 72221
AppSec [candidate] (72.253 ms) : 0, 72253
Remote Config [baseline] (922.794 µs) : 0, 923
Remote Config [candidate] (945.009 µs) : 0, 945
Telemetry [baseline] (9.253 ms) : 0, 9253
Telemetry [candidate] (9.288 ms) : 0, 9288
ProfilingAgent [baseline] (147.895 ms) : 0, 147895
ProfilingAgent [candidate] (150.36 ms) : 0, 150360
Profiling [baseline] (147.969 ms) : 0, 147969
Profiling [candidate] (150.459 ms) : 0, 150459
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-05T10:34:13 2024-08-05T10:41:02
git_branch master mario.vidal/fix_smoke_test_check
start_time 2024-08-05T10:34:00 2024-08-05T10:40:48
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1722854806 1722854806
ci_job_id 594442583 594442583
ci_pipeline_id 40885489 40885489
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1722850028 1722850028
git_commit_sha e0d4e22 e0d4e22
release_version 1.38.0-SNAPSHOT~e0d4e2291b 1.38.0-SNAPSHOT~e0d4e2291b
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.37 µs) : 353, 394
.   : milestone, 373,
iast (483.046 µs) : 462, 504
.   : milestone, 483,
iast_FULL (547.241 µs) : 526, 568
.   : milestone, 547,
iast_GLOBAL (502.288 µs) : 481, 523
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (477.796 µs) : 457, 499
.   : milestone, 478,
iast_INACTIVE (453.338 µs) : 431, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (470.583 µs) : 450, 492
.   : milestone, 471,
tracing (442.393 µs) : 422, 463
.   : milestone, 442,
section candidate
no_agent (366.091 µs) : 344, 388
.   : milestone, 366,
iast (484.466 µs) : 463, 506
.   : milestone, 484,
iast_FULL (546.333 µs) : 525, 567
.   : milestone, 546,
iast_GLOBAL (514.998 µs) : 493, 537
.   : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (481.719 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (452.357 µs) : 431, 474
.   : milestone, 452,
iast_TELEMETRY_OFF (471.445 µs) : 450, 493
.   : milestone, 471,
tracing (441.826 µs) : 421, 462
.   : milestone, 442,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.37 µs [353.14 µs, 393.599 µs] -
iast 483.046 µs [461.918 µs, 504.173 µs] 109.676 µs (29.4%)
iast_FULL 547.241 µs [526.157 µs, 568.325 µs] 173.871 µs (46.6%)
iast_GLOBAL 502.288 µs [481.318 µs, 523.258 µs] 128.918 µs (34.5%)
iast_HARDCODED_SECRET_DISABLED 477.796 µs [456.858 µs, 498.733 µs] 104.426 µs (28.0%)
iast_INACTIVE 453.338 µs [431.301 µs, 475.375 µs] 79.968 µs (21.4%)
iast_TELEMETRY_OFF 470.583 µs [449.569 µs, 491.596 µs] 97.213 µs (26.0%)
tracing 442.393 µs [421.731 µs, 463.056 µs] 69.023 µs (18.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.091 µs [344.117 µs, 388.065 µs] -
iast 484.466 µs [463.015 µs, 505.918 µs] 118.375 µs (32.3%)
iast_FULL 546.333 µs [525.337 µs, 567.329 µs] 180.242 µs (49.2%)
iast_GLOBAL 514.998 µs [492.509 µs, 537.488 µs] 148.907 µs (40.7%)
iast_HARDCODED_SECRET_DISABLED 481.719 µs [460.83 µs, 502.608 µs] 115.628 µs (31.6%)
iast_INACTIVE 452.357 µs [430.572 µs, 474.141 µs] 86.266 µs (23.6%)
iast_TELEMETRY_OFF 471.445 µs [449.895 µs, 492.996 µs] 105.354 µs (28.8%)
tracing 441.826 µs [421.342 µs, 462.31 µs] 75.735 µs (20.7%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.328 ms) : 1308, 1347
.   : milestone, 1328,
appsec (1.708 ms) : 1683, 1733
.   : milestone, 1708,
appsec_no_iast (1.699 ms) : 1674, 1723
.   : milestone, 1699,
iast (1.49 ms) : 1469, 1512
.   : milestone, 1490,
profiling (1.533 ms) : 1506, 1559
.   : milestone, 1533,
tracing (1.459 ms) : 1435, 1483
.   : milestone, 1459,
section candidate
no_agent (1.328 ms) : 1309, 1347
.   : milestone, 1328,
appsec (1.72 ms) : 1697, 1744
.   : milestone, 1720,
appsec_no_iast (1.695 ms) : 1669, 1720
.   : milestone, 1695,
iast (1.467 ms) : 1445, 1489
.   : milestone, 1467,
profiling (1.529 ms) : 1503, 1555
.   : milestone, 1529,
tracing (1.457 ms) : 1433, 1481
.   : milestone, 1457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.328 ms [1.308 ms, 1.347 ms] -
appsec 1.708 ms [1.683 ms, 1.733 ms] 380.36 µs (28.6%)
appsec_no_iast 1.699 ms [1.674 ms, 1.723 ms] 370.799 µs (27.9%)
iast 1.49 ms [1.469 ms, 1.512 ms] 162.524 µs (12.2%)
profiling 1.533 ms [1.506 ms, 1.559 ms] 204.809 µs (15.4%)
tracing 1.459 ms [1.435 ms, 1.483 ms] 131.121 µs (9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.328 ms [1.309 ms, 1.347 ms] -
appsec 1.72 ms [1.697 ms, 1.744 ms] 392.106 µs (29.5%)
appsec_no_iast 1.695 ms [1.669 ms, 1.72 ms] 366.371 µs (27.6%)
iast 1.467 ms [1.445 ms, 1.489 ms] 138.635 µs (10.4%)
profiling 1.529 ms [1.503 ms, 1.555 ms] 200.526 µs (15.1%)
tracing 1.457 ms [1.433 ms, 1.481 ms] 129.197 µs (9.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/fix_smoke_test_check
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1722855323 1722855323
ci_job_id 594442584 594442584
ci_pipeline_id 40885489 40885489
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1722850028 1722850028
git_commit_sha e0d4e22 e0d4e22
release_version 1.38.0-SNAPSHOT~e0d4e2291b 1.38.0-SNAPSHOT~e0d4e2291b
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
appsec (15.346 s) : 15346000, 15346000
.   : milestone, 15346000,
iast (18.87 s) : 18870000, 18870000
.   : milestone, 18870000,
iast_GLOBAL (17.769 s) : 17769000, 17769000
.   : milestone, 17769000,
profiling (15.55 s) : 15550000, 15550000
.   : milestone, 15550000,
tracing (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
section candidate
no_agent (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
appsec (14.941 s) : 14941000, 14941000
.   : milestone, 14941000,
iast (18.724 s) : 18724000, 18724000
.   : milestone, 18724000,
iast_GLOBAL (17.846 s) : 17846000, 17846000
.   : milestone, 17846000,
profiling (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
tracing (14.914 s) : 14914000, 14914000
.   : milestone, 14914000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.015 s [15.015 s, 15.015 s] -
appsec 15.346 s [15.346 s, 15.346 s] 331.0 ms (2.2%)
iast 18.87 s [18.87 s, 18.87 s] 3.855 s (25.7%)
iast_GLOBAL 17.769 s [17.769 s, 17.769 s] 2.754 s (18.3%)
profiling 15.55 s [15.55 s, 15.55 s] 535.0 ms (3.6%)
tracing 15.075 s [15.075 s, 15.075 s] 60.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.033 s [15.033 s, 15.033 s] -
appsec 14.941 s [14.941 s, 14.941 s] -92.0 ms (-0.6%)
iast 18.724 s [18.724 s, 18.724 s] 3.691 s (24.6%)
iast_GLOBAL 17.846 s [17.846 s, 17.846 s] 2.813 s (18.7%)
profiling 15.049 s [15.049 s, 15.049 s] 16.0 ms (0.1%)
tracing 14.914 s [14.914 s, 14.914 s] -119.0 ms (-0.8%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~e0d4e2291b, baseline=1.38.0-SNAPSHOT~e0d4e2291b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.463 ms) : 1451, 1474
.   : milestone, 1463,
appsec (2.215 ms) : 2180, 2250
.   : milestone, 2215,
iast (1.971 ms) : 1928, 2013
.   : milestone, 1971,
iast_GLOBAL (2.001 ms) : 1959, 2044
.   : milestone, 2001,
profiling (1.859 ms) : 1823, 1895
.   : milestone, 1859,
tracing (1.831 ms) : 1798, 1863
.   : milestone, 1831,
section candidate
no_agent (1.447 ms) : 1436, 1459
.   : milestone, 1447,
appsec (2.215 ms) : 2179, 2250
.   : milestone, 2215,
iast (1.966 ms) : 1924, 2008
.   : milestone, 1966,
iast_GLOBAL (2.011 ms) : 1968, 2055
.   : milestone, 2011,
profiling (1.847 ms) : 1812, 1882
.   : milestone, 1847,
tracing (1.83 ms) : 1797, 1863
.   : milestone, 1830,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.451 ms, 1.474 ms] -
appsec 2.215 ms [2.18 ms, 2.25 ms] 752.422 µs (51.4%)
iast 1.971 ms [1.928 ms, 2.013 ms] 507.907 µs (34.7%)
iast_GLOBAL 2.001 ms [1.959 ms, 2.044 ms] 538.655 µs (36.8%)
profiling 1.859 ms [1.823 ms, 1.895 ms] 396.267 µs (27.1%)
tracing 1.831 ms [1.798 ms, 1.863 ms] 368.036 µs (25.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.447 ms [1.436 ms, 1.459 ms] -
appsec 2.215 ms [2.179 ms, 2.25 ms] 767.176 µs (53.0%)
iast 1.966 ms [1.924 ms, 2.008 ms] 518.689 µs (35.8%)
iast_GLOBAL 2.011 ms [1.968 ms, 2.055 ms] 564.055 µs (39.0%)
profiling 1.847 ms [1.812 ms, 1.882 ms] 399.433 µs (27.6%)
tracing 1.83 ms [1.797 ms, 1.863 ms] 382.858 µs (26.5%)

@Mariovido Mariovido merged commit 60ddc9e into master Aug 5, 2024
80 checks passed
@Mariovido Mariovido deleted the mario.vidal/fix_smoke_test_check branch August 5, 2024 12:41
@github-actions github-actions bot added this to the 1.38.0 milestone Aug 5, 2024
@nayeem-kamal nayeem-kamal added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants