Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Throw exception when using repo index to resolve source path for classes with identical names #7793

Merged

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Oct 17, 2024

What Does This Do

Updates repo indexing logic: the logic now stores the list of classes whose path relative to source root is the same (e.g. src/java/main/my/package/MyClass.java and src/java9/main/my/package/MyClass.java).

When a source path lookup is performed with the repo index, if the class if one of those "duplicates", an exception will be thrown to indicate that we cannot reliably detect the source path for this class.

Motivation

The motivation is to skip code coverage report creation and submission for test cases that cover such classes.
The idea is that since we cannot reliably detect all the source paths, we do not want ITR to skip these test cases, which is why we will not be submitting code coverage reports for them.

Contributor Checklist

Jira ticket: SDTEST-1130

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: bug comp: ci visibility Continuous Integration Visibility labels Oct 17, 2024
@pr-commenter
Copy link

pr-commenter bot commented Oct 17, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/repo-index-duplicates-check
git_commit_date 1729184235 1729186962
git_commit_sha 666f2af 307dd92
release_version 1.42.0-SNAPSHOT~666f2afac1 1.42.0-SNAPSHOT~307dd9292d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729189299 1729189299
ci_job_id 675920324 675920324
ci_pipeline_id 46849117 46849117
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1075943
Total [baseline] (10.363 s) : 0, 10362518
Agent [candidate] (1.084 s) : 0, 1083914
Total [candidate] (10.346 s) : 0, 10345849
section appsec
Agent [baseline] (1.215 s) : 0, 1214943
Total [baseline] (10.591 s) : 0, 10590972
Agent [candidate] (1.21 s) : 0, 1210078
Total [candidate] (10.581 s) : 0, 10581201
section iast
Agent [baseline] (1.203 s) : 0, 1202591
Total [baseline] (10.926 s) : 0, 10926377
Agent [candidate] (1.214 s) : 0, 1213745
Total [candidate] (10.867 s) : 0, 10867464
section profiling
Agent [baseline] (1.274 s) : 0, 1273926
Total [baseline] (10.682 s) : 0, 10681787
Agent [candidate] (1.271 s) : 0, 1271441
Total [candidate] (10.725 s) : 0, 10724965
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.215 s 139.0 ms (12.9%)
Agent iast 1.203 s 126.649 ms (11.8%)
Agent profiling 1.274 s 197.984 ms (18.4%)
Total tracing 10.363 s -
Total appsec 10.591 s 228.454 ms (2.2%)
Total iast 10.926 s 563.858 ms (5.4%)
Total profiling 10.682 s 319.269 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.21 s 126.164 ms (11.6%)
Agent iast 1.214 s 129.832 ms (12.0%)
Agent profiling 1.271 s 187.527 ms (17.3%)
Total tracing 10.346 s -
Total appsec 10.581 s 235.351 ms (2.3%)
Total iast 10.867 s 521.615 ms (5.0%)
Total profiling 10.725 s 379.116 ms (3.7%)
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.464 ms) : 0, 685464
BytebuddyAgent [candidate] (689.821 ms) : 0, 689821
GlobalTracer [baseline] (312.677 ms) : 0, 312677
GlobalTracer [candidate] (314.884 ms) : 0, 314884
AppSec [baseline] (53.937 ms) : 0, 53937
AppSec [candidate] (53.955 ms) : 0, 53955
Remote Config [baseline] (670.944 µs) : 0, 671
Remote Config [candidate] (662.56 µs) : 0, 663
Telemetry [baseline] (9.567 ms) : 0, 9567
Telemetry [candidate] (10.858 ms) : 0, 10858
section appsec
BytebuddyAgent [baseline] (705.4 ms) : 0, 705400
BytebuddyAgent [candidate] (702.525 ms) : 0, 702525
GlobalTracer [baseline] (311.272 ms) : 0, 311272
GlobalTracer [candidate] (310.117 ms) : 0, 310117
AppSec [baseline] (165.582 ms) : 0, 165582
AppSec [candidate] (165.697 ms) : 0, 165697
IAST [baseline] (21.083 ms) : 0, 21083
IAST [candidate] (20.742 ms) : 0, 20742
Remote Config [baseline] (640.586 µs) : 0, 641
Remote Config [candidate] (640.717 µs) : 0, 641
Telemetry [baseline] (7.83 ms) : 0, 7830
Telemetry [candidate] (7.078 ms) : 0, 7078
section iast
BytebuddyAgent [baseline] (801.161 ms) : 0, 801161
BytebuddyAgent [candidate] (809.003 ms) : 0, 809003
GlobalTracer [baseline] (302.05 ms) : 0, 302050
GlobalTracer [candidate] (304.819 ms) : 0, 304819
AppSec [baseline] (57.803 ms) : 0, 57803
AppSec [candidate] (57.987 ms) : 0, 57987
IAST [baseline] (20.267 ms) : 0, 20267
IAST [candidate] (20.443 ms) : 0, 20443
Remote Config [baseline] (590.445 µs) : 0, 590
Remote Config [candidate] (604.205 µs) : 0, 604
Telemetry [baseline] (7.063 ms) : 0, 7063
Telemetry [candidate] (7.112 ms) : 0, 7112
section profiling
BytebuddyAgent [baseline] (679.871 ms) : 0, 679871
BytebuddyAgent [candidate] (678.479 ms) : 0, 678479
GlobalTracer [baseline] (396.39 ms) : 0, 396390
GlobalTracer [candidate] (395.509 ms) : 0, 395509
AppSec [baseline] (54.329 ms) : 0, 54329
AppSec [candidate] (54.622 ms) : 0, 54622
Remote Config [baseline] (646.899 µs) : 0, 647
Remote Config [candidate] (644.71 µs) : 0, 645
Telemetry [baseline] (13.784 ms) : 0, 13784
Telemetry [candidate] (12.977 ms) : 0, 12977
ProfilingAgent [baseline] (90.196 ms) : 0, 90196
ProfilingAgent [candidate] (90.488 ms) : 0, 90488
Profiling [baseline] (90.22 ms) : 0, 90220
Profiling [candidate] (90.511 ms) : 0, 90511
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081214
Total [baseline] (8.589 s) : 0, 8589179
Agent [candidate] (1.074 s) : 0, 1074297
Total [candidate] (8.556 s) : 0, 8555790
section iast
Agent [baseline] (1.203 s) : 0, 1203276
Total [baseline] (9.128 s) : 0, 9127568
Agent [candidate] (1.199 s) : 0, 1199291
Total [candidate] (9.117 s) : 0, 9116881
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.201 s) : 0, 1200728
Total [baseline] (9.081 s) : 0, 9081451
Agent [candidate] (1.205 s) : 0, 1204557
Total [candidate] (9.102 s) : 0, 9101590
section iast_TELEMETRY_OFF
Agent [baseline] (1.205 s) : 0, 1204508
Total [baseline] (9.125 s) : 0, 9125154
Agent [candidate] (1.198 s) : 0, 1198311
Total [candidate] (9.105 s) : 0, 9105144
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.203 s 122.062 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.201 s 119.514 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.205 s 123.294 ms (11.4%)
Total tracing 8.589 s -
Total iast 9.128 s 538.389 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.081 s 492.272 ms (5.7%)
Total iast_TELEMETRY_OFF 9.125 s 535.975 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.199 s 124.994 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.205 s 130.26 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.198 s 124.014 ms (11.5%)
Total tracing 8.556 s -
Total iast 9.117 s 561.09 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.102 s 545.8 ms (6.4%)
Total iast_TELEMETRY_OFF 9.105 s 549.354 ms (6.4%)
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.538 ms) : 0, 689538
BytebuddyAgent [candidate] (684.193 ms) : 0, 684193
GlobalTracer [baseline] (314.2 ms) : 0, 314200
GlobalTracer [candidate] (312.746 ms) : 0, 312746
AppSec [baseline] (54.237 ms) : 0, 54237
AppSec [candidate] (53.48 ms) : 0, 53480
Remote Config [baseline] (669.503 µs) : 0, 670
Remote Config [candidate] (660.731 µs) : 0, 661
Telemetry [baseline] (8.864 ms) : 0, 8864
Telemetry [candidate] (9.608 ms) : 0, 9608
section iast
BytebuddyAgent [baseline] (801.119 ms) : 0, 801119
BytebuddyAgent [candidate] (798.488 ms) : 0, 798488
GlobalTracer [baseline] (302.681 ms) : 0, 302681
GlobalTracer [candidate] (302.138 ms) : 0, 302138
AppSec [baseline] (58.116 ms) : 0, 58116
AppSec [candidate] (57.31 ms) : 0, 57310
IAST [baseline] (20.074 ms) : 0, 20074
IAST [candidate] (20.149 ms) : 0, 20149
Remote Config [baseline] (602.156 µs) : 0, 602
Remote Config [candidate] (601.358 µs) : 0, 601
Telemetry [baseline] (7.028 ms) : 0, 7028
Telemetry [candidate] (6.968 ms) : 0, 6968
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.966 ms) : 0, 799966
BytebuddyAgent [candidate] (801.765 ms) : 0, 801765
GlobalTracer [baseline] (301.825 ms) : 0, 301825
GlobalTracer [candidate] (303.031 ms) : 0, 303031
AppSec [baseline] (55.952 ms) : 0, 55952
AppSec [candidate] (57.258 ms) : 0, 57258
IAST [baseline] (21.766 ms) : 0, 21766
IAST [candidate] (21.086 ms) : 0, 21086
Remote Config [baseline] (582.647 µs) : 0, 583
Remote Config [candidate] (606.696 µs) : 0, 607
Telemetry [baseline] (6.987 ms) : 0, 6987
Telemetry [candidate] (7.137 ms) : 0, 7137
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (802.042 ms) : 0, 802042
BytebuddyAgent [candidate] (797.207 ms) : 0, 797207
GlobalTracer [baseline] (303.86 ms) : 0, 303860
GlobalTracer [candidate] (302.156 ms) : 0, 302156
AppSec [baseline] (56.462 ms) : 0, 56462
AppSec [candidate] (54.556 ms) : 0, 54556
IAST [baseline] (20.802 ms) : 0, 20802
IAST [candidate] (22.382 ms) : 0, 22382
Remote Config [baseline] (604.39 µs) : 0, 604
Remote Config [candidate] (586.259 µs) : 0, 586
Telemetry [baseline] (7.013 ms) : 0, 7013
Telemetry [candidate] (7.781 ms) : 0, 7781
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-17T17:54:11 2024-10-17T18:01:02
git_branch master nikita-tkachenko/repo-index-duplicates-check
git_commit_date 1729184235 1729186962
git_commit_sha 666f2af 307dd92
release_version 1.42.0-SNAPSHOT~666f2afac1 1.42.0-SNAPSHOT~307dd9292d
start_time 2024-10-17T17:53:58 2024-10-17T18:00:48
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729188409 1729188409
ci_job_id 675920325 675920325
ci_pipeline_id 46849117 46849117
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.141 µs) : 353, 392
.   : milestone, 372,
iast (483.973 µs) : 463, 505
.   : milestone, 484,
iast_FULL (551.587 µs) : 530, 573
.   : milestone, 552,
iast_GLOBAL (502.598 µs) : 482, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (494.57 µs) : 472, 517
.   : milestone, 495,
iast_INACTIVE (448.267 µs) : 427, 470
.   : milestone, 448,
iast_TELEMETRY_OFF (474.488 µs) : 453, 496
.   : milestone, 474,
tracing (445.481 µs) : 424, 467
.   : milestone, 445,
section candidate
no_agent (367.808 µs) : 348, 388
.   : milestone, 368,
iast (480.329 µs) : 459, 501
.   : milestone, 480,
iast_FULL (557.025 µs) : 535, 579
.   : milestone, 557,
iast_GLOBAL (503.421 µs) : 482, 525
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (484.964 µs) : 464, 506
.   : milestone, 485,
iast_INACTIVE (444.2 µs) : 423, 466
.   : milestone, 444,
iast_TELEMETRY_OFF (477.819 µs) : 456, 500
.   : milestone, 478,
tracing (439.844 µs) : 420, 460
.   : milestone, 440,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.141 µs [352.555 µs, 391.727 µs] -
iast 483.973 µs [462.703 µs, 505.243 µs] 111.832 µs (30.1%)
iast_FULL 551.587 µs [530.285 µs, 572.89 µs] 179.446 µs (48.2%)
iast_GLOBAL 502.598 µs [481.506 µs, 523.691 µs] 130.457 µs (35.1%)
iast_HARDCODED_SECRET_DISABLED 494.57 µs [472.137 µs, 517.003 µs] 122.428 µs (32.9%)
iast_INACTIVE 448.267 µs [426.824 µs, 469.709 µs] 76.126 µs (20.5%)
iast_TELEMETRY_OFF 474.488 µs [453.088 µs, 495.887 µs] 102.347 µs (27.5%)
tracing 445.481 µs [423.508 µs, 467.455 µs] 73.34 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.808 µs [347.663 µs, 387.952 µs] -
iast 480.329 µs [459.236 µs, 501.423 µs] 112.522 µs (30.6%)
iast_FULL 557.025 µs [535.335 µs, 578.715 µs] 189.217 µs (51.4%)
iast_GLOBAL 503.421 µs [482.309 µs, 524.532 µs] 135.613 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED 484.964 µs [463.547 µs, 506.381 µs] 117.156 µs (31.9%)
iast_INACTIVE 444.2 µs [422.744 µs, 465.656 µs] 76.392 µs (20.8%)
iast_TELEMETRY_OFF 477.819 µs [455.928 µs, 499.71 µs] 110.011 µs (29.9%)
tracing 439.844 µs [419.576 µs, 460.112 µs] 72.037 µs (19.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.33 ms) : 1310, 1349
.   : milestone, 1330,
appsec (1.711 ms) : 1688, 1734
.   : milestone, 1711,
appsec_no_iast (1.728 ms) : 1704, 1752
.   : milestone, 1728,
iast (1.48 ms) : 1458, 1502
.   : milestone, 1480,
profiling (1.472 ms) : 1449, 1494
.   : milestone, 1472,
tracing (1.451 ms) : 1426, 1475
.   : milestone, 1451,
section candidate
no_agent (1.339 ms) : 1320, 1359
.   : milestone, 1339,
appsec (1.708 ms) : 1685, 1732
.   : milestone, 1708,
appsec_no_iast (1.722 ms) : 1697, 1746
.   : milestone, 1722,
iast (1.479 ms) : 1455, 1502
.   : milestone, 1479,
profiling (1.517 ms) : 1490, 1543
.   : milestone, 1517,
tracing (1.463 ms) : 1438, 1488
.   : milestone, 1463,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.33 ms [1.31 ms, 1.349 ms] -
appsec 1.711 ms [1.688 ms, 1.734 ms] 381.096 µs (28.7%)
appsec_no_iast 1.728 ms [1.704 ms, 1.752 ms] 398.862 µs (30.0%)
iast 1.48 ms [1.458 ms, 1.502 ms] 150.194 µs (11.3%)
profiling 1.472 ms [1.449 ms, 1.494 ms] 142.052 µs (10.7%)
tracing 1.451 ms [1.426 ms, 1.475 ms] 121.234 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.339 ms [1.32 ms, 1.359 ms] -
appsec 1.708 ms [1.685 ms, 1.732 ms] 369.063 µs (27.6%)
appsec_no_iast 1.722 ms [1.697 ms, 1.746 ms] 382.352 µs (28.5%)
iast 1.479 ms [1.455 ms, 1.502 ms] 139.446 µs (10.4%)
profiling 1.517 ms [1.49 ms, 1.543 ms] 177.622 µs (13.3%)
tracing 1.463 ms [1.438 ms, 1.488 ms] 123.706 µs (9.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/repo-index-duplicates-check
git_commit_date 1729184235 1729186962
git_commit_sha 666f2af 307dd92
release_version 1.42.0-SNAPSHOT~666f2afac1 1.42.0-SNAPSHOT~307dd9292d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1729188803 1729188803
ci_job_id 675920327 675920327
ci_pipeline_id 46849117 46849117
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.455 ms) : 1444, 1466
.   : milestone, 1455,
appsec (2.299 ms) : 2258, 2340
.   : milestone, 2299,
iast (2.063 ms) : 2011, 2115
.   : milestone, 2063,
iast_GLOBAL (2.108 ms) : 2055, 2160
.   : milestone, 2108,
profiling (1.923 ms) : 1882, 1964
.   : milestone, 1923,
tracing (1.91 ms) : 1871, 1950
.   : milestone, 1910,
section candidate
no_agent (1.461 ms) : 1449, 1472
.   : milestone, 1461,
appsec (2.316 ms) : 2275, 2358
.   : milestone, 2316,
iast (2.053 ms) : 2002, 2104
.   : milestone, 2053,
iast_GLOBAL (2.099 ms) : 2047, 2151
.   : milestone, 2099,
profiling (1.922 ms) : 1882, 1963
.   : milestone, 1922,
tracing (1.909 ms) : 1869, 1949
.   : milestone, 1909,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.455 ms [1.444 ms, 1.466 ms] -
appsec 2.299 ms [2.258 ms, 2.34 ms] 844.164 µs (58.0%)
iast 2.063 ms [2.011 ms, 2.115 ms] 607.902 µs (41.8%)
iast_GLOBAL 2.108 ms [2.055 ms, 2.16 ms] 652.576 µs (44.9%)
profiling 1.923 ms [1.882 ms, 1.964 ms] 468.131 µs (32.2%)
tracing 1.91 ms [1.871 ms, 1.95 ms] 455.38 µs (31.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.449 ms, 1.472 ms] -
appsec 2.316 ms [2.275 ms, 2.358 ms] 855.617 µs (58.6%)
iast 2.053 ms [2.002 ms, 2.104 ms] 592.606 µs (40.6%)
iast_GLOBAL 2.099 ms [2.047 ms, 2.151 ms] 638.685 µs (43.7%)
profiling 1.922 ms [1.882 ms, 1.963 ms] 461.771 µs (31.6%)
tracing 1.909 ms [1.869 ms, 1.949 ms] 448.222 µs (30.7%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~307dd9292d, baseline=1.42.0-SNAPSHOT~666f2afac1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.058 s) : 15058000, 15058000
.   : milestone, 15058000,
appsec (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,
iast (18.884 s) : 18884000, 18884000
.   : milestone, 18884000,
iast_GLOBAL (17.945 s) : 17945000, 17945000
.   : milestone, 17945000,
profiling (15.732 s) : 15732000, 15732000
.   : milestone, 15732000,
tracing (15.161 s) : 15161000, 15161000
.   : milestone, 15161000,
section candidate
no_agent (15.117 s) : 15117000, 15117000
.   : milestone, 15117000,
appsec (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
iast (18.887 s) : 18887000, 18887000
.   : milestone, 18887000,
iast_GLOBAL (17.974 s) : 17974000, 17974000
.   : milestone, 17974000,
profiling (15.764 s) : 15764000, 15764000
.   : milestone, 15764000,
tracing (15.155 s) : 15155000, 15155000
.   : milestone, 15155000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.058 s [15.058 s, 15.058 s] -
appsec 15.146 s [15.146 s, 15.146 s] 88.0 ms (0.6%)
iast 18.884 s [18.884 s, 18.884 s] 3.826 s (25.4%)
iast_GLOBAL 17.945 s [17.945 s, 17.945 s] 2.887 s (19.2%)
profiling 15.732 s [15.732 s, 15.732 s] 674.0 ms (4.5%)
tracing 15.161 s [15.161 s, 15.161 s] 103.0 ms (0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.117 s [15.117 s, 15.117 s] -
appsec 15.028 s [15.028 s, 15.028 s] -89.0 ms (-0.6%)
iast 18.887 s [18.887 s, 18.887 s] 3.77 s (24.9%)
iast_GLOBAL 17.974 s [17.974 s, 17.974 s] 2.857 s (18.9%)
profiling 15.764 s [15.764 s, 15.764 s] 647.0 ms (4.3%)
tracing 15.155 s [15.155 s, 15.155 s] 38.0 ms (0.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: ci visibility Continuous Integration Visibility type: bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants