Retry telemetry requests if CI Visibility is enabled #8147

nikita-tkachenko-datadog · 2025-01-03T11:07:24Z

What Does This Do

retries telemetry requests up to 2 times if CI Visibility is enabled
updates telemetry logging: error message is not printed if a telemetry request is interrupted

Motivation

Telemetry system is shut down when the JVM terminates. Shutdown interrupts telemetry thread, and if a telemetry request was in progress when the shutdown starts that request is aborted and an InterruptedIOException is thrown.

Current behaviour is to log an error in this case, and possibly reattempt the request with a different dispatch method (intake vs agent).

This is not suitable for CI Visibility: oftentimes traced JVMs are short-lived (e.g. they need to run a few unit tests and then terminate). In such cases telemetry will fail to be sent (and we will miss useful data in the backend, for example the number of test start events will not correspond to the number of test finished events), and an error will be logged which is confusing to the customer. The changes in this PR are meant to address these shortcomings.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-1411

github-actions · 2025-01-03T11:28:36Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-01-03T11:40:50Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/telemetry-request-retries
git_commit_date	1735897629	1735901969
git_commit_sha	`a8b33d5`	`fd72025`
release_version	1.45.0-SNAPSHOT~a8b33d5c49	1.45.0-SNAPSHOT~fd72025912

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1735904405	1735904405
ci_job_id	753601281	753601281
ci_pipeline_id	52086084	52086084
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 59 metrics, 3 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:appsec:Telemetry	worse [+164.719µs; +375.450µs] or [+2.061%; +4.698%]	8.262ms	7.992ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054082
Total [baseline] (8.625 s) : 0, 8625038
Agent [candidate] (1.056 s) : 0, 1056250
Total [candidate] (8.608 s) : 0, 8608034
section iast
Agent [baseline] (1.185 s) : 0, 1184631
Total [baseline] (9.213 s) : 0, 9212801
Agent [candidate] (1.189 s) : 0, 1188736
Total [candidate] (9.292 s) : 0, 9291567
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.181 s) : 0, 1180707
Total [baseline] (9.166 s) : 0, 9166317
Agent [candidate] (1.18 s) : 0, 1180298
Total [candidate] (9.193 s) : 0, 9193088
section iast_TELEMETRY_OFF
Agent [baseline] (1.176 s) : 0, 1175841
Total [baseline] (9.224 s) : 0, 9224494
Agent [candidate] (1.184 s) : 0, 1183719
Total [candidate] (9.224 s) : 0, 9224375

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.185 s	130.549 ms (12.4%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.181 s	126.626 ms (12.0%)
Agent	iast_TELEMETRY_OFF	1.176 s	121.759 ms (11.6%)
Total	tracing	8.625 s	-
Total	iast	9.213 s	587.763 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.166 s	541.279 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.224 s	599.456 ms (7.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	iast	1.189 s	132.486 ms (12.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.18 s	124.048 ms (11.7%)
Agent	iast_TELEMETRY_OFF	1.184 s	127.469 ms (12.1%)
Total	tracing	8.608 s	-
Total	iast	9.292 s	683.534 ms (7.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.193 s	585.054 ms (6.8%)
Total	iast_TELEMETRY_OFF	9.224 s	616.341 ms (7.2%)

gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.071 ms) : 0, 713071
BytebuddyAgent [candidate] (714.111 ms) : 0, 714111
GlobalTracer [baseline] (256.693 ms) : 0, 256693
GlobalTracer [candidate] (257.112 ms) : 0, 257112
AppSec [baseline] (55.268 ms) : 0, 55268
AppSec [candidate] (55.366 ms) : 0, 55366
Remote Config [baseline] (710.417 µs) : 0, 710
Remote Config [candidate] (726.04 µs) : 0, 726
Telemetry [baseline] (13.27 ms) : 0, 13270
Telemetry [candidate] (13.778 ms) : 0, 13778
section iast
BytebuddyAgent [baseline] (834.696 ms) : 0, 834696
BytebuddyAgent [candidate] (835.851 ms) : 0, 835851
GlobalTracer [baseline] (246.255 ms) : 0, 246255
GlobalTracer [candidate] (248.557 ms) : 0, 248557
AppSec [baseline] (58.106 ms) : 0, 58106
AppSec [candidate] (58.219 ms) : 0, 58219
Remote Config [baseline] (643.658 µs) : 0, 644
Remote Config [candidate] (663.721 µs) : 0, 664
Telemetry [baseline] (8.501 ms) : 0, 8501
Telemetry [candidate] (8.864 ms) : 0, 8864
IAST [baseline] (21.366 ms) : 0, 21366
IAST [candidate] (21.465 ms) : 0, 21465
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (829.832 ms) : 0, 829832
BytebuddyAgent [candidate] (829.376 ms) : 0, 829376
GlobalTracer [baseline] (246.676 ms) : 0, 246676
GlobalTracer [candidate] (247.079 ms) : 0, 247079
AppSec [baseline] (58.258 ms) : 0, 58258
AppSec [candidate] (58.044 ms) : 0, 58044
Remote Config [baseline] (660.293 µs) : 0, 660
Remote Config [candidate] (643.121 µs) : 0, 643
Telemetry [baseline] (8.705 ms) : 0, 8705
Telemetry [candidate] (8.75 ms) : 0, 8750
IAST [baseline] (21.584 ms) : 0, 21584
IAST [candidate] (21.312 ms) : 0, 21312
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (826.042 ms) : 0, 826042
BytebuddyAgent [candidate] (831.848 ms) : 0, 831848
GlobalTracer [baseline] (246.668 ms) : 0, 246668
GlobalTracer [candidate] (248.189 ms) : 0, 248189
AppSec [baseline] (57.921 ms) : 0, 57921
AppSec [candidate] (58.037 ms) : 0, 58037
Remote Config [baseline] (648.264 µs) : 0, 648
Remote Config [candidate] (656.4 µs) : 0, 656
Telemetry [baseline] (8.482 ms) : 0, 8482
Telemetry [candidate] (8.746 ms) : 0, 8746
IAST [baseline] (21.095 ms) : 0, 21095
IAST [candidate] (21.156 ms) : 0, 21156

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057232
Total [baseline] (10.427 s) : 0, 10426931
Agent [candidate] (1.062 s) : 0, 1061788
Total [candidate] (10.557 s) : 0, 10556726
section appsec
Agent [baseline] (1.188 s) : 0, 1188012
Total [baseline] (10.737 s) : 0, 10737448
Agent [candidate] (1.186 s) : 0, 1186371
Total [candidate] (10.725 s) : 0, 10724694
section iast
Agent [baseline] (1.18 s) : 0, 1180389
Total [baseline] (10.92 s) : 0, 10920073
Agent [candidate] (1.179 s) : 0, 1178681
Total [candidate] (11.062 s) : 0, 11062267
section profiling
Agent [baseline] (1.277 s) : 0, 1276688
Total [baseline] (10.859 s) : 0, 10858518
Agent [candidate] (1.289 s) : 0, 1289290
Total [candidate] (10.816 s) : 0, 10815791

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.188 s	130.78 ms (12.4%)
Agent	iast	1.18 s	123.156 ms (11.6%)
Agent	profiling	1.277 s	219.456 ms (20.8%)
Total	tracing	10.427 s	-
Total	appsec	10.737 s	310.517 ms (3.0%)
Total	iast	10.92 s	493.142 ms (4.7%)
Total	profiling	10.859 s	431.588 ms (4.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	appsec	1.186 s	124.582 ms (11.7%)
Agent	iast	1.179 s	116.893 ms (11.0%)
Agent	profiling	1.289 s	227.502 ms (21.4%)
Total	tracing	10.557 s	-
Total	appsec	10.725 s	167.968 ms (1.6%)
Total	iast	11.062 s	505.54 ms (4.8%)
Total	profiling	10.816 s	259.064 ms (2.5%)

gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.313 ms) : 0, 716313
BytebuddyAgent [candidate] (716.832 ms) : 0, 716832
GlobalTracer [baseline] (257.607 ms) : 0, 257607
GlobalTracer [candidate] (258.309 ms) : 0, 258309
AppSec [baseline] (55.433 ms) : 0, 55433
AppSec [candidate] (55.734 ms) : 0, 55734
Remote Config [baseline] (734.617 µs) : 0, 735
Remote Config [candidate] (735.577 µs) : 0, 736
Telemetry [baseline] (12.002 ms) : 0, 12002
Telemetry [candidate] (14.902 ms) : 0, 14902
section appsec
BytebuddyAgent [baseline] (730.749 ms) : 0, 730749
BytebuddyAgent [candidate] (729.533 ms) : 0, 729533
GlobalTracer [baseline] (253.079 ms) : 0, 253079
GlobalTracer [candidate] (253.01 ms) : 0, 253010
AppSec [baseline] (170.882 ms) : 0, 170882
AppSec [candidate] (170.191 ms) : 0, 170191
Remote Config [baseline] (653.445 µs) : 0, 653
Remote Config [candidate] (672.64 µs) : 0, 673
Telemetry [baseline] (7.992 ms) : 0, 7992
Telemetry [candidate] (8.262 ms) : 0, 8262
IAST [baseline] (19.367 ms) : 0, 19367
IAST [candidate] (19.336 ms) : 0, 19336
section iast
BytebuddyAgent [baseline] (829.733 ms) : 0, 829733
BytebuddyAgent [candidate] (828.262 ms) : 0, 828262
GlobalTracer [baseline] (246.9 ms) : 0, 246900
GlobalTracer [candidate] (246.819 ms) : 0, 246819
AppSec [baseline] (58.103 ms) : 0, 58103
AppSec [candidate] (57.976 ms) : 0, 57976
Remote Config [baseline] (643.175 µs) : 0, 643
Remote Config [candidate] (651.028 µs) : 0, 651
Telemetry [baseline] (8.554 ms) : 0, 8554
Telemetry [candidate] (8.742 ms) : 0, 8742
IAST [baseline] (21.461 ms) : 0, 21461
IAST [candidate] (21.204 ms) : 0, 21204
section profiling
ProfilingAgent [baseline] (95.696 ms) : 0, 95696
ProfilingAgent [candidate] (96.121 ms) : 0, 96121
BytebuddyAgent [baseline] (702.804 ms) : 0, 702804
BytebuddyAgent [candidate] (711.157 ms) : 0, 711157
GlobalTracer [baseline] (373.928 ms) : 0, 373928
GlobalTracer [candidate] (375.585 ms) : 0, 375585
AppSec [baseline] (53.894 ms) : 0, 53894
AppSec [candidate] (55.267 ms) : 0, 55267
Remote Config [baseline] (658.682 µs) : 0, 659
Remote Config [candidate] (669.768 µs) : 0, 670
Telemetry [baseline] (7.828 ms) : 0, 7828
Telemetry [candidate] (8.041 ms) : 0, 8041
Profiling [baseline] (95.719 ms) : 0, 95719
Profiling [candidate] (96.145 ms) : 0, 96145

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-03T11:10:20	2025-01-03T11:17:18
git_branch	master	nikita-tkachenko/telemetry-request-retries
git_commit_date	1735897629	1735901969
git_commit_sha	`a8b33d5`	`fd72025`
release_version	1.45.0-SNAPSHOT~a8b33d5c49	1.45.0-SNAPSHOT~fd72025912
start_time	2025-01-03T11:10:06	2025-01-03T11:17:04

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1735903391	1735903391
ci_job_id	753601282	753601282
ci_pipeline_id	52086084	52086084
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.036 µs) : 363, 405
.   : milestone, 384,
iast (502.613 µs) : 481, 525
.   : milestone, 503,
iast_FULL (658.461 µs) : 637, 680
.   : milestone, 658,
iast_GLOBAL (525.857 µs) : 503, 548
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (490.058 µs) : 468, 512
.   : milestone, 490,
iast_INACTIVE (451.975 µs) : 431, 473
.   : milestone, 452,
iast_TELEMETRY_OFF (481.878 µs) : 460, 503
.   : milestone, 482,
tracing (448.965 µs) : 428, 470
.   : milestone, 449,
section candidate
no_agent (379.325 µs) : 360, 399
.   : milestone, 379,
iast (493.687 µs) : 472, 515
.   : milestone, 494,
iast_FULL (655.052 µs) : 633, 677
.   : milestone, 655,
iast_GLOBAL (522.181 µs) : 501, 544
.   : milestone, 522,
iast_HARDCODED_SECRET_DISABLED (496.78 µs) : 475, 518
.   : milestone, 497,
iast_INACTIVE (454.341 µs) : 433, 475
.   : milestone, 454,
iast_TELEMETRY_OFF (481.506 µs) : 460, 503
.   : milestone, 482,
tracing (446.753 µs) : 426, 467
.   : milestone, 447,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	384.036 µs [363.128 µs, 404.945 µs]	-
iast	502.613 µs [480.633 µs, 524.593 µs]	118.577 µs (30.9%)
iast_FULL	658.461 µs [636.833 µs, 680.089 µs]	274.424 µs (71.5%)
iast_GLOBAL	525.857 µs [503.266 µs, 548.447 µs]	141.82 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED	490.058 µs [468.172 µs, 511.944 µs]	106.022 µs (27.6%)
iast_INACTIVE	451.975 µs [430.828 µs, 473.121 µs]	67.938 µs (17.7%)
iast_TELEMETRY_OFF	481.878 µs [460.38 µs, 503.375 µs]	97.841 µs (25.5%)
tracing	448.965 µs [428.242 µs, 469.689 µs]	64.929 µs (16.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.325 µs [359.65 µs, 399.0 µs]	-
iast	493.687 µs [472.245 µs, 515.129 µs]	114.362 µs (30.1%)
iast_FULL	655.052 µs [633.303 µs, 676.8 µs]	275.726 µs (72.7%)
iast_GLOBAL	522.181 µs [500.637 µs, 543.725 µs]	142.856 µs (37.7%)
iast_HARDCODED_SECRET_DISABLED	496.78 µs [475.25 µs, 518.31 µs]	117.455 µs (31.0%)
iast_INACTIVE	454.341 µs [433.182 µs, 475.5 µs]	75.015 µs (19.8%)
iast_TELEMETRY_OFF	481.506 µs [460.15 µs, 502.862 µs]	102.18 µs (26.9%)
tracing	446.753 µs [426.126 µs, 467.38 µs]	67.428 µs (17.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1337, 1379
.   : milestone, 1358,
appsec (1.742 ms) : 1718, 1765
.   : milestone, 1742,
appsec_no_iast (1.752 ms) : 1728, 1777
.   : milestone, 1752,
iast (1.498 ms) : 1475, 1522
.   : milestone, 1498,
profiling (1.515 ms) : 1490, 1540
.   : milestone, 1515,
tracing (1.49 ms) : 1464, 1516
.   : milestone, 1490,
section candidate
no_agent (1.376 ms) : 1356, 1395
.   : milestone, 1376,
appsec (1.757 ms) : 1732, 1781
.   : milestone, 1757,
appsec_no_iast (1.728 ms) : 1703, 1754
.   : milestone, 1728,
iast (1.495 ms) : 1472, 1518
.   : milestone, 1495,
profiling (1.54 ms) : 1515, 1565
.   : milestone, 1540,
tracing (1.488 ms) : 1464, 1511
.   : milestone, 1488,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.337 ms, 1.379 ms]	-
appsec	1.742 ms [1.718 ms, 1.765 ms]	383.693 µs (28.3%)
appsec_no_iast	1.752 ms [1.728 ms, 1.777 ms]	394.399 µs (29.0%)
iast	1.498 ms [1.475 ms, 1.522 ms]	140.182 µs (10.3%)
profiling	1.515 ms [1.49 ms, 1.54 ms]	156.963 µs (11.6%)
tracing	1.49 ms [1.464 ms, 1.516 ms]	132.098 µs (9.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.376 ms [1.356 ms, 1.395 ms]	-
appsec	1.757 ms [1.732 ms, 1.781 ms]	381.18 µs (27.7%)
appsec_no_iast	1.728 ms [1.703 ms, 1.754 ms]	352.957 µs (25.7%)
iast	1.495 ms [1.472 ms, 1.518 ms]	119.383 µs (8.7%)
profiling	1.54 ms [1.515 ms, 1.565 ms]	164.716 µs (12.0%)
tracing	1.488 ms [1.464 ms, 1.511 ms]	112.163 µs (8.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/telemetry-request-retries
git_commit_date	1735897629	1735901969
git_commit_sha	`a8b33d5`	`fd72025`
release_version	1.45.0-SNAPSHOT~a8b33d5c49	1.45.0-SNAPSHOT~fd72025912

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1735904003	1735904003
ci_job_id	753601283	753601283
ci_pipeline_id	52086084	52086084
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.358 ms) : 2316, 2401
.   : milestone, 2358,
iast (2.097 ms) : 2044, 2150
.   : milestone, 2097,
iast_GLOBAL (2.143 ms) : 2089, 2196
.   : milestone, 2143,
profiling (1.959 ms) : 1917, 2002
.   : milestone, 1959,
tracing (1.94 ms) : 1899, 1981
.   : milestone, 1940,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.369 ms) : 2327, 2411
.   : milestone, 2369,
iast (2.094 ms) : 2041, 2147
.   : milestone, 2094,
iast_GLOBAL (2.131 ms) : 2078, 2185
.   : milestone, 2131,
profiling (1.99 ms) : 1946, 2035
.   : milestone, 1990,
tracing (1.937 ms) : 1897, 1978
.   : milestone, 1937,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	2.358 ms [2.316 ms, 2.401 ms]	885.028 µs (60.1%)
iast	2.097 ms [2.044 ms, 2.15 ms]	623.4 µs (42.3%)
iast_GLOBAL	2.143 ms [2.089 ms, 2.196 ms]	669.552 µs (45.4%)
profiling	1.959 ms [1.917 ms, 2.002 ms]	485.973 µs (33.0%)
tracing	1.94 ms [1.899 ms, 1.981 ms]	467.051 µs (31.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	2.369 ms [2.327 ms, 2.411 ms]	898.753 µs (61.1%)
iast	2.094 ms [2.041 ms, 2.147 ms]	623.574 µs (42.4%)
iast_GLOBAL	2.131 ms [2.078 ms, 2.185 ms]	661.036 µs (45.0%)
profiling	1.99 ms [1.946 ms, 2.035 ms]	520.093 µs (35.4%)
tracing	1.937 ms [1.897 ms, 1.978 ms]	466.915 µs (31.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~fd72025912, baseline=1.45.0-SNAPSHOT~a8b33d5c49
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.475 s) : 15475000, 15475000
.   : milestone, 15475000,
appsec (15.074 s) : 15074000, 15074000
.   : milestone, 15074000,
iast (18.918 s) : 18918000, 18918000
.   : milestone, 18918000,
iast_GLOBAL (17.724 s) : 17724000, 17724000
.   : milestone, 17724000,
profiling (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
tracing (14.777 s) : 14777000, 14777000
.   : milestone, 14777000,
section candidate
no_agent (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
appsec (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
iast (18.8 s) : 18800000, 18800000
.   : milestone, 18800000,
iast_GLOBAL (18.098 s) : 18098000, 18098000
.   : milestone, 18098000,
profiling (15.013 s) : 15013000, 15013000
.   : milestone, 15013000,
tracing (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.475 s [15.475 s, 15.475 s]	-
appsec	15.074 s [15.074 s, 15.074 s]	-401.0 ms (-2.6%)
iast	18.918 s [18.918 s, 18.918 s]	3.443 s (22.2%)
iast_GLOBAL	17.724 s [17.724 s, 17.724 s]	2.249 s (14.5%)
profiling	15.108 s [15.108 s, 15.108 s]	-367.0 ms (-2.4%)
tracing	14.777 s [14.777 s, 14.777 s]	-698.0 ms (-4.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.961 s [14.961 s, 14.961 s]	-
appsec	15.149 s [15.149 s, 15.149 s]	188.0 ms (1.3%)
iast	18.8 s [18.8 s, 18.8 s]	3.839 s (25.7%)
iast_GLOBAL	18.098 s [18.098 s, 18.098 s]	3.137 s (21.0%)
profiling	15.013 s [15.013 s, 15.013 s]	52.0 ms (0.3%)
tracing	15.054 s [15.054 s, 15.054 s]	93.0 ms (0.6%)

Retry telemetry requests if CI Visibility is enabled

fd72025

nikita-tkachenko-datadog added the comp: telemetry Telemetry label Jan 3, 2025

nikita-tkachenko-datadog marked this pull request as ready for review January 3, 2025 11:28

nikita-tkachenko-datadog requested a review from a team as a code owner January 3, 2025 11:28

nikita-tkachenko-datadog requested a review from mcculls January 3, 2025 11:28

nikita-tkachenko-datadog added the type: enhancement label Jan 3, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Retry telemetry requests if CI Visibility is enabled #8147

Retry telemetry requests if CI Visibility is enabled #8147

nikita-tkachenko-datadog commented Jan 3, 2025 •

edited by jira bot

Loading

github-actions bot commented Jan 3, 2025

pr-commenter bot commented Jan 3, 2025

Retry telemetry requests if CI Visibility is enabled #8147

Are you sure you want to change the base?

Retry telemetry requests if CI Visibility is enabled #8147

Conversation

nikita-tkachenko-datadog commented Jan 3, 2025 • edited by jira bot Loading

What Does This Do

Motivation

Contributor Checklist

github-actions bot commented Jan 3, 2025

pr-commenter bot commented Jan 3, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

nikita-tkachenko-datadog commented Jan 3, 2025 •

edited by jira bot

Loading