-
Notifications
You must be signed in to change notification settings - Fork 279
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add more metrics and tags to CI Visibility telemetry #7223
Merged
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/ci-vis-telemetry-improve
Jun 20, 2024
Merged
Add more metrics and tags to CI Visibility telemetry #7223
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/ci-vis-telemetry-improve
Jun 20, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069797
Total [baseline] (10.337 s) : 0, 10336516
Agent [candidate] (1.063 s) : 0, 1062771
Total [candidate] (10.308 s) : 0, 10307846
section appsec
Agent [baseline] (1.188 s) : 0, 1187931
Total [baseline] (10.487 s) : 0, 10487479
Agent [candidate] (1.187 s) : 0, 1186875
Total [candidate] (10.491 s) : 0, 10491131
section iast
Agent [baseline] (1.169 s) : 0, 1169053
Total [baseline] (10.695 s) : 0, 10695417
Agent [candidate] (1.17 s) : 0, 1169800
Total [candidate] (10.711 s) : 0, 10711137
section profiling
Agent [baseline] (1.262 s) : 0, 1262311
Total [baseline] (10.606 s) : 0, 10606067
Agent [candidate] (1.27 s) : 0, 1269671
Total [candidate] (10.631 s) : 0, 10631396
gantt
title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.936 ms) : 0, 670936
BytebuddyAgent [candidate] (666.342 ms) : 0, 666342
GlobalTracer [baseline] (305.419 ms) : 0, 305419
GlobalTracer [candidate] (303.491 ms) : 0, 303491
AppSec [baseline] (50.391 ms) : 0, 50391
AppSec [candidate] (50.181 ms) : 0, 50181
Remote Config [baseline] (692.088 µs) : 0, 692
Remote Config [candidate] (689.535 µs) : 0, 690
Telemetry [baseline] (7.658 ms) : 0, 7658
Telemetry [candidate] (7.616 ms) : 0, 7616
section appsec
BytebuddyAgent [baseline] (680.013 ms) : 0, 680013
BytebuddyAgent [candidate] (679.097 ms) : 0, 679097
GlobalTracer [baseline] (298.496 ms) : 0, 298496
GlobalTracer [candidate] (298.693 ms) : 0, 298693
AppSec [baseline] (154.081 ms) : 0, 154081
AppSec [candidate] (154.203 ms) : 0, 154203
Remote Config [baseline] (639.423 µs) : 0, 639
Remote Config [candidate] (641.816 µs) : 0, 642
Telemetry [baseline] (9.472 ms) : 0, 9472
Telemetry [candidate] (9.159 ms) : 0, 9159
IAST [baseline] (21.114 ms) : 0, 21114
IAST [candidate] (20.963 ms) : 0, 20963
section iast
BytebuddyAgent [baseline] (779.674 ms) : 0, 779674
BytebuddyAgent [candidate] (779.815 ms) : 0, 779815
GlobalTracer [baseline] (293.151 ms) : 0, 293151
GlobalTracer [candidate] (293.511 ms) : 0, 293511
AppSec [baseline] (47.228 ms) : 0, 47228
AppSec [candidate] (47.07 ms) : 0, 47070
Remote Config [baseline] (635.653 µs) : 0, 636
Remote Config [candidate] (638.496 µs) : 0, 638
Telemetry [baseline] (7.722 ms) : 0, 7722
Telemetry [candidate] (6.818 ms) : 0, 6818
IAST [baseline] (27.346 ms) : 0, 27346
IAST [candidate] (28.626 ms) : 0, 28626
section profiling
BytebuddyAgent [baseline] (663.602 ms) : 0, 663602
BytebuddyAgent [candidate] (667.44 ms) : 0, 667440
GlobalTracer [baseline] (386.033 ms) : 0, 386033
GlobalTracer [candidate] (388.382 ms) : 0, 388382
AppSec [baseline] (51.537 ms) : 0, 51537
AppSec [candidate] (51.497 ms) : 0, 51497
Remote Config [baseline] (759.1 µs) : 0, 759
Remote Config [candidate] (720.803 µs) : 0, 721
Telemetry [baseline] (7.385 ms) : 0, 7385
Telemetry [candidate] (7.41 ms) : 0, 7410
ProfilingAgent [baseline] (95.829 ms) : 0, 95829
ProfilingAgent [candidate] (96.751 ms) : 0, 96751
Profiling [baseline] (95.854 ms) : 0, 95854
Profiling [candidate] (96.776 ms) : 0, 96776
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061309
Total [baseline] (8.522 s) : 0, 8522337
Agent [candidate] (1.061 s) : 0, 1060603
Total [candidate] (8.529 s) : 0, 8528763
section iast
Agent [baseline] (1.166 s) : 0, 1165846
Total [baseline] (8.986 s) : 0, 8985642
Agent [candidate] (1.177 s) : 0, 1177110
Total [candidate] (9.018 s) : 0, 9018213
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.175 s) : 0, 1175392
Total [baseline] (9.004 s) : 0, 9004258
Agent [candidate] (1.172 s) : 0, 1172193
Total [candidate] (9.015 s) : 0, 9014715
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1172192
Total [baseline] (8.985 s) : 0, 8984971
Agent [candidate] (1.169 s) : 0, 1168809
Total [candidate] (8.989 s) : 0, 8988977
gantt
title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (665.099 ms) : 0, 665099
BytebuddyAgent [candidate] (664.778 ms) : 0, 664778
GlobalTracer [baseline] (303.157 ms) : 0, 303157
GlobalTracer [candidate] (303.092 ms) : 0, 303092
AppSec [baseline] (50.43 ms) : 0, 50430
AppSec [candidate] (50.126 ms) : 0, 50126
Remote Config [baseline] (684.931 µs) : 0, 685
Remote Config [candidate] (680.45 µs) : 0, 680
Telemetry [baseline] (7.546 ms) : 0, 7546
Telemetry [candidate] (7.598 ms) : 0, 7598
section iast
BytebuddyAgent [baseline] (779.021 ms) : 0, 779021
BytebuddyAgent [candidate] (784.937 ms) : 0, 784937
GlobalTracer [baseline] (292.078 ms) : 0, 292078
GlobalTracer [candidate] (295.222 ms) : 0, 295222
AppSec [baseline] (47.047 ms) : 0, 47047
AppSec [candidate] (47.257 ms) : 0, 47257
Remote Config [baseline] (658.424 µs) : 0, 658
Remote Config [candidate] (614.332 µs) : 0, 614
Telemetry [baseline] (7.007 ms) : 0, 7007
Telemetry [candidate] (7.592 ms) : 0, 7592
IAST [baseline] (26.776 ms) : 0, 26776
IAST [candidate] (28.125 ms) : 0, 28125
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (785.494 ms) : 0, 785494
BytebuddyAgent [candidate] (780.879 ms) : 0, 780879
GlobalTracer [baseline] (295.401 ms) : 0, 295401
GlobalTracer [candidate] (294.034 ms) : 0, 294034
AppSec [baseline] (47.419 ms) : 0, 47419
AppSec [candidate] (47.298 ms) : 0, 47298
Remote Config [baseline] (659.123 µs) : 0, 659
Remote Config [candidate] (617.392 µs) : 0, 617
Telemetry [baseline] (7.065 ms) : 0, 7065
Telemetry [candidate] (7.713 ms) : 0, 7713
IAST [baseline] (25.97 ms) : 0, 25970
IAST [candidate] (28.29 ms) : 0, 28290
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (781.403 ms) : 0, 781403
BytebuddyAgent [candidate] (778.687 ms) : 0, 778687
GlobalTracer [baseline] (294.041 ms) : 0, 294041
GlobalTracer [candidate] (293.551 ms) : 0, 293551
AppSec [baseline] (47.378 ms) : 0, 47378
AppSec [candidate] (47.268 ms) : 0, 47268
Remote Config [baseline] (597.129 µs) : 0, 597
Remote Config [candidate] (587.039 µs) : 0, 587
Telemetry [baseline] (9.161 ms) : 0, 9161
Telemetry [candidate] (7.541 ms) : 0, 7541
IAST [baseline] (26.207 ms) : 0, 26207
IAST [candidate] (27.804 ms) : 0, 27804
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section baseline
no_agent (1.363 ms) : 1344, 1382
. : milestone, 1363,
appsec (1.739 ms) : 1715, 1762
. : milestone, 1739,
appsec_no_iast (1.736 ms) : 1711, 1760
. : milestone, 1736,
iast (1.507 ms) : 1486, 1529
. : milestone, 1507,
profiling (1.51 ms) : 1484, 1537
. : milestone, 1510,
tracing (1.479 ms) : 1455, 1503
. : milestone, 1479,
section candidate
no_agent (1.372 ms) : 1353, 1391
. : milestone, 1372,
appsec (1.747 ms) : 1723, 1771
. : milestone, 1747,
appsec_no_iast (1.733 ms) : 1708, 1757
. : milestone, 1733,
iast (1.497 ms) : 1474, 1519
. : milestone, 1497,
profiling (1.521 ms) : 1495, 1547
. : milestone, 1521,
tracing (1.474 ms) : 1450, 1498
. : milestone, 1474,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section baseline
no_agent (371.688 µs) : 352, 392
. : milestone, 372,
iast (492.511 µs) : 471, 514
. : milestone, 493,
iast_FULL (561.976 µs) : 541, 583
. : milestone, 562,
iast_GLOBAL (510.218 µs) : 489, 531
. : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (488.711 µs) : 467, 510
. : milestone, 489,
iast_INACTIVE (469.278 µs) : 447, 492
. : milestone, 469,
iast_TELEMETRY_OFF (482.093 µs) : 461, 504
. : milestone, 482,
tracing (450.766 µs) : 430, 472
. : milestone, 451,
section candidate
no_agent (376.027 µs) : 356, 396
. : milestone, 376,
iast (491.642 µs) : 470, 513
. : milestone, 492,
iast_FULL (556.569 µs) : 535, 578
. : milestone, 557,
iast_GLOBAL (515.819 µs) : 494, 538
. : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (493.144 µs) : 472, 514
. : milestone, 493,
iast_INACTIVE (461.401 µs) : 440, 483
. : milestone, 461,
iast_TELEMETRY_OFF (478.383 µs) : 457, 500
. : milestone, 478,
tracing (450.661 µs) : 430, 472
. : milestone, 451,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section baseline
no_agent (1.456 ms) : 1445, 1468
. : milestone, 1456,
appsec (2.211 ms) : 2176, 2246
. : milestone, 2211,
iast (1.961 ms) : 1920, 2002
. : milestone, 1961,
iast_GLOBAL (1.999 ms) : 1958, 2040
. : milestone, 1999,
profiling (1.854 ms) : 1819, 1888
. : milestone, 1854,
tracing (1.818 ms) : 1786, 1849
. : milestone, 1818,
section candidate
no_agent (1.458 ms) : 1446, 1469
. : milestone, 1458,
appsec (2.205 ms) : 2171, 2239
. : milestone, 2205,
iast (1.954 ms) : 1913, 1995
. : milestone, 1954,
iast_GLOBAL (1.983 ms) : 1942, 2024
. : milestone, 1983,
profiling (1.834 ms) : 1800, 1868
. : milestone, 1834,
tracing (1.822 ms) : 1790, 1854
. : milestone, 1822,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~d5684e9254, baseline=1.36.0-SNAPSHOT~7294eaf157
dateFormat X
axisFormat %s
section baseline
no_agent (15.064 s) : 15064000, 15064000
. : milestone, 15064000,
appsec (14.831 s) : 14831000, 14831000
. : milestone, 14831000,
iast (18.968 s) : 18968000, 18968000
. : milestone, 18968000,
iast_GLOBAL (18.044 s) : 18044000, 18044000
. : milestone, 18044000,
profiling (15.584 s) : 15584000, 15584000
. : milestone, 15584000,
tracing (15.257 s) : 15257000, 15257000
. : milestone, 15257000,
section candidate
no_agent (15.006 s) : 15006000, 15006000
. : milestone, 15006000,
appsec (15.022 s) : 15022000, 15022000
. : milestone, 15022000,
iast (19.083 s) : 19083000, 19083000
. : milestone, 19083000,
iast_GLOBAL (17.9 s) : 17900000, 17900000
. : milestone, 17900000,
profiling (15.145 s) : 15145000, 15145000
. : milestone, 15145000,
tracing (15.169 s) : 15169000, 15169000
. : milestone, 15169000,
|
anmarchenko
approved these changes
Jun 20, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Adds more metrics and tags to CI Visibility telemetry.
Motivation
Improve libraries telemetry RFC
Jira ticket: SDTEST-412