{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":1090311,"defaultBranch":"main","name":"logstash","ownerLogin":"elastic","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2010-11-18T01:31:50.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/6764390?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1719617715.0","currentOid":""},"activityList":{"items":[{"before":"9cc0ab20f508f036c9854a47f7c32f50a0adcfcc","after":null,"ref":"refs/heads/backport_16268_8.14","pushedAt":"2024-06-28T23:35:15.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"karenzone","name":"Karen Metts","path":"/karenzone","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35154725?s=80&v=4"}},{"before":"3467751f906c6af8c6c204a739345f9f02912e2a","after":"6b8968476d68aecab028ea5c041d8a16759ace02","ref":"refs/heads/8.14","pushedAt":"2024-06-28T23:35:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"karenzone","name":"Karen Metts","path":"/karenzone","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35154725?s=80&v=4"},"commit":{"message":"Doc: Add ecs and datastream requirement for intg filter (#16268) (#16270)\n\n(cherry picked from commit 095733c409eaa75e71d46019d7df0df8b6d5caed)\r\n\r\nCo-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>","shortMessageHtmlLink":"Doc: Add ecs and datastream requirement for intg filter (#16268) (#16270"}},{"before":null,"after":"9cc0ab20f508f036c9854a47f7c32f50a0adcfcc","ref":"refs/heads/backport_16268_8.14","pushedAt":"2024-06-28T23:26:31.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Doc: Add ecs and datastream requirement for intg filter (#16268)\n\n(cherry picked from commit 095733c409eaa75e71d46019d7df0df8b6d5caed)","shortMessageHtmlLink":"Doc: Add ecs and datastream requirement for intg filter (#16268)"}},{"before":"784fa186c822a3d93499edbe60d9a6f18ac967aa","after":"095733c409eaa75e71d46019d7df0df8b6d5caed","ref":"refs/heads/main","pushedAt":"2024-06-28T23:25:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"karenzone","name":"Karen Metts","path":"/karenzone","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35154725?s=80&v=4"},"commit":{"message":"Doc: Add ecs and datastream requirement for intg filter (#16268)","shortMessageHtmlLink":"Doc: Add ecs and datastream requirement for intg filter (#16268)"}},{"before":"ec69624adea15349b3cffa53652703a39aa01954","after":null,"ref":"refs/heads/backport_15981_8.14","pushedAt":"2024-06-28T23:24:45.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"karenzone","name":"Karen Metts","path":"/karenzone","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35154725?s=80&v=4"}},{"before":"bd7e40885c60b56b61164094fd35979efdb6f1ac","after":"3467751f906c6af8c6c204a739345f9f02912e2a","ref":"refs/heads/8.14","pushedAt":"2024-06-28T23:24:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"karenzone","name":"Karen Metts","path":"/karenzone","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35154725?s=80&v=4"},"commit":{"message":"Doc: Remove include statements for screenshots not rendering properly (#15981) (#16269)\n\n(cherry picked from commit cb45cd28cc005a580c81c05ce6032206c5731f3b)\r\n\r\nCo-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>","shortMessageHtmlLink":"Doc: Remove include statements for screenshots not rendering properly ("}},{"before":null,"after":"ec69624adea15349b3cffa53652703a39aa01954","ref":"refs/heads/backport_15981_8.14","pushedAt":"2024-06-28T23:00:33.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Doc: Remove include statements for screenshots not rendering properly (#15981)\n\n(cherry picked from commit cb45cd28cc005a580c81c05ce6032206c5731f3b)","shortMessageHtmlLink":"Doc: Remove include statements for screenshots not rendering properly ("}},{"before":"b6325639519bd952892d8a325d58c4d443de2518","after":"4ed81eae1464fba0a00c428f0222eccd15442ee9","ref":"refs/heads/update_release_notes_1719594453","pushedAt":"2024-06-28T17:46:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"human touch for 8.14.2 release notes","shortMessageHtmlLink":"human touch for 8.14.2 release notes"}},{"before":null,"after":"b6325639519bd952892d8a325d58c4d443de2518","ref":"refs/heads/update_release_notes_1719594453","pushedAt":"2024-06-28T17:07:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update release notes for 8.14.2","shortMessageHtmlLink":"Update release notes for 8.14.2"}},{"before":"0cfe6b0801fcbb20cf28559e9b37dedc0de3db3a","after":"784fa186c822a3d93499edbe60d9a6f18ac967aa","ref":"refs/heads/main","pushedAt":"2024-06-28T11:13:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"edmocosta","name":"Edmo Vamerlatti Costa","path":"/edmocosta","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11836452?s=80&v=4"},"commit":{"message":"Ensure pipeline metrics are cleared on the pipeline shutdown (#16264)\n\nThis commit fixed the configuration reload process to clean up the pipeline's metric store, so it does not retain references to failed pipelines components.","shortMessageHtmlLink":"Ensure pipeline metrics are cleared on the pipeline shutdown (#16264)"}},{"before":"0e1d67eda9f1ea64f9c9ebbb6ab118e251b9f956","after":"0cfe6b0801fcbb20cf28559e9b37dedc0de3db3a","ref":"refs/heads/main","pushedAt":"2024-06-27T20:08:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mashhurs","name":"Mashhur","path":"/mashhurs","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/99575341?s=80&v=4"},"commit":{"message":"Add `RubyEvent#dup` support and unit test case to keep `Json#dump(Event)` safe. (#16255)\n\n* Add RubyEvent#dup support and unit test case to keep Json#dump(Event) safe.\r\n\r\n\r\nCo-authored-by: Ry Biesemeyer \r\n\r\n---------\r\n\r\nCo-authored-by: Ry Biesemeyer ","shortMessageHtmlLink":"Add RubyEvent#dup support and unit test case to keep `Json#dump(Eve…"}},{"before":"bc0b9556bde537bcbc13cdcb4ea6dfa56ff5def0","after":"0e1d67eda9f1ea64f9c9ebbb6ab118e251b9f956","ref":"refs/heads/main","pushedAt":"2024-06-26T12:50:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jsvd","name":"João Duarte","path":"/jsvd","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/31809?s=80&v=4"},"commit":{"message":"produce wolfi docker image in ci (#16252)","shortMessageHtmlLink":"produce wolfi docker image in ci (#16252)"}},{"before":"e6682c94b9e97907525c3b5f21f884c115ad3ad4","after":"bc0b9556bde537bcbc13cdcb4ea6dfa56ff5def0","ref":"refs/heads/main","pushedAt":"2024-06-26T10:05:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jsvd","name":"João Duarte","path":"/jsvd","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/31809?s=80&v=4"},"commit":{"message":"Add quotes to fix path handling in pqcheck.bat (#16205)","shortMessageHtmlLink":"Add quotes to fix path handling in pqcheck.bat (#16205)"}},{"before":"04d193d613002b0f7d20e90ba5da8abffb9cc209","after":"bd7e40885c60b56b61164094fd35979efdb6f1ac","ref":"refs/heads/8.14","pushedAt":"2024-06-25T22:11:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Backport 16250 8.14 (#16259)\n\n* sync notices\r\n\r\n* backport 16250\r\n\r\nCo-authored-by: Mashhur <99575341+mashhurs@users.noreply.github.com>\r\n\r\n---------\r\n\r\nCo-authored-by: Mashhur <99575341+mashhurs@users.noreply.github.com>","shortMessageHtmlLink":"Backport 16250 8.14 (#16259)"}},{"before":"9758c70129832b6e89b8896fcd05a93b0bd716d4","after":null,"ref":"refs/heads/update_lock_1719342623","pushedAt":"2024-06-25T21:13:57.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"}},{"before":"ff37802a77a905a63395afda2fea78198fd3a205","after":"04d193d613002b0f7d20e90ba5da8abffb9cc209","ref":"refs/heads/8.14","pushedAt":"2024-06-25T21:13:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Update patch plugin versions in gemfile lock (#16258)\n\nCo-authored-by: logstashmachine <43502315+logstashmachine@users.noreply.github.com>","shortMessageHtmlLink":"Update patch plugin versions in gemfile lock (#16258)"}},{"before":null,"after":"a6796b04a3a189bd1203be1852b91de92d215a41","ref":"refs/heads/backport-16250-8.14","pushedAt":"2024-06-25T21:00:37.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"sync notices","shortMessageHtmlLink":"sync notices"}},{"before":"0ec16ca39825d3e01fca4120fe2ef88775af5798","after":"e6682c94b9e97907525c3b5f21f884c115ad3ad4","ref":"refs/heads/main","pushedAt":"2024-06-25T19:14:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Pin fileutils version to 1.7+ (#16250)\n\n* Pin fileutils version to 1.7+\r\n\r\n* Add fileutils license notice.","shortMessageHtmlLink":"Pin fileutils version to 1.7+ (#16250)"}},{"before":null,"after":"9758c70129832b6e89b8896fcd05a93b0bd716d4","ref":"refs/heads/update_lock_1719342623","pushedAt":"2024-06-25T19:10:24.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update patch plugin versions in gemfile lock","shortMessageHtmlLink":"Update patch plugin versions in gemfile lock"}},{"before":"554c695958e49720081f0ec009beaf5c05057e03","after":null,"ref":"refs/heads/backport_15971_8.14","pushedAt":"2024-06-25T16:46:59.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"}},{"before":"a5b7d2bfadf2405948f87bcba33bdd93894e650b","after":"ff37802a77a905a63395afda2fea78198fd3a205","ref":"refs/heads/8.14","pushedAt":"2024-06-25T16:46:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Unicode pipeline and plugin ids (#15971) (#16257)\n\n* fix: restore support for unicode pipeline- and plugin-id's\r\n\r\nJRuby's `Ruby#newSymbol(String)` throws an exception when provided a `String`\r\nthat contains characters outside of lower-ASCII because JRuby internals expect\r\n\"the incoming String to be one of our mangled ISO-8859-1 strings\" as noted in\r\na comment on jruby/jruby#6217.\r\n\r\nInstead, we use `Ruby#newString(String)` to create a new `RubyString` (which\r\nworks properly), and then rely on `RubyString#intern` to get our `RubySymbol`.\r\n\r\nThis fixes a regression introduced in the 8.7 series in which pipeline id's\r\nare consistently represented as ruby symbols in the metrics store, and ensures\r\nsimilar issue does not exist when specifying a plugin id that contains\r\ncharacters above the lower-ASCII plane.\r\n\r\n* fix: use properly-encoded RubySymbol in PipelineConfig\r\n\r\nWe cannot rely on `RubySymbol#toString` to produce a properly-encoded `String`\r\nwhe the string contains characters above the lower-ASCII plane because the\r\nresult is effectively a binary ruby-internal marshal of the bytes that only\r\nholds when the symbol contains lower-ASCII.\r\n\r\nInstead, we can use the internally-memoizing `RubySymbol#name` to get a\r\nproperly-encoded `RubyString`, and `RubyString#asJavaString()` to get a\r\nproperly-encoded java-`String`.\r\n\r\n* fix: properly serialize unicode pipeline names in API output\r\n\r\nJackson's JSON serializer leaks the JRuby-internal byte structure of Symbols,\r\nwhich only aligns with the byte-structure of the symbol's actual string when\r\nthat string is wholly-comprised of lower-ASCII characters.\r\n\r\nBy pre-converting Symbols to Strings, we ensure that the result is readable\r\nand useful.\r\n\r\n* spec: bypass monitoring specs for unicode pipeline ids when PQ enabled\r\n\r\n(cherry picked from commit 0ec16ca39825d3e01fca4120fe2ef88775af5798)\r\n\r\nCo-authored-by: Ry Biesemeyer ","shortMessageHtmlLink":"Unicode pipeline and plugin ids (#15971) (#16257)"}},{"before":null,"after":"554c695958e49720081f0ec009beaf5c05057e03","ref":"refs/heads/backport_15971_8.14","pushedAt":"2024-06-25T15:36:03.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Unicode pipeline and plugin ids (#15971)\n\n* fix: restore support for unicode pipeline- and plugin-id's\n\nJRuby's `Ruby#newSymbol(String)` throws an exception when provided a `String`\nthat contains characters outside of lower-ASCII because JRuby internals expect\n\"the incoming String to be one of our mangled ISO-8859-1 strings\" as noted in\na comment on jruby/jruby#6217.\n\nInstead, we use `Ruby#newString(String)` to create a new `RubyString` (which\nworks properly), and then rely on `RubyString#intern` to get our `RubySymbol`.\n\nThis fixes a regression introduced in the 8.7 series in which pipeline id's\nare consistently represented as ruby symbols in the metrics store, and ensures\nsimilar issue does not exist when specifying a plugin id that contains\ncharacters above the lower-ASCII plane.\n\n* fix: use properly-encoded RubySymbol in PipelineConfig\n\nWe cannot rely on `RubySymbol#toString` to produce a properly-encoded `String`\nwhe the string contains characters above the lower-ASCII plane because the\nresult is effectively a binary ruby-internal marshal of the bytes that only\nholds when the symbol contains lower-ASCII.\n\nInstead, we can use the internally-memoizing `RubySymbol#name` to get a\nproperly-encoded `RubyString`, and `RubyString#asJavaString()` to get a\nproperly-encoded java-`String`.\n\n* fix: properly serialize unicode pipeline names in API output\n\nJackson's JSON serializer leaks the JRuby-internal byte structure of Symbols,\nwhich only aligns with the byte-structure of the symbol's actual string when\nthat string is wholly-comprised of lower-ASCII characters.\n\nBy pre-converting Symbols to Strings, we ensure that the result is readable\nand useful.\n\n* spec: bypass monitoring specs for unicode pipeline ids when PQ enabled\n\n(cherry picked from commit 0ec16ca39825d3e01fca4120fe2ef88775af5798)","shortMessageHtmlLink":"Unicode pipeline and plugin ids (#15971)"}},{"before":"440aa98e48d2589d9251170750caf28533a921ce","after":"0ec16ca39825d3e01fca4120fe2ef88775af5798","ref":"refs/heads/main","pushedAt":"2024-06-25T15:35:28.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Unicode pipeline and plugin ids (#15971)\n\n* fix: restore support for unicode pipeline- and plugin-id's\r\n\r\nJRuby's `Ruby#newSymbol(String)` throws an exception when provided a `String`\r\nthat contains characters outside of lower-ASCII because JRuby internals expect\r\n\"the incoming String to be one of our mangled ISO-8859-1 strings\" as noted in\r\na comment on jruby/jruby#6217.\r\n\r\nInstead, we use `Ruby#newString(String)` to create a new `RubyString` (which\r\nworks properly), and then rely on `RubyString#intern` to get our `RubySymbol`.\r\n\r\nThis fixes a regression introduced in the 8.7 series in which pipeline id's\r\nare consistently represented as ruby symbols in the metrics store, and ensures\r\nsimilar issue does not exist when specifying a plugin id that contains\r\ncharacters above the lower-ASCII plane.\r\n\r\n* fix: use properly-encoded RubySymbol in PipelineConfig\r\n\r\nWe cannot rely on `RubySymbol#toString` to produce a properly-encoded `String`\r\nwhe the string contains characters above the lower-ASCII plane because the\r\nresult is effectively a binary ruby-internal marshal of the bytes that only\r\nholds when the symbol contains lower-ASCII.\r\n\r\nInstead, we can use the internally-memoizing `RubySymbol#name` to get a\r\nproperly-encoded `RubyString`, and `RubyString#asJavaString()` to get a\r\nproperly-encoded java-`String`.\r\n\r\n* fix: properly serialize unicode pipeline names in API output\r\n\r\nJackson's JSON serializer leaks the JRuby-internal byte structure of Symbols,\r\nwhich only aligns with the byte-structure of the symbol's actual string when\r\nthat string is wholly-comprised of lower-ASCII characters.\r\n\r\nBy pre-converting Symbols to Strings, we ensure that the result is readable\r\nand useful.\r\n\r\n* spec: bypass monitoring specs for unicode pipeline ids when PQ enabled","shortMessageHtmlLink":"Unicode pipeline and plugin ids (#15971)"}},{"before":"8b2c6de4880dba7f92bb20ba1be5cc2e1e07926d","after":"28cb00b6eddb6f6606a75faa975a71faf06f333c","ref":"refs/heads/7.17","pushedAt":"2024-06-25T09:07:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"andsel","name":"Andrea Selva","path":"/andsel","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1038545?s=80&v=4"},"commit":{"message":"Require kafka integration to 10.12 for 7.17 (#16256)\n\nBump gemlock to bundle logstash-integration-kafka =>10.12.1","shortMessageHtmlLink":"Require kafka integration to 10.12 for 7.17 (#16256)"}},{"before":"b59e47e04aacff6bd0229256ae120e9e81852c4d","after":null,"ref":"refs/heads/backport_16213_8.14","pushedAt":"2024-06-24T19:21:20.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"mashhurs","name":"Mashhur","path":"/mashhurs","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/99575341?s=80&v=4"}},{"before":"a42c71a90497005a99d971633419cd5221f0090f","after":"a5b7d2bfadf2405948f87bcba33bdd93894e650b","ref":"refs/heads/8.14","pushedAt":"2024-06-24T19:21:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mashhurs","name":"Mashhur","path":"/mashhurs","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/99575341?s=80&v=4"},"commit":{"message":"json: remove unnecessary dup/freeze in serialization (#16213) (#16253)\n\n(cherry picked from commit 92909cb1c49ebff9868657515188b491892c6ccf)\r\n\r\nCo-authored-by: Ry Biesemeyer ","shortMessageHtmlLink":"json: remove unnecessary dup/freeze in serialization (#16213) (#16253)"}},{"before":null,"after":"b59e47e04aacff6bd0229256ae120e9e81852c4d","ref":"refs/heads/backport_16213_8.14","pushedAt":"2024-06-24T19:09:46.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"json: remove unnecessary dup/freeze in serialization (#16213)\n\n(cherry picked from commit 92909cb1c49ebff9868657515188b491892c6ccf)","shortMessageHtmlLink":"json: remove unnecessary dup/freeze in serialization (#16213)"}},{"before":"92909cb1c49ebff9868657515188b491892c6ccf","after":"440aa98e48d2589d9251170750caf28533a921ce","ref":"refs/heads/main","pushedAt":"2024-06-21T21:48:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kaisecheng","name":null,"path":"/kaisecheng","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/69120390?s=80&v=4"},"commit":{"message":"[CI] Benchmark pipeline (#16191)\n\nAdd a buildkite pipeline to do benchmark.\r\nThe script does benchmark by running Filebeats (docker) -> Logstash (docker) -> ES Cloud.\r\nLogstash metrics and benchmark results are sent to the same ES Cloud.\r\n- Secrets store in vault `secret/ci/elastic-logstash/benchmark`\r\n- Use flog (docker) to generate ~2GB logs\r\n- Pull the snapshot docker image of the main branch every day\r\n- Logstash runs two pipelines, main and node_stats\r\n - The main pipeline handles beats ingestion, sending data to the data stream `logs-generic-default`\r\n - It runs for all combinations. (pq + mq) x worker x batch size\r\n - Each test runs for ~7 minutes\r\n - The node_stats pipeline retrieves /_node/stats API every 30s and sends it to the data stream `metrics-nodestats-logstash`\r\n- The script sends a summary of EPS and resource usage to index `benchmark_summary`\r\n\r\nThe buildkite pipeline accepts ENV variables to customize the test\r\n| Variable Name | Default Value | Comment |\r\n|-----------------|---------------------|----------------------------------------------------|\r\n| FB_VERSION | 8.13.4 | docker tag |\r\n| LS_VERSION | | docker tag |\r\n| LS_JAVA_OPTS | -Xmx2g | by default, Xmx is set to half of memory |\r\n| MULTIPLIERS | 2,4,6 | determine the number of workers (cpu * multiplier) |\r\n| BATCH_SIZES | 125,1000 | |\r\n| CPU | 4 | number of cpu for Logstash container |\r\n| MEM | 4 | number of GB for Logstash container |\r\n| QTYPE | memory | queue type to test -- persisted; memory; all |\r\n| FB_CNT | 4 | number of filebeats to use in benchmark |\r\n\r\nTo check the result\r\n- `vault read secret/ci/elastic-logstash/benchmark` to get the host and credentials\r\n- `curl -u \"$ES_USER:$ES_PW\" \"$ES_HOST/benchmark_summary/_search\"`\r\n\r\nFixes: https://github.com/elastic/ingest-dev/issues/3377","shortMessageHtmlLink":"[CI] Benchmark pipeline (#16191)"}},{"before":"066cb7984242442c45e20d327d752ccbc1728222","after":null,"ref":"refs/heads/backport_16204_8.14","pushedAt":"2024-06-20T18:46:36.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"}},{"before":"0ba5330b5f8176c34bea807e04cf6b02fbf7a679","after":"a42c71a90497005a99d971633419cd5221f0090f","ref":"refs/heads/8.14","pushedAt":"2024-06-20T18:46:32.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yaauie","name":"Ry Biesemeyer","path":"/yaauie","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/210924?s=80&v=4"},"commit":{"message":"Avoid to log file not found errors when DLQ segments are removed concurrently between writer and reader. (#16204) (#16249)\n\n* Rework the logic to delete DLQ eldest segments to be more resilient on file not found errors and avoid to log warn messages that there isn't any action the user can do to solve.\r\n\r\n* Fixed test case, when path point to a file that doesn't exist, rely always on path name comparator. Reworked the code to simplify, not needing anymore the tri-state variable\r\n\r\n(cherry picked from commit 321e407e537c16ad32b69be844ebfc1f0aea02d5)\r\n\r\nCo-authored-by: Andrea Selva ","shortMessageHtmlLink":"Avoid to log file not found errors when DLQ segments are removed conc…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEckt1wQA","startCursor":null,"endCursor":null}},"title":"Activity · elastic/logstash"}