Skip to content

Latest commit

 

History

History
800 lines (652 loc) · 47.3 KB

CHANGELOG.md

File metadata and controls

800 lines (652 loc) · 47.3 KB
Raw

Changelog

2.31.3

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.31.2, this release adds the following fix that we are working on getting accepted upstream:

Same as 2.31.2, this release includes the following fixes and features that we are working on getting accepted upstream:

  • Bug - Resolve cloudwatch_logs duplicate tag match SIGSEGV issue introduced in 2.29.0 aws-for-fluent-bit:542
  • Feature - Add kinesis_firehose and kinesis_streams support for time_key_format milliseconds with %3N option, and nanoseconds 9N and %L options fluent-bit:2831
  • Feature - Support OpenSearch Serverless data ingestion via OpenSearch plugin fluent-bit:6448
  • Enhancement - Transition S3 to fully synchronous file uploads to improve plugin stability fluent-bit:6573
  • Bug - Mitigate Datadog output plugin issue by reverting recent PR aws-for-fluent-bit:491
  • Bug - Format S3 filename with timestamp from the first log in uploaded file, rather than the time the first log was buffered by the s3 output aws-for-fluent-bit:459
  • Bug - Resolve S3 logic to display log_key missing warning message if the configured log_key field is missing from log payload fluent-bit:6557
  • Bug - ECS Metadata filter gracefuly handle task metadata query errors and cache metadata processing state to improve performance aws-for-fluent-bit:505
  • Bug - Support Retry_Limit option in S3 plugin to set retries fluent-bit:6475
  • Bug - Resolve a rare Datadog segfault that occurs when remapping tags aws-for-fluent-bit:491

2.31.2

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.31.1, this release adds the following feature that we are working on getting accepted upstream:

Same as 2.31.1, this release includes the following fixes and features that we are working on getting accepted upstream:

  • Feature - Add kinesis_firehose and kinesis_streams support for time_key_format milliseconds with %3N option, and nanoseconds 9N and %L options fluent-bit:2831
  • Feature - Support OpenSearch Serverless data ingestion via OpenSearch plugin fluent-bit:6448
  • Enhancement - Transition S3 to fully synchronous file uploads to improve plugin stability fluent-bit:6573
  • Bug - Mitigate Datadog output plugin issue by reverting recent PR aws-for-fluent-bit:491
  • Bug - Format S3 filename with timestamp from the first log in uploaded file, rather than the time the first log was buffered by the s3 output aws-for-fluent-bit:459
  • Bug - Resolve S3 logic to display log_key missing warning message if the configured log_key field is missing from log payload fluent-bit:6557
  • Bug - ECS Metadata filter gracefuly handle task metadata query errors and cache metadata processing state to improve performance aws-for-fluent-bit:505
  • Bug - Support Retry_Limit option in S3 plugin to set retries fluent-bit:6475
  • Bug - Resolve a rare Datadog segfault that occurs when remapping tags aws-for-fluent-bit:491

2.31.1

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.31.0, this release adds the following feature that we are working on getting accepted upstream:

Same as 2.31.0, this release includes the following fixes and features that we are working on getting accepted upstream:

  • Feature - Add kinesis_firehose and kinesis_streams support for time_key_format milliseconds with %3N option, and nanoseconds 9N and %L options fluent-bit:2831
  • Feature - Support OpenSearch Serverless data ingestion via OpenSearch plugin fluent-bit:6448
  • Enhancement - Transition S3 to fully synchronous file uploads to improve plugin stability fluent-bit:6573
  • Bug - Mitigate Datadog output plugin issue by reverting recent PR aws-for-fluent-bit:491
  • Bug - Format S3 filename with timestamp from the first log in uploaded file, rather than the time the first log was buffered by the s3 output aws-for-fluent-bit:459
  • Bug - Resolve S3 logic to display log_key missing warning message if the configured log_key field is missing from log payload fluent-bit:6557
  • Bug - ECS Metadata filter gracefuly handle task metadata query errors and cache metadata processing state to improve performance aws-for-fluent-bit:505

2.31.0

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.30.0, this release adds the following feature that we are working on getting accepted upstream:

  • Feature - Add kinesis_firehose and kinesis_streams support for time_key_format milliseconds with %3N option, and nanoseconds 9N and %L options fluent-bit:2831
  • Bug - Format S3 filename with timestamp from the first log in uploaded file, rather than the time the first log was buffered by the s3 output aws-for-fluent-bit:459
  • Enhancement - Transition S3 to fully synchronous file uploads to improve plugin stability fluent-bit:6573
  • Bug - Resolve S3 logic to display log_key missing warning message if the configured log_key field is missing from log payload fluent-bit:6557
  • Bug - ECS Metadata filter gracefuly handle task metadata query errors and cache metadata processing state to improve performance aws-for-fluent-bit:505

Same as 2.30.0, this release includes the following fixes and features that we are working on getting accepted upstream:

2.30.0

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.29.1, this release adds the following feature that we are working on getting accepted upstream:

  • Feature - Support OpenSearch Serverless data ingestion via OpenSearch plugin fluent-bit:6448

Same as 2.29.1, this release includes the following fix that we are working on getting accepted upstream:

2.29.1

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.29.0, this release includes the following fix that we are working on getting accepted upstream:

2.29.0

This release includes:

  • Fluent Bit 1.9.10
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Compared to 2.28.4 this release adds:

  • Feature - Add store_dir_limit_size option fluentbit-docs:971
  • Feature - New filter for AWS ECS Metadata fluentbit:5898
  • Enhancement - Different user agent on windows vs linux fluentbit:6325
  • Bug - Resolve Fluent Bit networking hangs affecting CloudWatch plugin by migrating to async networking + sync core scheduler fluentbit:6339

2.28.4

This release includes:

  • Fluent Bit 1.9.9
  • Amazon CloudWatch Logs for Fluent Bit 1.9.1
  • Amazon Kinesis Streams for Fluent Bit 1.10.1
  • Amazon Kinesis Firehose for Fluent Bit 1.7.1

Important Note:

  • Two security vulnerabilities were found in amazonlinux which we use as our base image- ALAS-40674 and ALAS-32207. This new image will be based on an updated version of amazonlinux that resolves this CVE.
  • This is the first release for aws-for-fluent-bit Windows. Therefore, at launch this has been marked as the stable version. However, with future versions, the stable tag would be older than latest and would have been vetted for stability by the customers.

Compared to 2.28.3 this release adds the following feature that we are working on getting accepted upstream:

  • enhancement - Separate AWS User Agents for windows and linux fluentbit:6325

2.28.3

This release includes:

  • Fluent Bit 1.9.9
  • Amazon CloudWatch Logs for Fluent Bit 1.9.0
  • Amazon Kinesis Streams for Fluent Bit 1.10.0
  • Amazon Kinesis Firehose for Fluent Bit 1.7.0

Important Note:

  • A security vulnerability was found in golang which we use to build our go plugins. This new image builds the go plugins with latest golang and resolves the CVE.

2.28.2

This release includes:

  • Fluent Bit 1.9.9
  • Amazon CloudWatch Logs for Fluent Bit 1.9.0
  • Amazon Kinesis Streams for Fluent Bit 1.10.0
  • Amazon Kinesis Firehose for Fluent Bit 1.7.0

Compared to 2.28.1 this release adds:

  • Bug - Stop trace_error from truncating the OpenSearch API call response fluentbit:5788

2.28.1

This release includes:

  • Fluent Bit 1.9.8
  • Amazon CloudWatch Logs for Fluent Bit 1.9.0
  • Amazon Kinesis Streams for Fluent Bit 1.10.0
  • Amazon Kinesis Firehose for Fluent Bit 1.7.0

Compared to 2.28.0 this release adds the following feature that we are working on getting accepted upstream:

  • Bug - Resolve long tag segfault issue. Without this patch, Fluent Bit may segfault if it encounters tags over 256 characters in length. fluentbit:5753

2.28.0

This release includes:

  • Fluent Bit 1.9.7
  • Amazon CloudWatch Logs for Fluent Bit 1.9.0
  • Amazon Kinesis Streams for Fluent Bit 1.10.0
  • Amazon Kinesis Firehose for Fluent Bit 1.7.0

Compared to 2.27.0 this release adds:

  • Feature - Add gzip compression support for multipart uploads in S3 Output plugin
  • Bug - S3 output key formatting inconsistent rendering of $TAG[n] aws-for-fluent-bit:376
  • Bug - fix concurrency issue in S3 key formatting
  • Bug - cloudwatch_logs plugin fix skip counting empty events

2.27.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.9.6
  • Amazon CloudWatch Logs for Fluent Bit 1.9.0
  • Amazon Kinesis Streams for Fluent Bit 1.10.0
  • Amazon Kinesis Firehose for Fluent Bit 1.7.0

Compared to 2.26.0 this release adds:

  • Feature - Add support for record accessor on cloudwatch_logs plugin fluentbit:3246
  • Enhancement - Update S3 PutObject size to 1GB s3:5688
  • Bug - Clear last recently used parser to match next parser for multiline filter fluentbit:5524

2.26.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.9.4
  • Amazon CloudWatch Logs for Fluent Bit 1.8.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.25.1 this release adds:

  • Feature - Add auto_create_stream option cloudwatch:257
  • Feature - Enable Apache Arrow support in S3 at compile time s3:3184
  • Enhancement - Add debug logs to check batch sizes fluentbit:5428
  • Enhancement - Set 1 worker as default for cloudwatch_logs plugin fluentbit:5417
  • Bug - Allow recovery from a stream being deleted and created by a user cloudwatch:257

Same as 2.25.1, this release includes the following enhancement for AWS customers that has been accepted by upstream:

  • Enhancement - Add kube_token_ttl option to kubernetes filter to support refreshing the service account token used to talk to the API server. Prior to this change Fluent Bit would only read the token on startup. fluentbit:5332

2.25.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.9.3
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.25.0 this release adds:

  • Bug - Fix new kube_token_ttl option in kubernetes filter to correctly parse TTL as a time value aws-for-fluent-bit:353

2.25.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.9.3
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.24.0 this release adds the following feature that we are working on getting accepted upstream:

  • Enhancement - Add kube_token_ttl option to kubernetes filter to support refreshing the service account token used to talk to the API server. Prior to this change Fluent Bit would only read the token on startup. fluentbit:5332

2.24.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.9.3
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.23.4 this release adds:

2.23.4

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.15
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.23.3 this release adds:

  • Go version upgrade to 1.17.9

Same as 2.23.2, this release includes the following fix for AWS customers that we are working on getting accepted upstream:

Important Note:

  • A security vulnerability was found in amazonlinux which we use as our base image. This new image will be based on an updated version of amazonlinux that resolves this CVE.

2.23.3

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.15
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Same as 2.23.2, this release includes the following fix for AWS customers that we are working on getting accepted upstream:

New Tool:

  • firelens-datajet is a holistic log/metric routing software test tool made to flexibly send test data to Fluent Bit in a repeatable, reliable, and portable manner. Create test configuration JSONs that modularly connect test data generators to data senders, customize data generation rate, send data in parallel over various ingestion routes, and mock log router destinations.

2.23.2

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.14
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.23.1 this release adds:

  • Enhancement - Mitigate throttling issue on log group in cloudwatch_logs plugin fluentbit:4826

Same as 2.23.1, this release includes the following fix for AWS customers that we are working on getting accepted upstream:

2.23.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.13
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Same as 2.23.0, this release includes the following fix for AWS customers that we are working on getting accepted upstream:

Important Note:

  • Two security vulnerability were found in amazonlinux which we use as base image to our aws-for-fluent-bit image- ALAS-2022-1764 and ALAS-2022-1766. This new image will be based on an updated version of amazonlinux that resolves these CVEs.

2.23.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.13
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.9.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.22.0 this release adds:

  • Feature - Add timeout config for AWS SDK Go HTTP calls kinesis:178
  • Enhancement - Migrate AWS plugins to performant 2.25.0-mbedtls base64 implementation fluentbit:4422
  • Bug - Fix message loss issue using concurrency feature with 0 retries kinesis:179

Compared to 2.22.0 this release deletes the following fix which has been covered in new enhancement:

  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110

Same as 2.22.0, this release includes the following fix for AWS customers that we are working on getting accepted upstream:

2.22.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.12
  • Amazon CloudWatch Logs for Fluent Bit 1.7.0
  • Amazon Kinesis Streams for Fluent Bit 1.8.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.21.6 this release adds:

Same as 2.21.6, this release includes the following fix for AWS customers that has been accepted by upstream:

Same as 2.21.6, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110
  • Bug - Resolve IMDSv1 fallback error introduced in 2.21.0 aws-for-fluent-bit:259

2.21.6

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.11
  • Amazon CloudWatch Logs for Fluent Bit 1.6.4
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.21.5 this release adds:

  • Go version upgrade to 1.17.6

Same as 2.21.5, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

2.21.5

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.11
  • Amazon CloudWatch Logs for Fluent Bit 1.6.4
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Same as 2.21.4, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

2.21.4

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.10
  • Amazon CloudWatch Logs for Fluent Bit 1.6.4
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.21.3 this release adds:

  • Bug - Fix handling of TCP connections on SIGTERM fluentbit:2610
  • Bug - Auto retry invalid cloudwatch requests to resolve sequence token errors fluentbit:4189

Same as 2.21.3, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

2.21.3

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.9
  • Amazon CloudWatch Logs for Fluent Bit 1.6.4
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Same as 2.21.2, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

Important Note:

  • A security vulnerability was found in amazonlinux which we use as base image to our aws-for-fluent-bit image. This new image will be based on an updated version of amazonlinux that resolves this CVE.

2.21.2

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.9
  • Amazon CloudWatch Logs for Fluent Bit 1.6.4
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.21.1 this release adds:

Compared to 2.21.1 this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

Same as 2.21.1, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

  • Bug - Fix return value from tls_net_read fluentbit:4098
  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110

2.21.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.9
  • Amazon CloudWatch Logs for Fluent Bit 1.6.3
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.21.0 this release adds:

  • Bug - Avoid double free for multiline msgpack buffer fluentbit:4243
  • Bug - On Multiline handling, use file inode as stream_id fluentbit:3886

Same as 2.21.0, this release includes the following fixes for AWS customers that we are working on getting accepted upstream:

  • Bug - Fix return value from tls_net_read fluentbit:4098
  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110

2.21.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.8
  • Amazon CloudWatch Logs for Fluent Bit 1.6.3
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.20.0 this release adds:

  • Feature/Warning - This release introduces IMDSv2 support. Instances that rely on IMDS for security credentials must set EC2's instance-metadata-option http-put-response-hop-limit to 2 otherwise Fluent Bit will hang aws-for-fluent-bit:259
  • Bug - Fix memory leak in S3 output fluentbit:4038
  • Bug - Fix return value from tls_net_read fluentbit:4098
  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110

2.20.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.7
  • Amazon CloudWatch Logs for Fluent Bit 1.6.3
  • Amazon Kinesis Streams for Fluent Bit 1.8.0
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.19.2 this release adds:

  • Feature - Add support for gzip compression of records kinesis:162
  • Enhancement - Build aws-for-fluent-bit image with release mode rather than debug mode aws-for-fluent-bit:249
  • Bug - Fix return value from tls_net_read fluentbit:4098
  • Bug - Downgrade mbedtls to 2.24.0 to fix the performance regression issue in mbedtls 2.26.0 fluentbit:4110

Important Note:

  • Besides upgrading Fluent Bit version to 1.8.7, we also include some customized changes with this latest version (2.20.0) of aws-for-fluent-bit image. This aims to fix performance and stability issues in Fluent Bit.

2.19.2

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.6
  • Amazon CloudWatch Logs for Fluent Bit 1.6.3
  • Amazon Kinesis Streams for Fluent Bit 1.7.3
  • Amazon Kinesis Firehose for Fluent Bit 1.6.1

Compared to 2.19.1 this release adds:

  • Enhancement - Upgrade Go version to 1.17

2.19.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.6
  • Amazon CloudWatch Logs for Fluent Bit 1.6.2
  • Amazon Kinesis Streams for Fluent Bit 1.7.2
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Compared to 2.19.0 this release adds:

  • Enhancement - Add validation to stop accepting both of log_stream_name and log_stream_prefix together cloudwatch:190
  • Bug - Fix aggregator size estimation kinesis:155
  • Bug - Fix partition key computation for aggregation kinesis:158

2.19.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.3
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

2.18.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.2
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Compared to 2.17.0 this release adds:

  • Feature - Multiline Filter which helps to concatenate messages that originally belong to one context but were split across multiple records or log lines.

2.17.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.8.1
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

2.16.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.9
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Important Note:

  • We fixed known issues which were found in our previous version v2.16.0. This new image will use the updated version of our dependencies. It is highly recommended to upgrade your existing workload or run new workload with this latest version (2.16.1) of aws-for-fluent-bit image.

2.16.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.9
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

2.15.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.8
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

2.15.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.6
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Important Note:

  • Two different security vulnerabilities were found in openssl and glibc which we use to build our aws-for-fluent-bit image. This new image will use the updated version of these dependencies. It is highly recommended to upgrade your existing workload or run new workload with this latest version (2.15.0) of aws-for-fluent-bit image.

2.14.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.4
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

2.13.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.3
  • Amazon CloudWatch Logs for Fluent Bit 1.6.1
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Compared to 2.12.0 this release adds:

  • Enhancement - Delete debug messages which make log info useless cloudwatch:141

2.12.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.7.2
  • Amazon CloudWatch Logs for Fluent Bit 1.6.0
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.6.0

Compared to 2.11.0 this release adds:

  • Enhancement - Add an option to send multiple log events as a record firehose:12

2.11.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.6.10
  • Amazon CloudWatch Logs for Fluent Bit 1.6.0
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.5.1

This release removes /var/cache/yum to reduce the size of the container image; you can no longer yum install packages in this image.

2.10.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.6.10
  • Amazon CloudWatch Logs for Fluent Bit 1.6.0
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.5.1

This is the first release with images in Amazon ECR Public Gallery.

2.10.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.6.8
  • Amazon CloudWatch Logs for Fluent Bit 1.6.0
  • Amazon Kinesis Streams for Fluent Bit 1.7.1
  • Amazon Kinesis Firehose for Fluent Bit 1.5.1

Compared to 2.9.0 this release adds:

  • Enhancement - Add support for updating the retention policy of existing log groups cloudwatch:121

2.9.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.6.3
  • Amazon CloudWatch Logs for Fluent Bit 1.5.0
  • Amazon Kinesis Streams for Fluent Bit 1.7.0
  • Amazon Kinesis Firehose for Fluent Bit 1.5.0

This is the first release with images for both x86 and arm64.

Compared to 2.8.0 this release adds:

  • Feature - Automatically re-create CloudWatch log groups and log streams if they are deleted cloudwatch:95
  • Feature - Add default fallback log group and stream names cloudwatch:99
  • Feature - Add support for ECS Metadata and UUID via special variables in log stream and group names cloudwatch:108
  • Feature - Add new option replace_dots to replace dots in key names in firehose and kinesis plugins firehose:46
  • Enhancement - Add support for nested partition_key in log record kinesis:30

2.8.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.6.0
  • Amazon CloudWatch Logs for Fluent Bit 1.4.1
  • Amazon Kinesis Streams for Fluent Bit 1.6.1
  • Amazon Kinesis Firehose for Fluent Bit 1.4.2

Compared to 2.7.0 this release adds:

2.7.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.5.6
  • Amazon CloudWatch Logs for Fluent Bit 1.4.0
  • Amazon Kinesis Streams for Fluent Bit 1.6.0
  • Amazon Kinesis Firehose for Fluent Bit 1.4.1

Compared to 2.6.1 this release adds:

  • Feature - Add support for zlib compression of records kinesis:26
  • Feature - Add KPL aggregation support kinesis:16
  • Feature - Add support for dynamic log group names cloudwatch:46
  • Feature - Add support for dynamic log stream names cloudwatch:16
  • Feature - Support tagging of newly created log groups cloudwatch:51
  • Feature - Support setting log group retention policies cloudwatch:50

2.6.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.5.2
  • Amazon CloudWatch Logs for Fluent Bit 1.3.2
  • Amazon Kinesis Streams for Fluent Bit 1.5.1
  • Amazon Kinesis Firehose for Fluent Bit 1.4.1

2.6.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.5.1
  • Amazon CloudWatch Logs for Fluent Bit 1.3.1
  • Amazon Kinesis Streams for Fluent Bit 1.5.0
  • Amazon Kinesis Firehose for Fluent Bit 1.4.0

Compared to 2.5.0 this release adds:

  • Feature - Add log_key option support to firehose, and kinesis plugins.
  • Bug - Add an empty check before sending log events to destinations for firehose and cloudwatch plugins.

2.5.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.5.0
  • Amazon CloudWatch Logs for Fluent Bit 1.3.0
  • Amazon Kinesis Streams for Fluent Bit 1.4.0
  • Amazon Kinesis Firehose for Fluent Bit 1.3.0

Compared to 2.4.0 this release adds:

  • Feature - Add sts_endpoint parameter to cloudwatch, firehose, and kinesis plugins to support specifying a custom STS API endpoint.

2.4.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.5.0
  • Amazon CloudWatch Logs for Fluent Bit 1.2.0
  • Amazon Kinesis Streams for Fluent Bit 1.3.0
  • Amazon Kinesis Firehose for Fluent Bit 1.2.1

Compared to 2.3.1 this release adds:

2.3.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.4.5
  • Amazon CloudWatch Logs for Fluent Bit 1.2.0
  • Amazon Kinesis Streams for Fluent Bit 1.2.2
  • Amazon Kinesis Firehose for Fluent Bit 1.2.1

Compared to 2.3.0 this release adds:

  • Bug Fix - Remove redundant exponential backoff code from Firehose and Kinesis plugins firehose:23

2.3.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.4.2
  • Amazon CloudWatch Logs for Fluent Bit 1.2.0
  • Amazon Kinesis Streams for Fluent Bit 1.2.1
  • Amazon Kinesis Firehose for Fluent Bit 1.2.0

Compared to 2.2.0 this release adds:

  • Bug Fix - Updated logic to calculate individual and maximum record size kinesis:22

2.2.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.3.9
  • Amazon CloudWatch Logs for Fluent Bit 1.2.0
  • Amazon Kinesis Streams for Fluent Bit 1.2.0
  • Amazon Kinesis Firehose for Fluent Bit 1.2.0

Compared to 2.1.1 this release adds:

  • Feature - Add time_key and time_key_format config options to add timestamp to records firehose:9
  • Feature - Add time_key and time_key_format config options to add timestamp to records kinesis:17
  • Feature - Add support for Embedded Metric Format cloudwatch:27

2.1.1

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.3.4
  • Amazon CloudWatch Logs for Fluent Bit 1.1.1
  • Amazon Kinesis Streams for Fluent Bit 1.1.0
  • Amazon Kinesis Firehose for Fluent Bit 1.1.0

Compared to 2.1.0 this release adds:

2.1.0

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.3.4
  • Amazon CloudWatch Logs for Fluent Bit 1.1.0
  • Amazon Kinesis Streams for Fluent Bit 1.1.0
  • Amazon Kinesis Firehose for Fluent Bit 1.1.0

Compared to 2.0.0 this release adds:

  • Bug - Container exits with code 0 when it gracefully shuts down - #11
  • Feature - Support IAM Roles for Service Accounts in Amazon EKS in all plugins
  • Feature - Add credentials_endpoint to CloudWatch plugin - cloudwatch:36
  • Bug - A single CloudWatch Logs PutLogEvents request can not contain logs that span more than 24 hours - cloudwatch:29

2.0.0

Note: This is the first AWS for Fluent Bit release under our new versioning scheme; previously the image was versioned by the Fluent Bit version it contained. Please see the project README for an explanation of how we version this project.

This release includes:

  • An Amazon Linux 2 Base
  • Fluent Bit 1.3.3
  • Amazon CloudWatch Logs for Fluent Bit 1.0.0
  • Amazon Kinesis Streams for Fluent Bit 1.0.0
  • Amazon Kinesis Firehose for Fluent Bit 1.0.0

Compared to aws-for-fluent-bit:1.3.2 this release adds:

  • Bug - Allow retries for creating log group - cloudwatch:18
  • Feature - Add Fluent Bit plugin for Amazon Kinesis Data Streams - kinesis:1