You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Microsoft SQL Server instance logs errors and information to ERRORLOG files which is stored on a drive. That files are encoded in 'UTF-16 LE BOM'. Fluent-bit is able to read and parse that file and finally to send it to output (e.g. OpenTelemetry) however it does not track offsets. Every time when file is modified, fluent-bit reads whole content of the file instead of only tail which was changed which results with hundreds or thousands of duplicated entries in output.
Describe the solution you'd like
Introduce support for UTF-16 LE BOM for tail input.
Describe alternatives you've considered
There is no way to force SQL Server instance to change encoding, one of the alternative ways is to convert SQL Server error logs from unsupported format to UTF-8 on the fly using external script and configure fluent-bit to read converted file.
Additional context
In environment with thousands of SQL Server instances it requires to introduce script which will convert the log files frequently to export up-to-date logs to OpenTelemetry
Is your feature request related to a problem? Please describe.
Microsoft SQL Server instance logs errors and information to ERRORLOG files which is stored on a drive. That files are encoded in 'UTF-16 LE BOM'. Fluent-bit is able to read and parse that file and finally to send it to output (e.g. OpenTelemetry) however it does not track offsets. Every time when file is modified, fluent-bit reads whole content of the file instead of only tail which was changed which results with hundreds or thousands of duplicated entries in output.
Describe the solution you'd like
Introduce support for UTF-16 LE BOM for tail input.
Describe alternatives you've considered
There is no way to force SQL Server instance to change encoding, one of the alternative ways is to convert SQL Server error logs from unsupported format to UTF-8 on the fly using external script and configure fluent-bit to read converted file.
Additional context
In environment with thousands of SQL Server instances it requires to introduce script which will convert the log files frequently to export up-to-date logs to OpenTelemetry
ERRORLOG.zip
The text was updated successfully, but these errors were encountered: