Repeated inclusion of a file in the in_blob database.

[LACrea]

Bug Report

Describe the bug
After successfully uploading a file using the out_azure_blob plugin. The in_blob plugin repeatedly finds and adds the uploaded file.

To Reproduce

• Steps to reproduce the problem:

Upload a file using the in_blob and out_azure_blob plugins.
Stop fluent bit.
Restart FluentBit.

Expected behavior
If a file has already been scanned and added, the file should not be added to the data base.

Screenshots

Your Environment

• Version used: 3.2.0
• Configuration:

[SERVICE]
version 1.2.2
log_level debug
flush 3

[INPUT]
name blob
path /home/user/Desktop/ddc-fluentbit/bin/files/*
database_file input_files.db
upload_success_action suffix
upload_success_suffix .done

[OUTPUT]
name azure_blob
match *
endpoint http://127.0.0.1:10000
path output
container_name test
shared_key
account_name devstoreaccount1
emulator_mode true
database_file output_files.db
upload_parts_timeout 20s

• Environment name and version (e.g. Kubernetes? What version?): N/A
• Server type and version: N/A
• Operating System and version: Ubuntu 22
• Filters and plugins: blob, azure_blob

Additional context

Binary file transfer