fluent
Repeated inclusion of a file in the in_blob database.
Bug Report
Describe the bug After successfully uploading a file using the out_azure_blob plugin. The in_blob plugin repeatedly finds and adds the uploaded file.
To Reproduce
- Steps to reproduce the problem:
Upload a file using the in_blob and out_azure_blob plugins. Stop fluent bit. Restart FluentBit.
Expected behavior If a file has already been scanned and added, the file should not be added to the data base.
Screenshots
Your Environment
- Version used: 3.2.0
- Configuration:
[SERVICE] version 1.2.2 log_level debug flush 3
[INPUT] name blob path /home/user/Desktop/ddc-fluentbit/bin/files/* database_file input_files.db upload_success_action suffix upload_success_suffix .done
[OUTPUT] name azure_blob match * endpoint http://127.0.0.1:10000 path output container_name test shared_key account_name devstoreaccount1 emulator_mode true database_file output_files.db upload_parts_timeout 20s
- Environment name and version (e.g. Kubernetes? What version?): N/A
- Server type and version: N/A
- Operating System and version: Ubuntu 22
- Filters and plugins: blob, azure_blob
Additional context
Binary file transfer