file input plugin: many include patterns and patterns for exclude

[DmitryRomanov]

sample config

new format:

pipelines:
  welcome:
    input:
      type: file
      persistence_mode: async
      watching_dir: /var/lib/docker/containers
      # filename_pattern: "*-json.log" # old format
      paths:
        include:
          - 'containers/30b28763e40a7649ef73c8afce0b0f4e62546f2a07a174d97e56bd02854facbd/*-json.log'
          - 'containers/65d343a9cc0a9fe6e466a370fcaf8ad6458eb912d19f8e8832e941e2ab7cafa0/*-json.log'
          - 'containers/**/*-json.log'
        exclude:
          - '19aa5027343f4*/*-json.log'
      offsets_file: ./offsets.yaml
      offsets_op: reset
    output:
      type: stdout

see also #567

[codecov[bot]]

Codecov Report

Attention: 31 lines in your changes are missing coverage. Please review.

Comparison is base (7d1a963) 69.67% compared to head (48c0a6e) 69.97%. Report is 3 commits behind head on master.

:exclamation: Current head 48c0a6e differs from pull request most recent head 5a6b58d. Consider uploading reports for the commit 5a6b58d to get more accurate results

Files	Patch %	Lines
cfg/config.go	82.85%	8 Missing and 4 partials :warning:
plugin/input/file/watcher.go	76.47%	6 Missing and 2 partials :warning:
pipeline/config.go	40.00%	4 Missing and 2 partials :warning:
test/test.go	40.00%	2 Missing and 1 partial :warning:
fd/file.d.go	50.00%	2 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #566      +/-   ##
==========================================
+ Coverage   69.67%   69.97%   +0.29%     
==========================================
  Files         109      111       +2     
  Lines       11414    11723     +309     
==========================================
+ Hits         7953     8203     +250     
- Misses       2976     3025      +49     
- Partials      485      495      +10     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[DmitryRomanov]

i have decided remove watching_dir https://github.com/ozontech/file.d/pull/567