sof-elk icon indicating copy to clipboard operation
sof-elk copied to clipboard

Published 20 hours ago • verified publisher icon philhagen

use input scrubber?

Open philhagen opened this issue 3 years ago • 1 comments

clear files that have been loaded and not modded in some time:

https://pypi.org/project/filebeat-scrubber/

philhagen avatar Apr 17 '21 21:04 philhagen

maybe use this method to auto-kick the AWS logs that don't have a newline?

philhagen avatar Apr 17 '21 22:04 philhagen

that tool is not being updated and works with an older version of filebeat. upon further consideration, I don't think automatically removing input files is a good idea.

the filebeat registry may provide a means of a "status bar" of sorts in the future. filebeat also has an optional API that may provide the same functionality, possibly via the undocumented /dataset api route.

philhagen avatar Nov 17 '23 17:11 philhagen