Megastef

I did not know containerpilot. +1 To create some input filter for container pilot. The input filter could set a log context object, and an output filter could add the...

@bkcsfi We did recently something similar, parsing containerd log headers. See the plugin code: https://github.com/sematext/logagent-js/blob/master/lib/plugins/input-filter/kubernetesContainerd.js

To limit the rate from files via tail-forever we would need to get this issue solved: https://github.com/mingqi/tailF/issues/8 --maxInputRate 10mb can be used by any logagent "plugin", currently only implemented for...

This module seems to be interesting, as it exposes streams for tailed files: https://www.npmjs.com/package/safe-log-reader - to be tested ...

https://github.com/Juul/tail-stream

Hey @frytyler - let me try to get you started: This is the result of running Logagent today: ``` echo "some message and some metrics memory=14MB cpu=2" | bin/logagent.js 2>/dev/null...

Yes. Once you have test data it would be nice to share (e.g. as JSON file to simulate tests). You can find input plugins examples here: https://github.com/sematext/logagent-js/tree/master/lib/plugins/input See e.g TCP...

I think what you need to do is removing the ANSI escape sequences for terminal colour codes. The docker plugin has this functionality too. See: https://github.com/sematext/logagent-js/blob/master/lib/plugins/input/docker/docker.js#L7 https://github.com/sematext/logagent-js/blob/master/lib/plugins/input/docker/docker.js#L110 We could first...

I think the problem is that the sha1 checksum needs to be calculated in advance. See: https://crate.io/docs/stable/blob.html "To upload a blob the sha1 hash of the blob has to be...

+0.5 it solves the problem to upload files larger than heap limit and it could reduce memory ussage. Your example looks easy, but does not deal with with problems raised...