collector icon indicating copy to clipboard operation
collector copied to clipboard

Support client-side parsing of certain log files

Open henrikjohansen opened this issue 9 years ago • 3 comments

Many logfiles are written in CSV format - given the header of such a file the collector should stuff the correct values into fields and append those to the GELF message.

Perhaps you should even support GROK patterns for arbitrary logs ...

henrikjohansen avatar Jun 06 '15 17:06 henrikjohansen

I was looking at this myself. I have a lot of NX log parsing for logs like IIS (space separated). I'm working on rewriting these rules as server side extractors i'm noticing that if the log format fields are changed on the IIS server (adding or removing logged fields) it will break the regexes.

drewmmiranda avatar Jun 06 '15 22:06 drewmmiranda

This is definitely a killer feature. Falling over the input extractors/groks parts from graylog-server to collector and let the client to structure its own logs.

pdepaepe avatar Jun 10 '15 16:06 pdepaepe

+1

I would gladly change my td-agents for collector but without parsing feature it is useless to me

zolech avatar Jun 12 '15 12:06 zolech