dbatools icon indicating copy to clipboard operation
dbatools copied to clipboard

Export Xel to JSON for the purpose of ingesting to Elasticsearch easily

Open Angrboda2 opened this issue 5 years ago • 3 comments

Summary of new feature

There is an existing function to export XelToCsv. I would like to ingest XE data into an ElasticSearch index, which is very simply to do from a JSON format. If dbatools could export from a .Xel to a .JSON that would be awesome. (Maybe there is an even better approach of directly sending from a .XEL into logstash or ElasticSearch directly)

Proposed technical details (if applicable)

Latest version of dbatools as of writing

1.0

Angrboda2 avatar Jun 04 '19 18:06 Angrboda2

@Angrboda2 Can you provide a litte more technical detail? Maybe some code that shows the needed transformation? Then we can try to build a command around it.

andreasjordan avatar May 22 '21 11:05 andreasjordan

This is a fun idea! We wrap our commands our @spaghettidba's XESmartTarget, so this would first have to be a request on his repo at https://github.com/spaghettidba/XESmartTarget, then we could add support once he adds support

potatoqualitee avatar Jul 20 '21 06:07 potatoqualitee

Hi! XESmartTarget can write to Graylog using a response type like GelfTcpResponse, which writes directly to the graylog server. We also have a TelegrafAppenderResponse to write to InfluxDb, which is very similar to ElasticSearch on that regard. If you describe the way you would like the data, I can implement it in XESmartTarget

spaghettidba avatar Jul 20 '21 10:07 spaghettidba

So this would be best solved with XESmartTarget and is not in scope for dbatools? Can we close this?

andreasjordan avatar Jun 11 '23 11:06 andreasjordan

Yep, can't incorporate anything until upstream has support.

wsmelton avatar Jun 11 '23 14:06 wsmelton