elasticsearch-dataformat icon indicating copy to clipboard operation
elasticsearch-dataformat copied to clipboard

How do you export a large result set?

Open xermus opened this issue 8 years ago • 2 comments

The dataformat is perfectly running fine for me.

The problem is only that I need to export the whole index (which contains hundreds of thousands of documents). I then get:

Result window is too large, from + size must be less than or equal to: [10000] but was [1000000]

Can you provide me a specific example on how I can export all documents of an index to a given file (json or csv) on the Linux command line. Thank you.

xermus avatar Nov 07 '17 16:11 xermus

"file" request parameter stores an exported file in elasticsearch server without storing data into a response. ex. localhost:9200/{index}/_data?format=csv&file=/tmp/test.csv...

marevol avatar Nov 12 '17 21:11 marevol

I am looking to export all documents from the index. Using plugin v5.6.2 with ES 5.6.4, I get the following error when using the "file" parameter

"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"request [/{index}/{type}/_data] contains unrecognized parameter: [file]"}]

sewalita avatar Feb 20 '18 16:02 sewalita