elasticsearch-dataformat icon indicating copy to clipboard operation
elasticsearch-dataformat copied to clipboard

Heap Allocation Problem

Open anujtmr9 opened this issue 8 years ago • 8 comments

I have installed the plugin but whenever i m trying to retrieve data size more than 20mb i m facing memory exception. How can i handle default allocation and customize it

anujtmr9 avatar Jun 26 '17 13:06 anujtmr9

limit request parameter is available(ex. limit=50%).

marevol avatar Jun 26 '17 13:06 marevol

Sorry i need to retrieve more amount of data nearly 1gb some time so how i can increase memory allocation. This is my question

anujtmr9 avatar Jun 26 '17 19:06 anujtmr9

It depends on a heap size of elasticsearch. limit=50% means 50% of the heap size.

marevol avatar Jun 26 '17 21:06 marevol

Thanks you. How to set limit will u please help. Any specific command like so ?

anujtmr9 avatar Jun 27 '17 04:06 anujtmr9

limit is a request parameter.

marevol avatar Jun 27 '17 13:06 marevol

Thanks. So in http request only like http://myurl/..../limit=50% it will work ?

anujtmr9 avatar Jun 27 '17 13:06 anujtmr9

?limit=50%25

marevol avatar Jun 27 '17 14:06 marevol

bgl-mongo-rs1:9200/data1/logs/_data?format=json&source={"query":{"bool":{"must":[{"match_all":{}}]}},"from":0,"size":100000}

Error is "Result window is too large, from + size must be less than or equal to: [10000] but was [100000]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting." Please update the url how i can set limit here

anujtmr9 avatar Jun 27 '17 14:06 anujtmr9