elasticsearch-py

elasticsearch-py copied to clipboard

**Elasticsearch version** (`bin/elasticsearch --version`): 7.9 **`elasticsearch-py` version (`elasticsearch.__versionstr__`)**: 7.9.1 **Description of the problem including expected versus actual behavior**: We use this library with Google dataflow (apache beam). When we run...

daisy1754

parallel_bulk does not seem to respect chunk_size + parallel_bulk memory leak?

7

- Elasticsearch server version: 7.5.2 - Elasticsearch python version: 7.5.1 I am trying to parse files containing millions of lines, and I am using the helpers.parallel_bulk function for indexing data....

nicolaipre

**Elasticsearch version** (`bin/elasticsearch --version`): 7 **`elasticsearch-py` version (`elasticsearch.__versionstr__`)**: 7.9 / 7.8 / 7.7 **Description of the problem including expected versus actual behavior**: When trying to send a request containing an...

udi-forter

SQL scan helper

2

**Describe the feature**: SQL support in `elasticsearch.helpers.scan` or a separate helper for scanning SQL queries. I couldn't find a way to submit SQL through the standard `search` API, so I...

jamesharr

Passwords in basic auth can't be non latin-1

3

When passing basic auth headers the client calls: `b64encode(b(basic_auth)).decode('utf-8')` via the urllib3 request package. Here `b` is defined as ``` def b(s): return s.encode("latin-1") ``` This causes any non latin-1...

gingerwizard

parallel_bulk leaks memory and retries forever while still consuming the input iterator

4

**Description** Since there is no `max_retry` configuration on helpers.parallel_bulk (#645) the default case seems to retry forever and never stop. This is a very strange default behavior and caused my...

AntonFriberg

Misleading helpers.scan preserve_order documentation.

1

I need to 'scan' with 'preserve_order' and it works well. However, documentation warns that setting it to true makes > don’t set the search_type to scan - this will cause...

kramarz

tests for parallel bulk rely on Mock.call_count which is not thread safe

2

We need to change the logic used to checking the calls made to something that can be incremented atomically like appending to a list or something.

honzakral

Original document is not always returned when doing bulk operation

1

take a look at _process_bulk_chunk in actions.py

cyberintUser1

Add option to `bulk` indexer to automatically add nested mapping where appropriate

1

I am using `bulk` to index this JSON dict: ``` { "project.nested.repeated.addresses":[ { "status":"current", "city":"New York", "zip":33333, "state":"NY", "address":"789 Any Avenue", "numberOfYears":2 }, { "status":"previous", "city":"Hoboken", "zip":44444, "state":"NJ", "address":"321 Main...

melissachang