ActiveData
ActiveData copied to clipboard
Scanning the coverage column is a problem
Probably just too slow.. This columns has been a problem due to the number of values in it.
WARNING: Could not get coverage.source.file.covered.~n~ info
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 777, in _update_cardinality
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
ERROR: Problem with call to http://localhost:9201/coverage/_search
{"aggs":{"_filter":{"aggs":{"multi":{"max":{"script":"doc[\"source.file.covered.~n~\"].values.size()"}}},"filter":{"bool":{"should":[{"range":{"etl.timestamp.~n~":{"gte":1581897600}}},{"bool":{"must_not":{"exists":{"field":"etl.timestamp.~n~"}}}}]}}},"count":{"cardinality":{"field":"source.file.covered.~n~"}}},"size":0}
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 919, in post
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
ERROR: Tried 1 times: Timeout failure (timeout was
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 181, in request
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 125, in w_kwargs
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 242, in post
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 892, in post
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
ERROR: HTTPConnectionPool(host='localhost', port=9201): Read timed out. (read timeout=600)
File "C:\Python37\lib\site-packages\requests\adapters.py", line 529, in send
File "C:\Python37\lib\site-packages\requests\sessions.py", line 646, in send
File "C:\Python37\lib\site-packages\requests\sessions.py", line 533, in request
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 82, in wo_kwargs
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 172, in request
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 125, in w_kwargs
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 242, in post
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 892, in post
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__