ActiveData icon indicating copy to clipboard operation
ActiveData copied to clipboard

Scanning the coverage column is a problem

Open klahnakoski opened this issue 5 years ago • 0 comments

Probably just too slow.. This columns has been a problem due to the number of values in it.

WARNING: Could not get coverage.source.file.covered.~n~ info
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 777, in _update_cardinality
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
	File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
	ERROR: Problem with call to http://localhost:9201/coverage/_search
{"aggs":{"_filter":{"aggs":{"multi":{"max":{"script":"doc[\"source.file.covered.~n~\"].values.size()"}}},"filter":{"bool":{"should":[{"range":{"etl.timestamp.~n~":{"gte":1581897600}}},{"bool":{"must_not":{"exists":{"field":"etl.timestamp.~n~"}}}}]}}},"count":{"cardinality":{"field":"source.file.covered.~n~"}}},"size":0}
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 919, in post
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
	File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
	ERROR: Tried 1 times: Timeout failure (timeout was 
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 181, in request
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 125, in w_kwargs
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 242, in post
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 892, in post
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
	File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__
caused by
	ERROR: HTTPConnectionPool(host='localhost', port=9201): Read timed out. (read timeout=600)
	File "C:\Python37\lib\site-packages\requests\adapters.py", line 529, in send
	File "C:\Python37\lib\site-packages\requests\sessions.py", line 646, in send
	File "C:\Python37\lib\site-packages\requests\sessions.py", line 533, in request
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 82, in wo_kwargs
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 172, in request
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_kwargs\__init__.py", line 125, in w_kwargs
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_http\http.py", line 242, in post
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\elasticsearch.py", line 892, in post
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 594, in _update_cardinality
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\jx_elasticsearch\meta.py", line 881, in monitor
	File "C:\Users\kyle\code\ActiveData-ETL\vendor\mo_threads\threads.py", line 311, in _run
	File "C:\Users\kyle\.IntelliJIdea2019.2\config\plugins\python\helpers\pydev\_pydev_bundle\pydev_monkey.py", line 729, in __call__

klahnakoski avatar Feb 24 '20 21:02 klahnakoski