spark-dependencies Speed up ci tests

Some thoughts:

run elastic and cassandra tests in parallel
do not shut down containers between tests but rather wipe all data (e.g. in C* via CQL and for elastic via REST API)

Sep 25 '17 07:09 pavolloffay

do not shut down containers between tests but rather wipe all data (e.g. in C* via CQL and for elastic via REST API)

works well for C*, however, when I delete ES index by HTTP request jaeger query responds with 500.

Sep 26 '17 14:09 pavolloffay

@pavolloffay if index name is configurable then I recommend the same approach we use for our ElasticSearch testing - just use different index names for different tests and a single, shared ES container :)

Oct 02 '17 08:10 bsideup

+1, At the moment Jaeger does not support it. I have tried to remove the index completely but it caused some errors on the Jaeger side.

Oct 02 '17 08:10 pavolloffay

@pavolloffay then maybe https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-delete-by-query.html + ?refresh=true will help. It doesn't delete the index, but the data in it

Oct 02 '17 08:10 bsideup

@bsideup thanks. Done in #10

Now we do not restart containers between tests. The next improvement could use travis stages to run C* and elastic in parallel.

Oct 03 '17 08:10 pavolloffay

👍

Oct 03 '17 08:10 bsideup