spark-dependencies icon indicating copy to clipboard operation
spark-dependencies copied to clipboard

Bump Elasticsearch spark version to 8.2.3

Open sylvainOL opened this issue 2 years ago • 8 comments

Current version of elasticsearch-spark-20 jar is using a 7.x version and doesn't want to work with Elasticsearch 8.x.

Which problem is this PR solving?

  • Resolves #125

Short description of the changes

  • Bumping version of jar to make it also work with 8.x versions.

sylvainOL avatar Jun 28 '22 13:06 sylvainOL

and doesn't want to work with Elasticsearch 8.x.

If this issue is resolving ES8 compatibility then there should be e2e test for ES 8 e.g. https://github.com/jaegertracing/spark-dependencies/blob/main/.github/workflows/ci.yaml#L25

pavolloffay avatar Jul 04 '22 06:07 pavolloffay

I've added a test for es8.

But I'm not sure at all it'll work with es 5.6.9 which is the default version...

sylvainOL avatar Jul 04 '22 13:07 sylvainOL

But I'm not sure at all it'll work with es 5.6.9 which is the default version...

We should find out. Are you using Jaeger with ES8 https://github.com/jaegertracing/jaeger/issues/3571?

pavolloffay avatar Jul 05 '22 06:07 pavolloffay

@sylvainOL, what is the state of this change, can we say prod backend ES 8 is ok after this if you run it?

s7an-it avatar Aug 24 '22 15:08 s7an-it

Any update on this?

sergiomcalzada avatar Oct 25 '22 10:10 sergiomcalzada

Hello, it doesn't seems to work sorry :(

sylvainOL avatar Nov 17 '22 12:11 sylvainOL

does spark jobs work with opensearch?

desert3agle avatar Mar 29 '23 10:03 desert3agle

up

piratetm avatar Dec 18 '23 07:12 piratetm