Support for Apache Spark 2.X

Open thesuperzapper opened this issue 8 years ago • 1 comments

Hey guys, I see that the current version of seldon-server uses Spark 1.5.2 by default, given the dramatic performance and feature improvements in Spark 2.X, are there any plans to support it?

Jan 19 '17 08:01 thesuperzapper

Yes. We would like to. Adding it instead of 1.5.2 in the kubernetes setup should be trivial change to the Pod JSONs to newer packages. We welcome your tests if you try this. Apart from that we would need to test the existing code/algos we have built into Seldon.

Jan 19 '17 09:01 ukclivecox