ruby-spark icon indicating copy to clipboard operation
ruby-spark copied to clipboard

What's the future of this project?

Open tejasmanohar opened this issue 8 years ago • 6 comments

Just wondering if this project is still being maintained, and if things like Spark 2 are on the roadmap.

tejasmanohar avatar Feb 14 '17 07:02 tejasmanohar

That's a very important issue. We definitely need this project alive!

arbox avatar Feb 14 '17 09:02 arbox

If more people will want compatibility with version 2, I'll look at it.

ondra-m avatar Feb 26 '17 17:02 ondra-m

Yes please!

alexmc6 avatar Feb 26 '17 22:02 alexmc6

12 months later .. any activity here? I am sick of python , could really get a breath of fresh air from Ruby

javadba avatar Feb 21 '18 09:02 javadba

So why didn't this project move forward? I just did a Scala POC and writing platform-agnostic code is impossible due to it's static nature. Are there technical reasons why Python can support Spark but not Ruby? I find my Ruby code is way more maintainable and fun to write than my Python code.

IRobL avatar Oct 31 '19 15:10 IRobL

  1. Well, its very hard to use dynamic language in a distributed environment. Specially ruby cannot serialize an anonymous function (its easier in python).
  2. Ruby is not very common language for computation problem.

ondra-m avatar Nov 06 '19 18:11 ondra-m