spark-redshift icon indicating copy to clipboard operation
spark-redshift copied to clipboard

Published 20 hours ago • verified publisher icon databricks

Alternatives or Active Forks?

Open markdessain opened this issue 6 years ago • 3 comments

Are there any suggestions for alternatives to using spark-redshift?

Having seen that this project is no longer maintained our team does not feel comfortable continuing to use this to connect Spark with Redshift. We're not seeing any issues right now with our current usage but are looking for advice on what we should do next?

Would anyone recommend writing our own UNLOAD and COPY commands to move data in and out of S3 and then just connecting Spark to S3 as usual?

I couldn't spot any active forks, or other libraries that don't require doing a complete move over to Databricks?

markdessain avatar Mar 13 '18 14:03 markdessain

Same here. Any news about this?

sylvinho81 avatar Apr 20 '18 07:04 sylvinho81

Same here. As a side project I would love to dig in and see if the community could maintain this project. I mean we have access to all the source.

Nestor10 avatar May 25 '18 21:05 Nestor10

I just commented on another issue suggesting the same thing, am open to any discussion/thoughts on moving forward with support from the open-source community https://github.com/databricks/spark-redshift/issues/315#issuecomment-435252389

schwartzmx avatar Nov 02 '18 02:11 schwartzmx