tpcds
tpcds copied to clipboard
Teradata
Write directly to HDFS
Is there any interest in teaching this library to also write directly to HDFS connected storage? I have a patch that handles it already but before I go to clean up the code and make it presentable I wanted to see if you would be at all interested in a feature like that?
To clarify, is your patch to expand the generator to be able to write to an hdfs file instead of a regular file? That seems reasonable. We'd be happy to take a PR.
Yes, that's correct -- it's pretty simple frankly. I just need to do some cleanup in your pom as some of stuff was black listed IIRC.
On Tue, Aug 29, 2017 at 9:43 AM Rebecca Schlussel [email protected] wrote:
To clarify, is your patch to expand the generator to be able to write to an hdfs file instead of a regular file? That seems reasonable. We'd be happy to take a PR.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/Teradata/tpcds/issues/24#issuecomment-325723400, or mute the thread https://github.com/notifications/unsubscribe-auth/AACHV2AyvfvFW50bGlrmiAt3iYH5aIbmks5sdD-ygaJpZM4PGDNi .
-- snet from a itny keybaord