node-redshift icon indicating copy to clipboard operation
node-redshift copied to clipboard

What about streaming?

Open cabrinoob opened this issue 8 years ago • 2 comments

Is there a way to stream out rows from redshift instead of getting the entire dataset into memory before return it to client?

Thank you for your help

cabrinoob avatar May 03 '16 06:05 cabrinoob

Yeah! Theoretically there's a way to do this using redshift cursors and node streams like in this module https://github.com/brianc/node-pg-query-stream. A streaming API is a great feature idea but this project currently doesn't have support for it. But I'm going to put it on the feature list for the next version.

On May 3, 2016, at 2:22 AM, cabrinoob [email protected] wrote:

Is there a way to stream out rows from redshift instead of getting the entire dataset into memory before return it to client?

Thank you for your help

— You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub

dmanjunath avatar May 03 '16 13:05 dmanjunath

This would be nice.

I need to write a very large csv. And would be nice to append row by row.

raffacabofrio avatar Feb 13 '19 17:02 raffacabofrio