chdb icon indicating copy to clipboard operation
chdb copied to clipboard

Add support for arrow stream

Open djouallah opened this issue 5 months ago • 3 comments

first congratulation on the progress you made, chDB is substantially better than just 6 months ago, I am trying to read a folder of csv and export it to delta, current I am using df = sess.sql(sql,"ArrowTable") to transfer the data to deltalake Python, the problem is I am getting OOM errors, would be nice if you can add support for arrow recordbatch so the transfer is done in smaller batch

thanks

djouallah avatar Sep 08 '24 08:09 djouallah