arkouda icon indicating copy to clipboard operation
arkouda copied to clipboard

Calculate the byte sizes of Parquet str columns in batches

Open bmcdonald3 opened this issue 8 months ago • 6 comments

To improve the performance of Parquet string reading, increasing the batch size for byte calculation allows for larger chunks of work, leading to a performance improvement.

bmcdonald3 avatar Jun 11 '24 16:06 bmcdonald3