Apache arrow format for the endpoints

Open alippai opened this issue 2 years ago • 1 comments

It should be safer, faster and easier to process the data. Streaming frequent Apache arrow batches is a good replacement for json and csv, it can be used as-is in most client languages (also it's a backend for pandas without any conversion or parsing). Depending on your storage format, there is a chance it can be up to 10x faster on the server side as well (no serialization needed, you just put it on the wire)

Jul 26 '23 03:07 alippai

I see some arrow related forks by polygon. Can you share any info on the progress? Do you see it promising?

Dec 28 '23 01:12 alippai