yoloexplorer
yoloexplorer copied to clipboard
Use recordbatch iterator when creating tables
Currently the table is built using the entire dataset in one go which'll probably fail for massive datasets due to memory constraints. Switch to iterator for initialization of LanceDB tables.