clouddrift
clouddrift copied to clipboard
⚡ Source gdp adapter using dask
This migrates the adapter to leverage dask for the parallelization of the adapter. This makes the adapter much more scalable as Dask can scale to many machines. The memory footprint of the adapters will also be improved due to dasks lazy loading feature.