clouddrift icon indicating copy to clipboard operation
clouddrift copied to clipboard

⚡ Source gdp adapter using dask

Open kevinsantana11 opened this issue 6 months ago • 8 comments

This migrates the adapter to leverage dask for the parallelization of the adapter. This makes the adapter much more scalable as Dask can scale to many machines. The memory footprint of the adapters will also be improved due to dasks lazy loading feature.

kevinsantana11 avatar Aug 14 '24 04:08 kevinsantana11