dask-sql icon indicating copy to clipboard operation
dask-sql copied to clipboard

[ENH] Investigate perf and memory consumption with cross joins

Open ayushdg opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. As discussed in https://github.com/dask-contrib/dask-sql/pull/521#discussion_r874111227 and implemented in #150 we should investigate the perf of using a Dask DataFrame merge directly vs creating the layers manually to see if there's any perf differences.

Describe the solution you'd like N/A

Describe alternatives you've considered N/A

Additional context Add any other context, code examples, or references to existing implementations about the feature request here.

ayushdg avatar May 19 '22 20:05 ayushdg