featuretools icon indicating copy to clipboard operation
featuretools copied to clipboard

Make dask an optional dependency

Open gsheni opened this issue 4 years ago • 3 comments

  • Currently, dask is required to be installed with Featuretools (its used for if n_jobs > 1 for DFS)
  • However, dask can be made into an optional dependency, and only needed if n_jobs is greater than 1 when calling DFS.
  • Therefore, we should create a dask-requirements.txt, and modify setup.py with an additional extras_require.
  • Additionally, DFS should be modified to look for Dask if n_jobs is greater than 1.
  • If Dask is not installed, DFS should raise a error, and direct the user to install Featuretools with Dask

gsheni avatar May 05 '21 14:05 gsheni

When we make this change, we can also move pyyaml out of the general requirements. Currently dask, distributed, and moto depend on pyyaml. We could make pyyaml-requirements.txt and have both dask-requirements.txt and test-requirements.txt include it via -r pyamml-requirements.txt

rwedge avatar May 11 '21 20:05 rwedge

This will have to wait until we finish the Woodwork integration into Featuretools

gsheni avatar Jun 15 '21 20:06 gsheni

Will revisit with Featuretools 2.0. We will most likely do this.

gsheni avatar Aug 10 '22 18:08 gsheni