featuretools
featuretools copied to clipboard
Make dask an optional dependency
- Currently, dask is required to be installed with Featuretools (its used for if n_jobs > 1 for DFS)
- However, dask can be made into an optional dependency, and only needed if n_jobs is greater than 1 when calling DFS.
- Therefore, we should create a
dask-requirements.txt, and modifysetup.pywith an additionalextras_require. - Additionally, DFS should be modified to look for Dask if n_jobs is greater than 1.
- If Dask is not installed, DFS should raise a error, and direct the user to install Featuretools with Dask
When we make this change, we can also move pyyaml out of the general requirements. Currently dask, distributed, and moto depend on pyyaml. We could make pyyaml-requirements.txt and have both dask-requirements.txt and test-requirements.txt include it via -r pyamml-requirements.txt
This will have to wait until we finish the Woodwork integration into Featuretools
Will revisit with Featuretools 2.0. We will most likely do this.