featuretools
featuretools copied to clipboard
Implement deepcopy for Koalas EntitySets
Koalas DataFrames cannot be deepcopied, so currently EntitySet.__deepcopy__
will not work for EntitySets with koalas dataframes.
The tests for EntitySet.concat xfail for koalas because "Koalas deepcopy fails", so this is not a behavior that existed with the Entity implementation, so we're not handling it in the initial Woodwork integration. However, it might be nice to have something implemented for Koalas.
Since it's possible to deepcopy everything except for the DataFrame, we can consider the following options:
- bring the DataFrame into memory with to_pandas and bring back to koalas, which will create a copy of the data, and note that this can be very computationally intensive
- do a shallow copy of just the dataframe (which does work) for koalas and leave a note that the object is the only shallowly copied, so any changes should be made with that in mind. All the other attributes of the entityset would still be deepcopied