Iaroslav Igoshev
Iaroslav Igoshev
HDK engine is deprecated and will be removed in a future version.
It looks like filter operator is suitable here. @anmyachev, do you think we should lift it up to the algebra module?
`PandasQueryCompiler.filter_func = Fold.register(lambda df: df[df.index % 2 == 0])` is a normal filter operator. We have filter method at the Modin Dataframe layer but we don't have it in algebra...
We have a note in the docstring: "The data shape is not changed (length and width of the table).". However, I agree with you and we can expand Fold operator...
Move content related to OmniSci engine from `modin/experimental/core` to `modin/core` and avoid setting `MODIN_EXPERIMENTAL=1`.
Yes, let's try to put it in 0.13.
We can use [broadcast_apply_full_axis](https://github.com/modin-project/modin/blob/7ef544f4467ddea18cfbb51ad2a6fcbbb12c0db3/modin/core/dataframe/pandas/dataframe/dataframe.py#L3139) and pass the right dataframe in to it. Further in the flow we just pass object references of the right dataframe in to ray remote functions....
@dchigarev, should we close this issue?
HDK engine is deprecated and will be removed in a future version.
@abudden, your issue seems to be related to this topic https://modin.readthedocs.io/en/stable/getting_started/troubleshooting.html#error-when-using-dask-engine-runtimeerror-if-name-main. You should put your code under `if __name__ == '__main__':`.