modin icon indicating copy to clipboard operation
modin copied to clipboard

``Series.sample()``, ``Series.repeat()`` and ``Series.empty()`` don`t work correctly at MODIN_STORAGE_FORMAT=omnisci

Open Rubtsowa opened this issue 3 years ago • 2 comments

When I run:

import modin.pandas as pd
from modin.pandas.test.utils import test_data_values
import modin.config as cfg
cfg.StorageFormat.put('omnisci')

data = test_data_values[0]
modin_series = pd.Series(data)
hasattr(modin_series.sample(n=0, random_state=21019), "index")

I have error:

KeyError: 'Column F___reduced__ does not exist in schema'

Also function repeat have this problem if run: hasattr(modin_series.repeat(0), "index") Also function Series.empty have this error:

modin_series = pd.Series()
modin_series.empty

Rubtsowa avatar Jan 17 '22 10:01 Rubtsowa

@modin-project/modin-omnisci could someone please check if this still happens?

vnlitvinov avatar Aug 29 '22 13:08 vnlitvinov

Should be fixed by #4910

AndreyPavlenko avatar Sep 21 '22 10:09 AndreyPavlenko

@AndreyPavlenko, #4910 is merged. Should we close this issue?

YarShev avatar Sep 27 '22 18:09 YarShev

The issue is not reproducible after the merge, however, the following warning is printed: UserWarning: Frame contain columns with unsupported data-types: ['F___reduced__']. All operations with this frame will be default to pandas!

AndreyPavlenko avatar Sep 27 '22 18:09 AndreyPavlenko

Okay, that looks like a separate feature to implement so I am closing this issue.

YarShev avatar Sep 27 '22 18:09 YarShev