modin icon indicating copy to clipboard operation
modin copied to clipboard

PERF: importing modin.pandas from fresh pypi.org install takes 11 seconds

Open mvashishtha opened this issue 2 years ago • 5 comments

pip install --force-reinstall modin
time python -c "import modin.pandas as pd"

System Information my laptop (macOS Monterey version 12.4 with 16 GB RAM and 2.3 GHz 8-core intel CPU on MacBook Pro (16-inch, 2019))

mvashishtha avatar Jun 01 '23 16:06 mvashishtha

importing pandas<2.0 alone has the same problem. this takes 11.533 seconds

pip install --force-reinstall "pandas<2.0"
time python -c "import pandas"

mvashishtha avatar Jun 01 '23 16:06 mvashishtha

the pandas issue to follow: https://github.com/pandas-dev/pandas/issues/53488

mvashishtha avatar Jun 01 '23 16:06 mvashishtha

@mvashishtha, can we close this issue as there is a tracker in pandas?

YarShev avatar Jan 11 '24 21:01 YarShev

FYI on windows I see the following times (using MINGW64 on current Modin master):

$ time python -c "import modin.pandas as pd"

real    0m1.287s
user    0m0.000s
sys     0m0.000s

anmyachev avatar Jan 12 '24 01:01 anmyachev

On linux.

$ time python -c "import modin.pandas as pd"

real    0m0.488s
user    0m2.912s
sys     0m11.180s

YarShev avatar Jan 12 '24 09:01 YarShev