Iaroslav Igoshev

ImportError: cannot import name 'basestring' from 'pyparsing'

8

Hi guys, I noticed that `dfsql` doesn't work with new versions of `pyparsing` (since 3.0.0). This should probably be fixed.

Upgrade Modin and pandas versions

5

- [x] Closes #1085 (Replace xxxx with the GitHub issue number). - [x] Tests passed if fixing a bug or adding a new feature. - [x] All [code checks passed](https://github.com/gventuri/pandas-ai/blob/main/CONTRIBUTING.md#-testing).

## What do these changes do? - [x] first commit message and PR title follow format outlined [here](https://modin.readthedocs.io/en/latest/development/contributing.html#commit-message-formatting) > **_NOTE:_** If you edit the PR title to match this format,...

xref - https://github.com/modin-project/unidist/issues/342#issuecomment-1793727907

Open MPI hangs on Modin tests

2

When running the following Modin tests on Open MPI the flow hangs both in CI and locally. ```bash MODIN_ENGINE=unidist mpiexec --oversubscribe -x UNIDIST_MPI_SHARED_OBJECT_STORE=True -n 1 python -m pytest modin/pandas/test/internals/test_benchmark_mode.py ```...

We should figure out why MPI is slow here and fix it. https://github.com/intel-ai/timedf_benchmarks/blob/b092ea0d490eb630224fc4ffdbc2f62630f57e49/timedf_benchmarks/hm_fashion_recs/fe.py#L159

We should figure out why the slow down occurs and fix it. https://github.com/intel-ai/timedf_benchmarks/blob/b092ea0d490eb630224fc4ffdbc2f62630f57e49/timedf_benchmarks/hm_fashion_recs/fe.py#L228

MSMPI implements a subset of features from MPI 3.1 standard, one of which is MPI shared memory - https://github.com/Microsoft/Microsoft-MPI#version-of-mpi-standard. We should enable the MPI shared object store for msmpi.

When putting data into the MPI shared object store we should try to use aligned memory access. This should improve performance.