Igor Zamyatin
Igor Zamyatin
Great! Looking forward to see these changes in
@naren-ponder Any plans here?
Any progress here?
I see ~3x speed up compare to pandas on this test for current modin master so I think this can be closed
> @Garra1980 what system did you test on? Did you enable benchmark mode? If you don't enable benchmark mode the Modin binary operation should happen async. This is regular python...
I got your point - I just was under impression that modin was slow so there is no async execution in the script Anyway, we still seem to speed up...
pandas is ~0.5s
Looks like should be something like https://github.com/omnisci/omniscidb/blob/416df923adebc6d2db1372986d961b563f94d7b7/QueryEngine/ArrowResultSetConverter.cpp#L972
cc @devin-petersohn
@devin-petersohn any thoughts/estimations about this