Anatoly Myachev
Anatoly Myachev
> Ah, I see. Is that the same reason why the Map operator requires that the shape doesn't change? Looks like that. > I do think it could be really...
> It looks like filter operator is suitable here. @anmyachev, do you think we should lift it up to the algebra module? Could you write in more detail? It seems...
> As to Map and Fold operators, I wouldn't like to change their definition since they have already been documented well in different articles/papers. @YarShev regarding `Fold` operator, at the...
Thanks @trgiangdo! There is a problem, but it seems that changes need to be made in the `twisted` library itself. Corresponding issue: https://github.com/twisted/twisted/issues/12039.
@Garra1980 almost all issues in the tracker have been fixed. It might be worth updating the tracker and considering moving it from experimental in the nearest release.
https://github.com/modin-project/modin/issues/7234
Hello @SiRumCz! Have you tried the opposite, increasing storage? Could you try increase up to 60% of host RAM (as Modin does by default for one host). Without setting `MODIN_NPARTITIONS`.
No, I mean using `--object-store-memory`
@SiRumCz consider this setup: * --object-store-memory 38000000000 (for both nodes) * --num-cpus 4 (for both nodes) * MODIN_NPARTITIONS=32 The main way to limit memory usage now is to reduce the...
> I don't quite get why increasing MODIN_NPARTITIONS would help reduce concurrency, from the doc, I thought if I increase the value, it would also increase how many tasks to...