zkchen

> Hello @SiRumCz! Have you tried the opposite, increasing storage? Could you try increase up to 60% of host RAM (as Modin does by default for one host). Without setting...

@anmyachev Yes, I have tried from range 1GB to all the way 60GB, they all seem to behave similarly except program will hang on 1GB, with and without setting `MODIN_NPARTITIONS`.

@anmyachev I have tried the configs are you suggested, unfortunately it will still get killed. I don't quite get why increasing MODIN_NPARTITIONS would help reduce concurrency, from the doc, I...

@anmyachev thanks for the explanation. What about the memory usage with Ray clusters, Modin doesn't seem to utilize both of the memories when doing the `dot` operation on dataframes, because...

@anmyachev Happy new year! Just to check-in, any updates on this Issue?

@noloerino Hi, as I mentioned in the description, there's not much useful information on the terminal because the program did not exit with error code, rather it was killed unexpectedly....

@anmyachev Thanks for the update, here's the output: ```py >>> print(f"{df._query_compiler._modin_frame._partitions.shape=}") df._query_compiler._modin_frame._partitions.shape=(48, 48) >>> from modin.config import CpuCount, NPartitions >>> print(f"{CpuCount.get()=}, {NPartitions.get()=}") CpuCount.get()=16, NPartitions.get()=48 ``` On both of my py3.8...

@anmyachev 1. There are many log files, which one would you like to see? 2. `{'accelerator_type:G': 3.0, 'node:__internal_head__': 1.0, 'node:': 2.0, 'node:': 1.0, 'CPU': 48.0, 'object_store_memory': 51305297510.0, 'memory': 113189397300.0, 'GPU':...

@anmyachev I have an update, it seems like the problem is not from `dot`, but the problem might come from the network. I have removed `dot` operation and the code...

@anmyachev I have enabled `faulthandler` while running the code, and got a few errors that might be the root cause for the problem. ``` >>> df.dot(mat_df) UserWarning: Ray Client is...