Shawn Yang
Shawn Yang
@jyizheng Seems it's a bug in old version of mars, which has been fixed in #2579. Could you try a newer mars version?
@jyizheng Could you try use mars 0.9 by `pip install --pre pymars`, I believe it will works.
@qinxuye I don't know why it's named as `read_raydataset` instead of `read_ray_dataset`, I changed it to `read_ray_dataset` in #2705 yesterday.
> Why not create an actor of Mars `LocalCluster` of `mars/deploy/oscar/local.py`? This is much simpler and most of the logic is shared with Mars which is well tested in CI....
> Please open a new issue to illustrate your changes. What's more, any benchmarks for that? @wjsi I will open an issue after I finished the benchmark.
> Remove in-process actor will get more performance boost. But, that will change lots of code. Yes, removing in-process actor will get more performance boost. Actually, after using direct call...
Can we add some tests to check that closure cleanup are actually executed?
- If invoke `to_csv` with a local path, we can collect data to local by `to_pandas` and then call pandas `to_csv` instead. - If invoke `to_csv` with a remote path...
The existing class loader is an `URLClasssLoader`, and not referenced by other classes, after `compileClass2ByJaninoCompiler` method return, there should be any strong references to all those generated class, and they...