mars
mars copied to clipboard
mars-project
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
**Is your feature request related to a problem? Please describe.** We can support restarting entire service.
Broadcasting data shared by a number of workers can be added. Strategies like TorrentBroadcast in Apache Spark can be used.
As more and more libraries now deprecate support for Python 2, it is time to replace coroutines in Mars with builtin asyncio supplied by Python 3.
We shall support storing shared data in multiple paths to facilitate using multiple devices.
**Is your feature request related to a problem? Please describe.** When running huge graphs (~80k nodes) in Mars, runners have to wait for a long time (~20min) before the graph...
**Is your feature request related to a problem? Please describe.** Currently fail-over being developed Mars (#207) only supports one graph. However, support for fail-over in eager mode under a number...
We may encounter slow nodes when executing on multiple workers. The initial assignment algorithm is not guaranteed to be optimal. The execution graph may have a larger output set than...
**Describe the bug** Failover remote functions failed. **To Reproduce** To help us reproducing this bug, please provide information below: 1. Your Python version 2. The version of Mars you use...
**Describe the bug** When debugging mars in pycharm, following exception is throwed:  Although it didn't affect program execution, but this error log is very confusing, and should be removed....
## What do these changes do? ## Related issue number Fixes #xxxx ## Check code requirements - [ ] tests added / passed (if needed) - [ ] Ensure all...
Metadata
Owner
Metadata
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.