mars
mars copied to clipboard
mars-project
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
# DataFrame-oriented JIT compiler ## Background Mars is aimed to handle Pandas pipelines in a distributed way, which can be more efficient than Pandas. Mars can partition big data into...
**Describe the bug** The same DataFrame expression outputs different results. The only difference is that the first piece of code does not execute intermediately while the second executes. **To Reproduce**...
## What do these changes do? This PR added pandas api coverage doc ## Related issue number Fixes #xxxx ## Check code requirements - [ ] tests added / passed...
**Is your feature request related to a problem? Please describe.** We can implement a xarray backend in Mars, refer to https://xarray.pydata.org/en/stable/internals/how-to-add-new-backend.html .
## What do these changes do? This PR use the direct async function call to speed up in-progress actor call, and gives a speed up about 2.6 times. **Benchmark code**:...
**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** To help us reproducing this bug, please provide information below: 1. Your Python version: 3.7.9...
**Is your feature request related to a problem? Please describe.** Recently, we want to use JIT compiler (#2754) to accelerate df getitem with bool expressions. But now Mars optimize these...
**Is your feature request related to a problem? Please describe.** `cluster.AffinityPropagation` can be introduced, sklearn version is https://scikit-learn.org/stable/modules/generated/sklearn.cluster.AffinityPropagation.html
**Describe the bug** Got an runtime error when using raydataset.to_ray_dataset **To Reproduce** To help us reproducing this bug, please provide information below: 1. Your Python version 3.7.7 from ray 1.9...
**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** To help us reproducing this bug, please provide information below: 1. Your Python version 2....
Metadata
Owner
Metadata
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.