mlx
mlx copied to clipboard
MLX: An array framework for Apple silicon
This maybe a feature request or a bug.. not sure: ```python import mlx.core as mx import multiprocessing as mp queue = mp.Queue(5) def worker(queue): queue.put(mx.array(1.0)) if __name__ == "__main__": process...
To reduce the overhead of CUDA graph to minimum, we should avoid updating graph as possible as we can, and in the most ideal situation the graph should be created...
I read the document https://ml-explore.github.io/mlx/build/html/dev/extensions.html#implementing-the-cpu-back-end, and I need to develop a new primitive in my project. I found that the example custom cpu kernel is a single thread one, how...
I just came across https://github.com/iree-org/iree/issues/4727#issuecomment-1629901672 which had some pioneer experiments on synchronization between CPU/GPU with CUDA. They had the same conclusion with me: there is no way to make `cudaEvent`...
In MLX you can run tasks in CPU and GPU streams and have them waiting for each other: ```python c = mx.add(a, b, stream=mx.cpu) d = mx.add(a, c, stream=mx.gpu) ```...
On both performs when try to install under ubuntu desktop 22.04.5/24.04.3: pip install mlx[cuda] Error messages: Could not find a version that satisfies the requirement mlx[cuda] from versions[none] ERROR: No...
Several platforms, architectures and Python versions are not being build (for example Python 3.14, musllinux, most glibc variants, ...). https://pypi.org/project/mlx/0.28.0/#files > The manylinux project supports: > * manylinux2014 images for...
### š Feature request: Add **ASTC weight compression + hardware decoding** support **TL;DR** Recent Apple documentation (ā*AppleĀ IntelligenceāÆFoundationāÆLanguageāÆModelsāÆTechĀ ReportĀ 2025*ā) shows that storing LLM weights as...
# Motivation mlx supports exporting a model with its parameters into an `mlxfn` file and later loads it into other programming languages, e.g., Python, C++, without the need for the...
**Describe the bug** When attempting to perform an `mlx.nn.celu` operation using `MLX 0.26.1` on `Ubuntu 24.04`, the operation fails with C++ compilation errors. The errors indicate "redeclaration of C++ built-in...