Awni Hannun
Awni Hannun
Nice. I think (at least for the non-group axis) fixing this is mostly a matter of bounds checking in the matmul.. but @angeloskath can say more about if / when...
Aslo https://github.com/ml-explore/mlx-examples/issues/279
@mzbac not sure you saw, in 0.0.10 this should be fixed. We can add yayi2 to mlx-lm now 😃
Oh that would be amazing.
Possible we could allow for some basic number formatting in the printing of arrays. The python code can then set the appropriate format for `True` and `False`.
The array printing code is [here](https://github.com/ml-explore/mlx/blob/main/mlx/utils.cpp#L124). It looks like NumPy uses some global state (see [set_format_options](https://numpy.org/doc/stable/reference/generated/numpy.set_printoptions.html#numpy.set_printoptions) to manage the printing style. That may be a bit heavy handed for a...
Hmm. One thing I'm wondering is if you can try just looping over the data without using MLX. Just to make sure this is an MLX issue and not something...
It doesn't look to be out of memory. And it definitely shouldn't segfault. Does it segfault reliably for you? How far into the training?
I'm running your script on an M1 Max with 32 GB. So far no segfault 🤷♂️ , I'm at iteration 600. Did it segfault before that? Also what's your OS?...
What about your MLX version (or commit hash if building from source)?