kstavro

Refactors TryMatmuls for better error messages when dimensions don't match

5

I haven't synced the branch yet with all the recent commits, but will of course do if this works out in the end. So, I tried to move more of...

Add QoL Error when dimensions between layers don't match

36

If, by accident, you mistype the dimensions of layers in your `model`, the compiler throws you an error at `model.forward_mut()` which does not hint at all to the actual error...

Candle example uses 10% of CPU when fma is active for x86

7

Coming here after noticing that CPU inference in the llama example over at candle only utilizes 10% of my CPU (AMD Ryzen 5800X3D). As I mentioned over at the candle...