Maximilian Böther

4) Oh, and just additionally, I was wondering if it was safe to use more gcc optimization flags or if that could somehow mess up OpenBlas: `-O3 -mfloat-abi=hard -funsafe-math-optimizations -mlittle-endian...

Thank you for your help! 1. Nope, using BINARY=32 does not help. I'm not so 100% sure about the ARMV7 vs ARMV8 internals, but for example, for ARMV7, OpenBLAS is...

Yes, it will build ARMV7. But my problem is that the compiler flags `-mcpu=cortex-a72 -mfpu=neon-fp-armv8 -mtune=cortex-a72 mfpu=neon-fp-armv8` are only working for ARMV8. If the autodetection does a ARMV7 build, we...

Hmmm, so vector instructions should not be possible when running a 32bit OS on ARMV8. Then I do not get how Roy Longbottom was able to port Linpack w/ NEON...

But then the statement that NEON is only available in 64bit is not really true, or is it? If there is a subset of instructions available, at least some SIMD...

So, after some more research, I've found out the following: Just like martin-frbg wrote, VFP is just a hardware accelerator for floating point operations that fastens up SISD instructions. NEON...

Thanks for the pointers! I have already read the swisstable design document you linked, and I will watch the talk you sent. However, I was rather referring to platform-/architecture-specific optimizations,...

for those interested, in https://github.com/MaxiBoether/langchain-ollama-package I have prototyped using the ollama package also for e.g. the chat model, which massively speeds up the inference. I need to clean this a...

Hey, please excuse the late answer, I had some deadlines I was working on. I added package versions to the environments. Can you recreate the base environment from scratch, and...

Ah, sorry, I accidently removed the file when updating my personal webpage. The mboether.com link should work again. Leaving this issue open until I find a new alternative mirror, apparently...