Juan Calderon-Perez

Results 1417 comments of Juan Calderon-Perez

@GauriSP10 Would it be possible to merge this?

Yeah, I can definitely test the arm64/linux wheels on a Raspberry PI. I was using the wheels from https://github.com/jllllll/llama-cpp-python-cuBLAS-wheels for the longest, but yes it does blow out the number...

@abetlen If you install the package in `MacOS` directly the platform is `darwin/arm64`, which you have wheels for already. If you install the package in MacOS with Docker the platform...

@abetlen I don't see any `arm64` wheels here https://abetlen.github.io/llama-cpp-python/whl/cpu/llama-cpp-python/ Running pip install confirms it can't find wheels: ```console Building wheels for collected packages: llama-cpp-python Building wheel for llama-cpp-python (pyproject.toml) ......

Maybe the list can be shrink down a bit. For example: - Not many people have AVX512, remove until there's enough demand. - Making AVX support a minimum? - Remove...

@Smartappli Your hanges are adding AVX for CUDA wheels, is that needed? At that point the user is using the GPU. It makes sense for the basic wheels to have...

Up to @abetlen I was going to mention the current CI (outside of this PR) is building i386 and win32 wheels, is that even necessary?

> Ping @gaby It's up to @abetlen :-)