tortoise.cpp icon indicating copy to clipboard operation
tortoise.cpp copied to clipboard

latest ggml version sync

Open dridri opened this issue 6 months ago • 7 comments

This is an attempt to rebase on the latest commit of ggml master branch. My primary goal behind it is to add Vulkan/OpenCL support as I only have AMD GPUs.

Tested and working well on CPU, but I don't have any nVidia card around so I cannot test CUDA backend.

This needs the following PR on ggml to work : https://github.com/balisujohn/ggml/pull/1

dridri avatar Aug 10 '24 12:08 dridri