tortoise.cpp icon indicating copy to clipboard operation
tortoise.cpp copied to clipboard

Mac OS: Bringing metal support

Open baileyheading opened this issue 7 months ago • 51 comments

Work is underway to get metal working for this project. Keen to get help from anyone interested.

TODO:

  • [ ] add conv_tranpose_1d for metal (already has cpu implementation)
  • [ ] modify ggml_pad backend and added ggml_pad_ext for metal
  • [ ] add pad_reflect_1d to metal (already has cpu implementation)
  • [ ] add unfold_1d to metal (already has cpu implementation)

Existing PRs from @balisujohn decent example to follow for the changes done to CUDA already: https://github.com/ggerganov/ggml/pulls/balisujohn

baileyheading avatar Jul 14 '24 09:07 baileyheading