rwkv.cpp icon indicating copy to clipboard operation
rwkv.cpp copied to clipboard

Draft: support apple metal framework to compute graph

Open fann1993814 opened this issue 1 year ago • 4 comments

  1. Library setting
  • [x] Add new metal setting in CMakeLists. (follow the CMakeLists.txt in llama.cpp)
  1. Update Functions for metal support.
  • [x] Set initial metal context in load model weight
  • [x] Add buffer data from the context built from original graph in rwkv_graph
  • [x] Add new compute_graph for metal in rwkv_eval
  • [ ] Update operations for metal can use in rwkv_operators. (because many ggml_op cannot compute in metal, and I found the max function cannot be re-write from other ggml-functions for metal backend can be supported.)

#134

fann1993814 avatar Oct 09 '23 07:10 fann1993814