llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggml-org

[Draft] Tensor Parallel support to llama.cpp

Open ClarkChin08 opened this issue 4 months ago • 2 comments

  • [x] I have read the contributing guidelines
  • Self-reported review complexity:
    • [ ] Low
    • [ * ] Medium
    • [ ] High Add tensor parallel support to llama.cpp, still draft code now.

ClarkChin08 avatar Sep 26 '24 02:09 ClarkChin08