mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Published 20 hours ago • verified publisher icon EricLBuehler

Quantized Phi3: Features to add

Open EricLBuehler opened this issue 9 months ago • 0 comments

  • [ ] Support for LongRope (this is supported with ISQ in non-GGUF models, though)
    • The challenge is that the scalings information is not present in the GGUF file.
  • [x] X-LoRA: #293
    • Again, we already have ISQ support, so this is not critical.

EricLBuehler avatar May 09 '24 12:05 EricLBuehler