Yi
Yi copied to clipboard
[doc][trans] submit translation for Yi Quick start (Docker + llama.cpp + Web demo) #321
Task:
- [x] Docker
- [x] llama.cpp
- [x] Web Demo
The tone in technical writing is typically neutral, objective, and professional (rather than engaging). The primary goal is to convey information clearly, accurately, and unambiguously.
@soulteary I see you have resolved most of the comments. Feel free to ping me once you've addressed them all. 😺
Is there quantized vision model in gguf format for llama.cpp?
Is there quantized vision model in gguf format for llama.cpp?
not yet, but you can manually quantize to run the 4-bit version supported by transformers. like this: https://www.zhihu.com/question/640746695/answer/3373498291
What is the point of this exercise? Why not just use ChatGPT to translate from English to Simplified Chinese? Wouldn't that be faster?