Yi icon indicating copy to clipboard operation
Yi copied to clipboard

[doc][trans] submit translation for Yi Quick start (Docker + llama.cpp + Web demo) #321

Open soulteary opened this issue 1 year ago • 4 comments

Task:

  • [x] Docker
  • [x] llama.cpp
  • [x] Web Demo

image image image

soulteary avatar Jan 22 '24 11:01 soulteary

The tone in technical writing is typically neutral, objective, and professional (rather than engaging). The primary goal is to convey information clearly, accurately, and unambiguously.

image

Anonymitaet avatar Jan 23 '24 03:01 Anonymitaet

@soulteary I see you have resolved most of the comments. Feel free to ping me once you've addressed them all. 😺

Anonymitaet avatar Jan 23 '24 09:01 Anonymitaet

Is there quantized vision model in gguf format for llama.cpp?

chigkim avatar Jan 23 '24 11:01 chigkim

Is there quantized vision model in gguf format for llama.cpp?

not yet, but you can manually quantize to run the 4-bit version supported by transformers. like this: https://www.zhihu.com/question/640746695/answer/3373498291

soulteary avatar Jan 28 '24 10:01 soulteary

What is the point of this exercise? Why not just use ChatGPT to translate from English to Simplified Chinese? Wouldn't that be faster?

pattang56892 avatar May 27 '24 18:05 pattang56892