wei.cai

> 模型看到了，需要通过api调用吗？ 是的，需要api调用。

Hi MohamedKHALILRouissi, In your application, you can try to fine llm with data examples might look like: Input: A prompt describing the specific information or query, such as "Provide a...

it's called Supervised fine-tuning (SFT) on instruction data

try "pip install exllamav2"? and "pip show exllamav2" to check if installed successfully

70b chat v6的量化版本在这里：https://huggingface.co/TigerResearch/tigerbot-70b-chat-v6-4bit-exl2