SunixLiu
SunixLiu
> Just to make sure it's not the model's issue, can you run `facebook/opt-125m` model? Yes, I can use text-generation-webui to load `facebook/opt-125m` and get it work.
> @dcruiz01 @SunixLiu @AlpinDale vLLM is designed to take almost all of your GPU memory. Could you double-check your GPU is not used by other processes when using vLLM? I'm...
Thank you @zhuohan123 for helping this. Issue closed.
我找到问题了。 在文件web\utils\analysis_runner.py里，加上`import streamlit as st` 就可以了。
CUDA 12.4 here, working perfectly, direct run
> 将github原工程按照这个步骤来，首先这个**可能会导致你原有的环境不可用** > > # 1.获取资源 > sudo apt install espeak-ng > > git lfs install > cd api/src/models > git clone https://huggingface.co/hexgrad/Kokoro-82M-v1.1-zh > mv Kokoro-82M-v1.1-zh v1_1-zh > > cp...