taoari

Results 8 comments of taoari

@Celelibi Will you share your Controller file for Alienware 15 R3? And also any instruction for finding the mappings? My output of `lsusb -v` is the following: ``` Bus 001...

@TheBloke When I tried to run with `TheBloke/Llama-2-7b-Chat-GPTQ`, I got the following error: warmup{max_input_length=4096 max_prefill_tokens=4096}:warmup: text_generation_client: router/client/src/lib.rs:33: Server error: Not enough memory to handle 4096 prefill tokens. You need to...

@Saigenix This does not work. For Gradio streaming, the predict function should be a generator function. The complex part is that LangChain does not return a generator even with streaming=True.

@Saigenix i do not know simple ways to achieve this. I see examples using subprocess or websocket, the codes are quite difficult to understand. So I am wondering if this...

@sestinj I got the following error ModuleNotFoundError: No module named 'continuedev.src.continuedev.libs.llm.ht_tgi'

@sestinj No errors this time. But it still does not work. The "Play" button blinks all the time, and get no response.

@sestinj I think it crashed on my computer. I did uninstall, lsof -i :65432 | grep "(LISTEN)" | awk '{print $2}' | xargs kill -9 delete ~/.continue reinstall It still...

Same error here for version 2.0.3. The interesting thing is that: if I run `pip install xgboost==2.0.3`from a notebook, I get this error. But if I run from the system...