Yusseiin

4bit, 8bit, no bit specified takes the same time. It seems from `nvidia-smi`  That no process is taking GPU Memory, but in Task Manager memory it's full used and...

I have the Intel GPU ( the one from the CPU ) and the Nvidia ones. it should be 4GB dedicated

I will try to reinstall it and check. nvidia-smi is reporting cuda 12.2, i need to install 11.8?

> I will try to reinstall it and check. nvidia-smi is reporting cuda 12.2, i need to install 11.8? I reinstalled everything following the guide under the docs. `print(torch.cuda.is_available())` is...

Checked Nvidia Control panel and set "Performance Mode", i am using `python generate.py --base_model=h2oai/h2ogpt-gm-oasst1-en-2048-falcon-7b-v3 --score_model=None --load_8bit=True` i will try with other config and check if i can reach something usable...

> For issue regarding node-red-contrib-cip-st-ethernet-ip (2.0.0.0) you the right place to post is https://github.com/SerafinTech/node-red-contrib-cip-st-ethernet-ip/issues Posted even on the other github, hope for an answer [https://github.com/SerafinTech/node-red-contrib-cip-st-ethernet-ip/issues/6](url)