CoderChang65535

Results 3 comments of CoderChang65535

I tried this to fix missing module error: 1. Go to `anaconda3/lib/python3.11/site-packages/gptq` folder 2. Create the same file in this folder: [setup_cuda.py](https://github.com/IST-DASLab/gptq/blob/main/setup_cuda.py) 3. Run `python setup_cuda.py install` I am still...

> Good question > > I need to add support for gateways other than the main OpenAI one. So you can choose which API to use in the end You...