Miguel Angelo

I am trying to revalidate the domain as you suggested. When using `CompleteChallenge`, I use `Force` and `Regenerate` flags, but the challenge is the same as the previously already validated...

What I have found so far is an `import` that is failing in the `quant.py` file: ```python import quant_cuda_faster as quant_cuda ``` I then created a test file containing the...

I executed `python -m torch.utils.collect_env` in the context of `cmd_windows.bat`, with the result bellow. It tells that CUDA is installed. ``` PyTorch version: 2.2.1+cu121 Is debug build: False CUDA used...

> Hello, I was able to resolve this by using "ExLlamav2_HF" as the loader instead of "GPTQ-for-LLaMa", make sure to click Save Settings so it uses that next time it...

I was able to load the model and use *multimodal extension* using the `ExLlamav2` loader.

Hi @mniak I won't have time to look at this issue until the end of this month. If you want to contribute with a pull request in the mean time,...