Ji-Ha

AssertionError: Torch not compiled with CUDA enabled

7

Hi I tried to run LLMLingua using dolphin-2.6-phi-2 but I got ```AssertionError: Torch not compiled with CUDA enabled``` ``` PS C:\Users\DefaultUser> python "C:\Users\Public\Coding\LLMLingua\LLMLingua_test1.py" Special tokens have been added in the...

How to setup LLMLingua with localhost?

6

Hello, how do I set up LLMLingua with a self-hosted localhost server? Is there a tutorial? Thanks. ```[tasklist] ### Tasks ```

[BUG] White on white text in the demo when using dark mode

1

**Describe the bug** When you turn on dark mode in the demo page and get redirected from the payment page, the text turns white but the background remains white, therefore...

I have added the ability to search for subfolders inside the models folder.    Addresses #5129, #1626 ## Checklist: - [x] I have read the [Contributing guidelines](https://github.com/oobabooga/text-generation-webui/wiki/Contributing-guidelines).