Ravindra Marella

Hi, sorry for the late response and thanks for the PR. Currently this package only provides the minimum required css to load and render the fonts. Font size and colors...

I don't think the default models are the best for all languages. I'm also not familiar which models are best for other languages. I would suggest asking for model suggestions...

3. MPT models don't have GPU support. It doesn't throw error and simply runs on CPU. May be I should print a warning when someone tries to use `gpu_layers` for...

Recently CUDA support (experimental) was added for MPT models. Please update, try it out and let me know if the performance has improved.

You can try different prompts like: - *Based on the context provided, who is captain america?* - *Based on the above text, who is captain america? If the above text...

Do you want to use `ctransformers` or `huggingface` model? If you want to use `huggingface` set: ```yml llm: huggingface ``` If you want to use `ctransformers` make sure it is...

So basically you should create a `chatdocs.yml` file in the directory you are running commands from and add the following to it: ```yml llm: huggingface # this makes it use...

Please try reinstalling from source: ```sh pip uninstall ctransformers --yes pip install ctransformers --no-binary ctransformers ```

Added support for 🤗 Transformers in [0.2.26](https://github.com/marella/ctransformers/releases/tag/v0.2.26)

Hi, this looks similar to https://github.com/microsoft/TaskMatrix/issues/242#issuecomment-1475521495 Can you try updating `charset-normalizer` package: ```sh pip install --force-reinstall charset-normalizer==3.1.0 ```