AIconicInsight

The below `conda_env.yaml` version worked for me. I moved matplotlib to the conda section as you did and used the pypi version of `slowapi` instead of the given git version....

Another fix: `pydantic==2.10.1` is required so that chainlit works fine. Newer versions break the installation. Source: [Update of pydantic to version 2.10.2 breaks chainlit](https://github.com/Chainlit/chainlit/issues/1544)

The RM works fine, after some more testing I narrowed the issue down to the LLMs. I tested Ollama models in a up to 80GB VRAM range (both quantized and...