Denis Lapchev
Denis Lapchev
That would be greatly appreciated @Hisma
Is it for interactions via the terminal, similar to the one used in the demo? That interface is super simplistic, more of a toy mode. Arguably, if using the web...
Hi, I might add support for docker in the future if there is enough demand
It is an outdated version and not in sync with the latest libraries. Will add pandoc once I update it.
CUDA is also required for sparse embeddings (SPLADE in this project), which are not optional at the moment. Theoretically, they can run on CPU but would have a large performance...
Hi @vulcano9 Without GPU, it would take a few orders of magnitude longer (technically I didn't test it - but should be supported out of the box on a system...
Closing as stale issue
Thanks for the suggestion, sounds like a good idea, please feel free to create a PR
Hi, I will investigate and try to add support in the upcoming minor release, during the week.
Version 0.8.3 should support OpenAI's embeddings now. Here is an example configuration - https://github.com/snexus/llm-search/blob/main/sample_templates/openai_embeddings.yaml Let me know if you have any issues.