Darren Oberst
Darren Oberst
Interesting idea ... Where would want to start with Rust? BTW, a big piece of the back-end of llmware is written in Native C (check the /libs folder). The rest...
Just brainstorming: it might be interesting to explore around production-grade inference, potentially in conjunction with GGUF models (that are already compiled in C/C++ and do not necessarily require python/pytorch) .......
Most likely, there is a parsing issue with the .json file, so it is not returning any parsed content, which is then triggering the breaking error when you call prompt_with_sources....
@HarshalPal - confirming YES... sorry I missed your reply. Closing out this issue as it was resolved in 0.1.14.
thanks for the feedback - which model are you trying to use?
@dtthan1971 - FYI, we added OpenChat support last week. This should enable you to support this use case. Please check out the example in Examples/Models in the file: using-open-chat-models.py -...
Thanks for the feedback. Sorry you have run into an issue. Which model are you trying to use?
we just updated this example - could you try again? I ran it a few times locally, and no issues, so hopefully you see the same on your end.
Sure - for future reference, this is in the Examples/RAG/ folder: """This example demonstrates a basic contract analysis workflow run entirely on on a laptop using a RAG-finetuned small specialized...
Hi MacOS - appreciate your contribution - BTW, please check the updated EmbeddingHandler and embedding classes - there have been some recent updates in terms of support for other vector...