Prasad Chalasani
Prasad Chalasani
> it download the model and run it Did you mean to say it's working now?
> but when it comes to using DocChat it doesn't give any response. Are you running exactly the `rag-local-simple.py` script? Let me know the exact script syntax you are using,...
If you ran it correctly, the fact you're not getting a response could mean that for that specific question there was no answer found. If you're not getting a response...
It may be ok to have a separate file that is rendered into the PyPi page, rather than exactly current README (or some translation of it)
> I made this changes. that should work, for a good enough local model. (I assume you don't actually use `**.***` in the URL, just masking it here).
Can you check with other documents and/or more variety of questions and see if you’re still not getting a response? You can also try the bare chat mode (I e...
In future, when we have tests that depend on optional/extra deps, we should keep the tests in `tests/main` and skip the test when the corresponding import fails, e.g. how I...
Structure-aware chunking in general is good to have. E.g. in a markdown doc, it's good to avoid having a logically coherent section broken up, as long as chunk size limits...
And add test in `test_vector_stores.py`
@rachittshah If I understood the TGI post correctly, we would simply set `api_base` to be access models on TGI. We already have this in langroid, i.e. you can set `OpenAIGPTConfig.chat_model...