polymath
polymath copied to clipboard
dglazkov
This allows sensing the content via embeddings similar content to what you're looking for without seeing the content itself. But someone with the access_token should get the full thing. Another...
Part of the point of polymath is that we'll have lots of federation of endpoints that can talk to each other. That means that two problems will be (reasonably) common:...
[Scraping Bee](https://www.scrapingbee.com/) would allow non tech folks to do integrations, and make it easy for all.
Save results for prompts. Allow for new runs and bring new results on top of the cached result. Add a hash(query) => results cache to the client. Related to #104.
Be able to have a conversation with history etc vs one off queries. We want to be able to chain queries together. It would be nice to be smart about...
The "library.json loaded up in memory" is fine for small libraries and as a quickstart, but a backing store like Pinecone is useful for large libraries and performance. Creating a...
While importing text, text can be gnarly. We need a consistent way to clean it. There are two places where that happens currently: 1. in `chunker.py`: https://github.com/dglazkov/polymath/blob/main/convert/chunker.py#L43 2. In `main.py`:...
a718b684d9f857694c1545f574e4599c39c48575 happened because there were some imports necessary for particular converters that weren't included. In general the number of importers has ballooned (which is great), but that means that there...
`completions_options` is used inside `query.html` but not in areas such as: ask_embeddings.py: ```def get_completion_with_context(query, context, answer_length=None, completion_model=COMPLETION_MODEL_NAME): # Borrowed from https://github.com/openai/openai-cookbook/blob/838f000935d9df03e75e181cbcea2e306850794b/examples/Question_answering_using_embeddings.ipynb prompt = f"Answer the question as truthfully as possible...
Currently you either take the defaults or you grab the new object of config. Be more defensive and for each key if one isn't there use the default. But be...