OpenDAN-Personal-AI-OS icon indicating copy to clipboard operation
OpenDAN-Personal-AI-OS copied to clipboard

Enhancements for Knowledge Base and Multimedia Content Handling

Open waterflier opened this issue 1 year ago • 0 comments

I would like to suggest some improvements in our current KB system:

Contextual Text Prompts in Knowledge Base: The text prompts returned by the Knowledge Base should be multiline, including the lines above and below where the relevant terms are found in the document. This would provide a richer context for the associated terms.

Token Limit and Priority in Knowledge Base: Due to the token limit, the Knowledge Base should find the highest weighted associated objects based on the provided token limit. If this approach isn't effective, I have another idea: We could only return the titles of the associated objects, and allow the LLM to decide through inner functions whether it needs to read the original text of these associated objects. If we can include a table of contents in the associated objects, it might further improve the efficiency of LLM's autonomous search.

Prompt Construction for Multimedia Content: The current structure seems more suitable for generating Knowledge Base prompts for document content. I believe we should also construct prompts for different types of multimedia content.

I look forward to hearing your thoughts on these suggestio

waterflier avatar Sep 21 '23 21:09 waterflier