julep
julep copied to clipboard
julep-ai
A new DSL and server for AI agents and multi-step tasks
Let's run an automated evaluation on the RAG dataset (using a local model or something) and then tune the doc search hyperparameters based on this. Parameters are: - num docs...
That is, people should be able to send tools in the session itself in addition to the tools of the agent. So basically allow `POST {tools, ...} to /session/chat` and...
https://github.com/julep-ai/julep/blob/dev/agents-api/agents_api/routers/agents/routers.py#L365 and others
use https://huggingface.co/nvidia/dragon-multiturn-context-encoder for semantic cache embeddings
Use xxhash for hashing, create a cozo table for saving these. lookup before every call to openai `xxhash(json.dumps({ chatml, parameters })) => cache lookup => openai` the hash is the...
