prompttools
prompttools copied to clipboard
hegelai
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
### ⁉️ Discussion/Question I'm currently facing an issue while attempting to use the HuggingFaceHubExperiment for testing models from Hugging Face. Specifically, it seems that only the gpt2 model is functional...
# Overview of Change OpenAI has a new API format that uses a client object, so we need to change the way we monkey patch logging ``` from openai import...
### 🚀 The feature Request from potential user: "There are two main aspects, 1) adjusting prompts that changing semantic words does not trigger hallucination, 2) the prompt itself is such...
### 🚀 The feature https://platform.openai.com/docs/guides/images/ ### Motivation, pitch Allows users to experiment with image generation (similar to Stable Diffusion experiment). ### Alternatives _No response_ ### Additional context _No response_
### 🚀 The feature https://platform.openai.com/docs/assistants/overview ### Motivation, pitch Allow users to experiment with different assistant ### Alternatives _No response_ ### Additional context _No response_
### 🚀 The feature We need an experiment or example for LlamaIndex. This will be similar to the work we need to do for LangChain and MindsDB. ### Motivation, pitch...
### ⁉️ Discussion/Question Hi. I just start with prompttools. I have two problems. I will post separate them. First, I couldn't load from downloaded model. There is error like below...
### 🐛 Describe the bug I downloaded the notebook `GoogleVertexChatExperiment.ipynb` and tried to run it and I get this error: ``` ----> 1 from prompttools.experiment import GoogleVertexChatCompletionExperiment 4 model =...
### 🐛 Describe the bug Hi folks, Thanks again for your work on this library. I noticed an issue where similarity scores do not get updated when I change my...
