prompttools icon indicating copy to clipboard operation
prompttools copied to clipboard

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Results 41 prompttools issues
Sort by recently updated
recently updated
newest added

Adding Llama 3 8b Instruct Model variant to promptToolExperiment

### 🐛 Describe the bug On running the playground command, I see below deprecation warnings Please replace st.experimental_get_query_params with st.query_params. st.experimental_get_query_params will be removed after 2024-04-11. Refer to our [docs...

### 📚 The doc issue The docs steps are not working when I run playground streamlit command. Streamlit dependency is missing in requirements.txt ### Suggest a potential fix Include prompttools...

I have introduced a new class called OpenAICompatibleChatExperiment. This class aims to enhance the compatibility of prompttools with a wider range of large language models (LLMs) that support OpenAI-compatible inference...

### 🐛 Describe the bug Error in console : `st.experimental_get_query_params` will be removed after 2024-04-11. Refer to our [docs page](https://docs.streamlit.io/library/api-reference/utilities/st.query_params) for more information. 2024-04-08 08:01:31.859 Please replace `st.experimental_set_query_params` with `st.query_params`....

### 🐛 Describe the bug PS C:\LocalDevPipeline> git clone https://github.com/hegelai/prompttools.git Cloning into 'prompttools'... remote: Enumerating objects: 5354, done. remote: Counting objects: 100% (2148/2148), done. remote: Compressing objects: 100% (628/628), done....

### 🐛 Describe the bug In # OpenAI Chat Experiment Example I've had to change the requirements install script to the below and the below version is working. Will contribute...

### 🚀 The feature I would love to have an interface to MS SK. https://github.com/microsoft/semantic-kernel ### Motivation, pitch SK supports a vast set of possibilities to solve a problem. When...

This is current progress of ollama integration #39 into prompttools added files - prompttools/prompttools/experiment/experiments/ollama/ - Dockerfile: build image for ollama server to use locally(tested) - ollama_api.py: handle the api calls...

Hey, I am working on issue #69 and I have generated 2 sample scripts - one involving prompt substitution and the other for auto evaluation. I am using Promptbench in...