prompttools
prompttools copied to clipboard
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
Adding Llama 3 8b Instruct Model variant to promptToolExperiment
### 🐛 Describe the bug On running the playground command, I see below deprecation warnings Please replace st.experimental_get_query_params with st.query_params. st.experimental_get_query_params will be removed after 2024-04-11. Refer to our [docs...
### 📚 The doc issue The docs steps are not working when I run playground streamlit command. Streamlit dependency is missing in requirements.txt ### Suggest a potential fix Include prompttools...
I have introduced a new class called OpenAICompatibleChatExperiment. This class aims to enhance the compatibility of prompttools with a wider range of large language models (LLMs) that support OpenAI-compatible inference...
### 🐛 Describe the bug Error in console : `st.experimental_get_query_params` will be removed after 2024-04-11. Refer to our [docs page](https://docs.streamlit.io/library/api-reference/utilities/st.query_params) for more information. 2024-04-08 08:01:31.859 Please replace `st.experimental_set_query_params` with `st.query_params`....
### 🐛 Describe the bug PS C:\LocalDevPipeline> git clone https://github.com/hegelai/prompttools.git Cloning into 'prompttools'... remote: Enumerating objects: 5354, done. remote: Counting objects: 100% (2148/2148), done. remote: Compressing objects: 100% (628/628), done....
### 🐛 Describe the bug In # OpenAI Chat Experiment Example I've had to change the requirements install script to the below and the below version is working. Will contribute...
### 🚀 The feature I would love to have an interface to MS SK. https://github.com/microsoft/semantic-kernel ### Motivation, pitch SK supports a vast set of possibilities to solve a problem. When...
This is current progress of ollama integration #39 into prompttools added files - prompttools/prompttools/experiment/experiments/ollama/ - Dockerfile: build image for ollama server to use locally(tested) - ollama_api.py: handle the api calls...
Hey, I am working on issue #69 and I have generated 2 sample scripts - one involving prompt substitution and the other for auto evaluation. I am using Promptbench in...