FastChat
FastChat copied to clipboard
lm-sys
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Identify the records in `chatbox` and the records in `prompt` by adding flag `is_prompt` in messages. The default value of `is_prompt` is `True`. Set the flag of the last pair...
Running inference using vicuna 7B on a 16Gb 3080. Occasionally the script crashes with an error like: RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 16.00...
I made a video with working gradio script for dolly v2 but it took a lot of time for me to prepare it if you release a gradio script I...
I am excited to contribute to the FastChat project by adding support for the OpenBuddy model. OpenBuddy is a multilingual AI language model based on the LLAMA architecture, and it...
Hi! As the developer of the OpenBuddy model (https://github.com/OpenBuddy/OpenBuddy) , I would like to request permission to participate in the LM-Sys AI Conversation Model Arena. OpenBuddy is a multilingual AI...
I've been using the ChatML-style to allow for more customization of the role field on my own experiments and thought I'd share. Inspired by https://github.com/openai/openai-python/blob/main/chatml.md
Add preprocess exception handling for 3 type of errors: - size of source is 0 - `chatgpt` or `bing` is not in roles. - The order of `human` and `assistant`...
Fix generate_webpage_data_from_table.py (by just fixing paths), and change the results files to follow a standard format.
… fixed length and provides a method called contains_stop_sequence to check if the queue contains the given stop sequence. The clear_torch_cache function is designed to clear GPU memory cache used...
