FastChat
FastChat copied to clipboard
lm-sys
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Seems like the num_gpus counts from 0. ``` CUDA_VISIBLE_DEVICES="3,4" python3 -m fastchat.serve.model_worker --model-path ../text-generation-webui/models/vicuna-13b/ --port 310001 --worker http://localhost:31001 --num-gpus 2 2023-06-16 10:07:22 | INFO | model_worker | args: Namespace(host='localhost', port=310001,...
 I just said hi. model is in multiple rounds of conversations with himself. Why? I hope model don't talk to myself
## Why are these changes needed? Update the documentation to include the training script to fine-tune using LoRA/QLoRA. If necessary, I could also add the reference `deepspeed_config.json`, but I didn't...
When trying to run arena battle, it errors. The traceback is below  ``` 2024-04-29 06:11:41 | ERROR | stderr | /workingdir/cen-ai-30032024/aistudent/miniforge3/envs/fastchat/lib/python3.11/site-packages/fastchat/serve/gradio_block_arena_anony.py:304: RuntimeWarning: invalid value encountered in divide 2024-04-29 06:11:41...
## Why are these changes needed? Error when selecting category then back to overall in leaderboard dropdown Added very subtle vote button, changed mirror phrase, swapped rows of plots, added...
Here are the steps I followed git clone https://github.com/lm-sys/FastChat.git cd FastChat/ brew install rust cmake pip3 install --upgrade pip pip3 install -e ".[model_worker,webui]" mkdir llm_models cd llm_models/ git clone https://huggingface.co/meta-llama/Llama-2-7b-chat-hf...
## Why are these changes needed? Side-by-side multimodal chatbot arena. Please comment any advice in terms of the UI or logic! This branch is a fork of the direct chat...
2024-04-29 00:55:07 | ERROR | stderr | ERROR: Exception in ASGI application 2024-04-29 00:55:07 | ERROR | stderr | Traceback (most recent call last): 2024-04-29 00:55:07 | ERROR | stderr...
It's not an urgent request, but can we remove those emoji from the leaderboard? It's distracting and I cannot really tell what that column is about by just looking at...
