FastChat
FastChat copied to clipboard
lm-sys
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
## Why are these changes needed? ## Related issue number (if applicable) ## Checks - [x] I've run `format.sh` to lint the changes in this PR. - [ ] I've...
This Prompt "$MODERATION$ YOUR INPUT VIOLATES OUR CONTENT MODERATION GUIDELINES." makes the AI think it's output violated content guidelines, when in reality the user's input violated the guidelines.
## Why are these changes needed? Add multi-image, interleaved chat functionality. ## Related issue number (if applicable) ## Checks - [ ] I've run `format.sh` to lint the changes in...
Right now, we don't store the text moderation and image moderation info when it can be very helpful.
I find [https://github.com/lm-sys/FastChat/pull/3423/commits/45cf5ccce897f5c86c812d3c729f2b9ac8e144b0](https://github.com/lm-sys/FastChat/pull/3423/commits/45cf5ccce897f5c86c812d3c729f2b9ac8e144b0) I tried it, but it still returned null.
avaliable fix to available ## Why are these changes needed? ## Related issue number (if applicable) ## Checks - [ ] I've run `format.sh` to lint the changes in this...
Error in sys.excepthook: ubuntu-xllm-stream-1-1 | Original exception was: ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | Traceback (most recent call last): ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr...
Hi, I meet an error: 2024-08-27 11:51:42 | ERROR | stderr | Expected `str` but got `bool` - serialized value may not be as expected It seems that is_blocking should...
I am using a server.controller to control 3 model_workers, which are placed on 3 GPUs, and then I opened 3 identical server.gradio_web_server and input the same question. The first time,...
curl -X POST "http://0.0.0.0:20000/v1/chat/completions" -H "Content-Type: application/json" -d "{\"model\": \"glm-4-9b-chat-1m\", \"messages\": [{\"role\": \"system\", \"content\": \"You are ChatGLM4, a large language model trained by Zhipu.AI. Follow the user's instructions carefully. Respond...
