FastChat
FastChat copied to clipboard
lm-sys
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Hi，I come from a LLM Lab.I am looking forward to the competitive level of our models on the list， I want to know everything about submitting models to the Arena...
我遇到一个偶现问题，在本项目长时间运行的时候不会有什么问题，大约运行了1-2个月没有暂停本项目。在这两个月的时间内，这个接口最大能承受100个并发，并且不会爆显存，但是在大约两个月之后突然发送一个请求返回“200OK“后出现了报错，这个报错之后必须强制关闭本项目并且重启才能得以解决！！ 我认为，应该不会出现这种需要人工强制关闭重启才能解决的问题，问题截图和相关报错在下面，欢迎解决和讨论！！   2025-02-19 17:25:31 | ERROR | stderr | ERROR: Traceback (most recent call last): 2025-02-19 17:25:31 | ERROR | stderr | File "/root/miniconda3/envs/fastchat/lib/python3.10/asyncio/runners.py", line 44, in run...
## Why are these changes needed? These changes enable users to upload PDF files as context for LLM queries. ## Changes made 1. Added PDF file handling capabilities: - Implemented...
> python3 -m fastchat.serve.cli --device mps --model-path lmsys/vicuna-7b-v1.5 The above command produces the following garbled text. What can I do? Thank you for any advcie. > USER: hello > ASSISTANT:...
## Why are these changes needed? Current version of gradio_web_server cannot be served. ## Related issue number (if applicable) ## Checks - [x] I've run `format.sh` to lint the changes...
Hello, would it be possible to add text attachments that attach: txt, csv, tsv, xml, html, css, js, py, c , cpp, etc. text based files by having it appended...
Hi, I want to run MT-Bench using the dataset 'ThaiLLM-Leaderboard/mt-bench-thai'. What modifications should I make to the code to ensure it works correctly?
Looks like there is no way to link to https://lmarena.ai leaderboard. Clicking tabs doesn't update the URL, and context menu has no option to copy link. 
Hey there, Thanks a lot for this super nice LLM benchmark! Looking at the new release of Grok3 being clearly the top-1 model, I wondered whether you could make some...
Can you add a filter to hide proprietary licensed model from tables?
