FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Using vllm model as a judge

Open luciolcv opened this issue 10 months ago • 0 comments
trafficstars

Hi there,

I wonder if it is possible to use a local or open model as a judge instead of GPT-4, e.g., deploying it via vllm.

Best.

luciolcv avatar Jan 04 '25 12:01 luciolcv