opencompass
opencompass copied to clipboard
[Feature] Support evaluation with vllm/lmdeploy openai-compatible api via CLI
Describe the feature
Support use the following pattern:
OPENAI_API_KEY=xxxx BASE_URL=xxx opencompass xxxxxxxxx
Will you implement it?
- [ ] I would like to implement this feature and create a PR!