wuyaoxuehun

How can I get the database for Chinese legal provisions?

As stated in your paper, "Results for COMMONGEN are on the test set and others are on the official development set. We tune the hyperparameters based on the models’ performance...

Qwen1.5-110B-Chat的中文能力是否评测过，如cmmlu，ceval等

2

根据https://qwenlm.github.io/blog/qwen1.5-110b 可以看出英文能力确实可以和llama3媲美，请问是否评测过Qwen1.5-110B-Chat的中文能力，如cmmlu，ceval等

[Feature]: Deepseek R1 GGUF 4bit(Q4KM) support

2

### 🚀 The feature, motivation and pitch Now I run vllm on deepseek R1 GGUF 4bit(Q4KM), but it shows not supported. Can you support this? ### Alternatives _No response_ ###...

Eval bug: GGML_SCHED_MAX_BACKENDS assert error

2

### Name and Version latest version ### Operating systems Linux ### GGML backends CUDA ### Hardware A800-40G ### Models R1 Q4km ### Problem description & steps to reproduce GGML_SCHED_MAX_BACKENDS asser...

[Feature] GGUF Q4KM(4bit) format for deepseek R1 support

1

### Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. - [x]...