Dev

[Bug] New Update breaks Inference for Balance Serve with Cache (gpu_only: false)

1

### Checklist - [ ] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest...

[Bug] Kimi K2 Thinking only produces coherent output on first query, on small context

2

### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. -...

DeepSeek 3.2 Models

3

### Reminder - [x] I have read the above rules and searched the existing issues. ### Description Would it be possible to upload the CPU/GPU weights of the new DeepSeek...