Yixiao Chen issues

Repositories
Issues
Comments

Results 2 issues of


                                            Yixiao Chen

[Bug] 开启prefix cache后，有时对于同prompt推理的结果不一样

### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. -...

[Bug] ModelInputs.split()中对max_kv_seqlen和sum_kv_seqlen的计算可能存在问题

### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. -...