xunyoyo
xunyoyo
### 请确保您已阅读以上注意事项，并勾选下方的确认框。 - [X] 我确定这是一个从未被提出和实现过的功能。 - [X] 我已经在 [Issue Tracker](https://github.com/moesnow/March7thAssistant/issues) 以及 [Pull Request](https://github.com/moesnow/March7thAssistant/pulls) 中找过我要提出的功能，没有找到相同功能的 Issue 和 PR。 - [X] 我已知晓并同意，此处仅用于建议新功能。若这个 Issue 是关于其他非主题的问题，则我的 Issue 可能会被无条件自动关闭/锁定。 - [X] 我已知晓并同意，如果我不按照模板提供的指示进行填写，则我的 Issue 可能会被无条件删除。 ###...
26行的二级标题没有正常显示
## Motivation NO.36 功能模块 fastdeploy/cache_manager/prefix_cache_manager.py 单测补充 ## Modifications new tests/cache_manager/prefix_cache_manager.py ## Usage or Command `tests/cache_manager/prefix_cache_manager.py`: ```bash python -m coverage run -m unittest tests.cache_manager.test_prefix_cache_manager \ && python -m coverage report -m...
This commit adds unit tests for the sampler helpers, covering guided decoding and speculative flows. It includes various test cases to ensure the correct functionality of the sampling methods and...
This file contains tests for the global scheduler, including request handling, load accounting, and response management. ## Motivation NO.38 功能模块 fastdeploy/scheduler/global_scheduler.py 单测补充 ## Modifications new dir and add tests/scheduler/test_global_scheduler.py ##...
Add unit tests for Triton fused MoE backends with stubs for GPU/operator functionality. ## Motivation NO.21 功能模块 fastdeploy/model_executor/layers/moe/fused_moe_triton_backend.py 单测补充 ## Modifications add tests/model_executor/test_fused_moe_triton_backend.py ## Usage or Command `tests/model_executor/test_fused_moe_triton_backend.py`: ```bash python...
## Motivation NO.37 功能模块 fastdeploy/output/token_processor.py 单测补充 ## Modifications add tests/output/test_token_processor.py ## Usage or Command `tests/output/test_token_processor.py`: ```bash python -m coverage run -m unittest tests.output.test_token_processor \ && python -m coverage report -m...