q yao

[Refactor] Support custom codebase and task

5

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily receiving feedbacks. If you do not understand...

[Refactor] Refactor backend API

1

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily receiving feedbacks. If you do not understand...

backends/moe.py and nn/moe.py has been refactored. Reuse token dispatcher in DLBlas

Support Deepseek v32

5

requirements: https://github.com/Dao-AILab/fast-hadamard-transform# latest FlashMLA Note: My bitonic topk kernel would failed on triton