PaddleNLP

PaddleNLP copied to clipboard

完成实测、提交测评，赢取奖金！——DeepSeek-R1-MTP 单机部署实战

1

🤗 非常开心的告诉大家，飞桨框架3.0推理部署能力已全面升级，我们依托本次升级发起了**💰有奖实测**活动，现已上线！快上车🔥 ## 🎯 实测题目：DeepSeek-R1-MTP 单机部署实战 **🧑‍💻 任务描述：** 基于飞桨框架完成DeepSeek-R1满血版单机部署实战并发布**测评博客💰**，并于**2025年4月07日12:00**前提交，即可获得**最高2000元的奖学金！ **💰 奖励规则：** 本次实测活动除了【DeepSeek-R1-MTP 单机部署实战】任务，还为大佬设置了更高奖金的【两机版推理部署】任务、为算力受限的用户们增设了【蒸馏版模型推理】任务作为体验题，**基于本地算力、云平台完成实测均可**！欢迎大家基于飞桨框架3.0体验！反馈！领奖金！ | 任务概括 | 💰奖学金 | 任务描述 | 参考代码 | | --- | --- | --- | ---...

Daeshiyao

【Inference Optimize】Paddle supports MOE model EP parallel

3

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

chang-wenbin

Integrate DeepGEMM into fused_moe op

3

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

Sunny-bot1

Add fused expert

2

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

phlrain

Mix

3

### PR types Others ### PR changes Others ### Description Others

AnnaTrainingG

Optimize expert performance

2

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

phlrain

force select self node

2

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

phlrain

update doc

2

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

bukejiyu

[LLM INFER] refactor return_full_hidden_states

2

#### Before submitting - [ ] Lint code. If there are lint issues, please format the code first. ```shell # Install and register `pre-commit` in the project folder pip install...

yuanlehome

LoriKiT

5

### PR types New features ### PR changes add LinChain at peft/lora ### Description add LinChain method. (https://arxiv.org/abs/2411.00039)

Liebele