xiaobochen

Results 2 comments of xiaobochen

Hi,@casper-hansen Q1:https://huggingface.co/deepseek-ai/deepseek-moe-16b-base Q2: How to test the perplexity?

> @liangzelang DP has already been merged(only for DeepSeek right now) #1970 and EP will be supported soon cc @ispobock @zhyncs Does MoE-EP have any support? I have implemented MoE-EP.