MoE-Infinity icon indicating copy to clipboard operation
MoE-Infinity copied to clipboard

[Feature Request] The Compatibility with DeepSeek V3

Open BaideBear opened this issue 9 months ago • 1 comments

Prerequisites

  • [x] I have searched existing issues and reviewed documentation.

Problem Description

Does the current code framework support DeepSeek V3? I found DeepSeek V3 model files in the code, but I didn't find any explanation in the README document about whether DeepSeek V3 can run. Is this feature still under development?

Proposed Solution

Include some explanations about model compatibility.

Alternatives Considered

No response

Additional Context

No response

Importance

Nice to have

Usage Statistics (Optional)

No response

BaideBear avatar Mar 17 '25 12:03 BaideBear

DeepSeek V3 support is current under way, due to lack of support of fp8 operations in pytorch, it may take sometime

drunkcoding avatar Mar 18 '25 14:03 drunkcoding