MoE-Infinity
MoE-Infinity copied to clipboard
[Feature Request] The Compatibility with DeepSeek V3
Prerequisites
- [x] I have searched existing issues and reviewed documentation.
Problem Description
Does the current code framework support DeepSeek V3? I found DeepSeek V3 model files in the code, but I didn't find any explanation in the README document about whether DeepSeek V3 can run. Is this feature still under development?
Proposed Solution
Include some explanations about model compatibility.
Alternatives Considered
No response
Additional Context
No response
Importance
Nice to have
Usage Statistics (Optional)
No response
DeepSeek V3 support is current under way, due to lack of support of fp8 operations in pytorch, it may take sometime