Donghai Hong
Results
1
comments of
Donghai Hong
Thank you for your question! This is a known issue. Since the current architecture implements the `BaseInference` class based on deepspeed and vllm in the same Python file, importing deepspeed-related...