hipudding
hipudding
已经在容器内尝试访问 cn-beijing-data.aliyundrive.net，网络通
> The issue is likely in the `ggml_backend_cann_supports_buft`. It should only return true when the ggml_backend device and the buffer type device match, otherwise the scheduler will just assign everything...
Thanks for this bug report.
@loadams Sorry for late reply, This is something wrong in torch_npu, and I think it's not relate to DeepSpeed. We will look into it. Please keep this issue as closed,...
@lq0104 I think some function defination is not same between different SOCs. Someone also met this when using 910A. But you can find some function to replace DataCopyPad.
We have not tested it before. Will test it now.
Hi @ggerganov. We'd like to add releases for Ascend NPU, Can you please review this PR? Thanks.
Please rebase to pass the CI.
It seems that resources for amd-rocm and amd-vulkan are tight. Considering that this is a release package for adding the CANN backend, it is therefore unrelated to those two use...
@noemotiovon @ggerganov Not any. I don't think CANN backend use this parameter.