CogVideo icon indicating copy to clipboard operation
CogVideo copied to clipboard

Published 20 hours ago • verified publisher icon THUDM

[FeatureRequest] Support MLX backend

Open mzbac opened this issue 1 year ago • 3 comments

Given the advantage of VRAM in Apple silicon, please add backend support for MLX so we can run this efficiently on Apple silicon.

mzbac avatar Aug 12 '24 03:08 mzbac

@zRzRzRzRzRzRzR Does "self-assigned" mean this is going to happen :), we are going to have MLX support for CogVideo 🚀

mzbac avatar Aug 16 '24 08:08 mzbac

I’m currently conducting research and scheduling, and I will look into potential deployment options next week. At present, this model does not support int4, which could be a significant issue.

zRzRzRzRzRzRzR avatar Aug 17 '24 03:08 zRzRzRzRzRzRzR

Hi! Any progress now? Thanks!

ZhihaoAIRobotic avatar Feb 02 '25 12:02 ZhihaoAIRobotic