Video-ChatGPT icon indicating copy to clipboard operation
Video-ChatGPT copied to clipboard

why i use A100 80G to inference so slow?

Open Arbor334 opened this issue 6 months ago • 0 comments

I downloaded all the files and data locally, but the graphics card memory did not increase when loaded, and the reasoning was very slow, especially when loading initialize_model functions, and now I don't have a complete single_video_inference.py file

Arbor334 avatar Aug 03 '24 00:08 Arbor334