Video-LLaMA icon indicating copy to clipboard operation
Video-LLaMA copied to clipboard

Published 20 hours ago • verified publisher icon DAMO-NLP-SG

CPU support

Open esteininger opened this issue 2 years ago • 1 comments
trafficstars

swapped out CUDA params for CPU support

esteininger avatar Aug 24 '23 21:08 esteininger

Hi @esteininger, I am new to this repo, so maybe this is a naive question, does it work with CPU? I mean, with this patch, is it able to generate a response in a reasonable time? And does it work for both training and inferencing?

BTW, I don't think the owner of this repo would accept this kind of functionality change. If it works with CPU, maybe making the behaviour controlled by an optional parameter specified somewhere (command line, or environment variable, or configuraiton file) is a better approach. Just my two cents.

james-hu avatar Jan 13 '24 04:01 james-hu