FlexGen icon indicating copy to clipboard operation
FlexGen copied to clipboard

Allow FlexGen to use locally downloaded models

Open Vinkle-hzt opened this issue 2 years ago • 0 comments

Support local models by using argument --local, like:

python3 -m flexgen.flex_opt --model /home/username/model/facebook/opt-1.3b --local

It will load the locally downloaded opt-1.3b model instead of the opt-1.3b from huggingface.

Vinkle-hzt avatar Apr 24 '23 05:04 Vinkle-hzt