FlexGen
FlexGen copied to clipboard
Allow FlexGen to use locally downloaded models
Support local models by using argument --local, like:
python3 -m flexgen.flex_opt --model /home/username/model/facebook/opt-1.3b --local
It will load the locally downloaded opt-1.3b model instead of the opt-1.3b from huggingface.