WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

Load the model using the transformer and pytorch api

Open ziqizhang opened this issue 2 years ago • 0 comments

Sorry if this question has been asked and answered but I cannot find anything related to it.

Is there a way to download and use the model through the transformer and pytorch API, just like dolly or vicuna, explained on their model card page like below: https://huggingface.co/databricks/dolly-v2-3b https://huggingface.co/CarperAI/stable-vicuna-13b-delta

The WizardLM model card on huggingface (https://huggingface.co/TheBloke/wizardLM-7B-GPTQ) only shows how to configure it for text-generate-webui.

Can anyone shed some light on this please?

ziqizhang avatar May 11 '23 13:05 ziqizhang