WizardLM
WizardLM copied to clipboard
Load the model using the transformer and pytorch api
Sorry if this question has been asked and answered but I cannot find anything related to it.
Is there a way to download and use the model through the transformer and pytorch API, just like dolly or vicuna, explained on their model card page like below: https://huggingface.co/databricks/dolly-v2-3b https://huggingface.co/CarperAI/stable-vicuna-13b-delta
The WizardLM model card on huggingface (https://huggingface.co/TheBloke/wizardLM-7B-GPTQ) only shows how to configure it for text-generate-webui.
Can anyone shed some light on this please?