How add an API if the model is already downloaded separately via text-generation-webui

[vishagar81]

Hello, Thanks for sharing your samples for the vsc extension and API. I have already downloaded the 'TheBloke_WizardCoder-15B-1.0-GPTQ' model via text-generation-webui. Would it possible to reference that model via the API? If you could help me in this regard then that would be deeply appreciated.

[mzbac]

It used to be compatible with the text generation web UI. If there are any changes in the web UI, you may have to fork the VSC extension repository and make the change there to make it compatible with the web UI API. https://github.com/mzbac/wizardCoder-vsc/blob/main/src/WizardCoderInlineCompletionItemProvider.ts#L53-L57 https://github.com/mzbac/wizardCoder-vsc/blob/main/src/chatWithWizardCoder.ts#L50-L59

[vishagar81]

Thank you so much for your response.