simple-llm-finetuner icon indicating copy to clipboard operation
simple-llm-finetuner copied to clipboard

Published 20 hours ago • verified publisher icon lxe

How can I use the finetuned model with text-generation-webui or KoboldAI?

Open Gitterman69 opened this issue 1 year ago • 4 comments

How can I utilize a fine-tuned model with text-generation-webui or KoboldAI for generating text? What are the necessary steps to ensure the successful integration of the model with these interfaces, and are there any specific requirements or dependencies I need to be aware of?

Gitterman69 avatar Mar 23 '23 08:03 Gitterman69

I think you'll need to convert it using https://github.com/tloen/alpaca-lora/blob/main/export_hf_checkpoint.py. Let me figure it out and I'll ad it to the readme.

lxe avatar Mar 25 '23 05:03 lxe

Thanks lad!

Sent from Proton Mail for iOS

On Sat, Mar 25, 2023 at 06:19, Aleksey Smolenchuk @.***> wrote:

I think you'll need to convert it using https://github.com/tloen/alpaca-lora/blob/main/export_hf_checkpoint.py. Let me figure it out and I'll ad it to the readme.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

Gitterman69 avatar Mar 25 '23 05:03 Gitterman69

I would also like to know this.

kotykd avatar Mar 25 '23 19:03 kotykd

Any updates?

Gitterman69 avatar Apr 07 '23 10:04 Gitterman69