litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

Add chat mode for finetuned models using Adapter.

Open shuwang127 opened this issue 2 years ago • 1 comments

To chat with the finetuned model interactively using: python chat/adapter.py The default parameters: - model path: out/adapter/alpaca/lit_model_adapter_finetuned.pth - model type: stabilityai/stablelm-base-alpha-3b - finetune data: alpaca - finetune tech: Adapter Test success on NVIDIA DGX-A100.

shuwang127 avatar Jun 23 '23 16:06 shuwang127

This is a separate script added to the ./chat/ folder, won't affect the other script logic.

shuwang127 avatar Jun 23 '23 18:06 shuwang127