llama-recipes icon indicating copy to clipboard operation
llama-recipes copied to clipboard

How to test my finetuned model

Open Tizzzzy opened this issue 9 months ago • 4 comments

🚀 The feature, motivation and pitch

I am new to llama-recipes. Right now I have finetuned a llama3 model based on "openbookqa" dataset. It store a model for me in this path: /research/cbim/medical/lh599/research/ruijiang/Dong/llama-recipes/PATH/to/save/PEFT/model. In this model folder, there are three files: adapter_config.json, adapter_model.safetensors, README.md.

My question is how can I test this fine tuned model. For example, I can pass a question like: "The sun is responsible for?". And my model will give me an answer.

Alternatives

No response

Additional context

No response

Tizzzzy avatar May 21 '24 21:05 Tizzzzy