llama icon indicating copy to clipboard operation
llama copied to clipboard

How to infer answer using llama2-7b-hf?

Open Jerry-hyl opened this issue 8 months ago • 0 comments

I want to test the ability of llama2-7b-hf instead of llama2-7b-chat. But llama2-7b-hf is a base model not having a chat template, so how can I use llama2-7b-hf and transformers library to answer questions?.Could you give me a demo?

Jerry-hyl avatar Jun 14 '24 08:06 Jerry-hyl