NanoLLM icon indicating copy to clipboard operation
NanoLLM copied to clipboard

Meta-Llama-3-8B-Instruct always reply: You are a helpful and friendly AI assistant.<|eot_id|>

Open UserName-wang opened this issue 8 months ago • 6 comments

Dear @dusty-nv ,

I'm trying the example code on web page: Function Calling.

I tried both Llama-2-7b-chat-hf and Meta-Llama-3-8B-Instruct. Seems Llama-2-7b-chat-hf is more reliable than Meta-Llama-3-8B-Instruct. Here are the replies when I'm using Meta-Llama-3-8B-Instruct:

hello You are a helpful and friendly AI assistant.<|eot_id|>

what is time current time? You are a helpful and friendly AI assistant<|eot_id|>

what's the current date? You are a helpful and friendly AI assistant<|eot_id|>

But even Llama-2-7b-chat-hf cannot invoke the giving bot_function each time. when I'm using Llama-2-7b-chat-hf, I have to specify the function name in prompt to increase the possibility to invoke the bot_function.

And how to pass arguments to the bot_function in a better and reliable way? thank you!

UserName-wang avatar Jun 08 '24 01:06 UserName-wang