torchchat icon indicating copy to clipboard operation
torchchat copied to clipboard

Weird model behaviour on Server/Browser: Looks like it's not using the template

Open akhilreddy0703 opened this issue 1 year ago • 2 comments

Hi,

I'm trying out the torchchat right now, started the streamlit application with llama3 model image

I just texted Hi !!

  • Why is this text generation behaviour unusal , Is it the problem with model being converted to torchchat format ?

image

akhilreddy0703 avatar Aug 01 '24 05:08 akhilreddy0703

Hi @akhilreddy0703, thanks for testing out the repo Seems like a potential formatting/templating issue that gets surfaced in the UI

@vmpuri Can you take a look at this? I don't recall this happening via the CLI chat

Jack-Khuu avatar Aug 01 '24 06:08 Jack-Khuu

I saw a similar response with torchchat sever as well, please check it once

akhilreddy0703 avatar Aug 01 '24 09:08 akhilreddy0703