torchchat
torchchat copied to clipboard
Weird model behaviour on Server/Browser: Looks like it's not using the template
Hi,
I'm trying out the torchchat right now, started the streamlit application with llama3 model
I just texted Hi !!
- Why is this text generation behaviour unusal , Is it the problem with model being converted to torchchat format ?
Hi @akhilreddy0703, thanks for testing out the repo Seems like a potential formatting/templating issue that gets surfaced in the UI
@vmpuri Can you take a look at this? I don't recall this happening via the CLI chat
I saw a similar response with torchchat sever as well, please check it once