Kevin Tran Vu Le

I'm also interested in this enhancement - it seems like we need to apply a session state to the gradio-web ui according to gradio documentation - discussion on multiple user...

Could we put a little more priority on this feature? CC @oobabooga

@InitialBug I'm still running into the same error listed above using `python translate.py -model=model_step_100000.pt -src=data/test.article.txt -template=data/test.template.rerank-5 -tgt=data/test.title.txt` any suggestions about what to do?

> @InitialBug I'm still running into the same error listed above using > `python translate.py -model=model_step_100000.pt -src=data/test.article.txt -template=data/test.template.rerank-5 -tgt=data/test.title.txt` any suggestions about what to do? Fixed it! Turns out the...

My question also^ - very much interested in trying to get LLMs like Llama to work on Triton CC @pommedeterresautee