Jimmy Tsai

I used to have this issue in 26.1.0, I just upgrade to 28.1.0 and now it is resolved.

Just test llama3-8b in the 2.0.2, looks like this issues has been fixed. https://github.com/huggingface/text-generation-inference/pull/1808