Dilara Soylu

icon location Exploring, living and always learning - nowadays phding @stanford.

Results 1 comments of Dilara Soylu

Llama-3 support

I have also been testing TGI versions >= 2.0.2 with `meta-llama/Meta-Llama-.13-8B-Instruct` from HuggingFace's model hub and running into similar issues. In particular, `stop=["\n\n"]` seems to work fine, but `stop=["---"]` doesn't....