spring-ai
spring-ai copied to clipboard
Select text-generation-inferenc support LLMs
trafficstars
Now huggingface text-generation-inference only support Llama, Falcon, StarCoder, BLOOM, GPT-NeoX, and T5. If you select other LLMs, use HuggingfaceChatClient will get errors.
Yesterday, I use gpt2 model, and I use HuggingfaceChatClient get a lot of errors. So I think add a tip for novice will be friendly.