spring-ai icon indicating copy to clipboard operation
spring-ai copied to clipboard

Select text-generation-inferenc support LLMs

Open kekeboomboom opened this issue 1 year ago • 0 comments
trafficstars

Now huggingface text-generation-inference only support Llama, Falcon, StarCoder, BLOOM, GPT-NeoX, and T5. If you select other LLMs, use HuggingfaceChatClient will get errors.

Yesterday, I use gpt2 model, and I use HuggingfaceChatClient get a lot of errors. So I think add a tip for novice will be friendly.

kekeboomboom avatar Apr 27 '24 06:04 kekeboomboom