[New feature] Add inference load balance controller for fastdeploy llm

[rainyfly]

PR types(PR类型)

LLM

Description

1. Add inference load balance controller for fastdeploy llm

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}