Inference in my own codes

[ChengsongLu]

Self Checks

• [X] I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find any relevant information that meets my needs. English 中文 日本語 Portuguese (Brazil)
• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell us your story.

How can I inference from python code? Is there any instruction about how to intergrate the codes into my own codes?

2. What is your suggested solution?

Please update another inference way besides CLI, http api and webui

3. Additional context or comments

No response

4. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.