ADD a large model SSE stream api

[ming-shy]

…ng interface

What this PR does / why we need it:

Due to business needs, I added a large model SSE streaming interface to the seldon-core microservice component. But instead of modifying the seldon-core-excutor layer code, I added an istio vs when deploying the model to directly correlate with the new interface for the seldon-core microservice. We hope to get help from developers and contribute to the seldon-core project.

Which issue(s) this PR fixes:

No

Fixes #

Special notes for your reviewer:

The new code is annotated, focusing on wrapper.py in the seldon-core microservice, and several associated files.

[seldondev]

Hi @ming-shy. Thanks for your PR.

I'm waiting for a SeldonIO or todo member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

---

jiangmingcai25104 seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}