Do online inference using the models saved in MLFlow registry.

[s0nicboOm]

Summary

What change needs making?

Use Cases

When would you use this?

---

Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.