Aaron Pham

We had spark mllib support prior to 1.0, and currently we have redesigned the infrastructure for BentoML, and Spark MLlib support has not yet been migrated.

so this `make_predict_dataloader` function return a list of data? have you try to just pass the `dataloader` in and let `run_batch` handles inference that way?

Can you guys try with the latest changes on the main branch?

Thank you so much for the detailed profiling @udevnl. We are actively working to address this problem. Would still love to hear more about the experiments 🎉

Hi @jung235 can you fix the failing CI?

I will probably close this for now due to inactivity. If one requests for such feature in 1.0 we can add it.

Hi @harshitsinghai77, I believe this is P1, and will be addressed after BentoML 1.0

Working in progress, per current MLH batch. Current progress can be tracked here at https://github.com/bentoml/BentoML/tree/grpc branch and this PR https://github.com/bentoml/BentoML/pull/2808

Hi all, I'm happy to say that gRPC support has been merged into `main` via PR #2808. We will include this in the next release as an experimental feature.

@bojiang can you fetch main and run the test again?