[ MLflow Roadmap ] Official MLflow docker image support - slim & full version

[serena-ruan]

Summary

Original discussion: https://github.com/mlflow/mlflow/issues/9513

Based on this issue, we would like to introduce two docker images, one MLflow-slim version with no extra dependencies, and one MLflow version with DB related dependencies such as postgres or MySQL.

We should also update CI for pushing both images.

Notes

• Make sure to open a PR from a non-master branch.

• Sign off the commit using the -s flag when making a commit:

  git commit -s -m "..."
           # ^^ make sure to use this
  

• Include #{issue_number} (e.g. #123) in the PR description when opening a PR.

[rajveer43]

Can I work on this?

[serena-ruan]

@rajveer43 Sounds good! Thanks for volunteering :) Assigned to you!

[rajveer43]

thanks

[github-actions[bot]]

@mlflow/mlflow-team Please assign a maintainer and start triaging this issue.

[rajveer43]

some points to start! a bit idea would help!, @serena-ruan

[Deathfireofdoom]

If you feel the task is a bit to complex for you @rajveer43, then I am happy to take over!

[serena-ruan]

Hi @Deathfireofdoom Could you work with @rajveer43 on this together? Ideally we just want to docker images, the current one as the slim version, and another full version adding necessary dependencies for those databases, or if you think other dependencies are needed we're open to ideas :)

[Deathfireofdoom]

Hey I am up for that if @rajveer43 is, dont want to sweep in and steal the issue, if you feel you can do it by yourself feel free to go!

[rajveer43]

Sure @Deathfireofdoom we can work on it together

[Deathfireofdoom]

Great, we need to:

• Rename the current docker file to be the slim version
• Figure out what dependencies that would be useful for the non slim version
• Make the new dockerfile
• Update the pipelines

@rajveer43 Do you want to start with figure out the dependencies or the pipelines?

[rajveer43]

I will work on the pipelines

[Dewwi]

Any update on this?

[rajveer43]

have not got time here to work. will resume from this week

[ghadgeabhi]

Noticed there hasn't been much progress on this issue. Can I join your team and be able to contribute here?

[Deathfireofdoom]

@rajveer43 how is it going? Are the pipelines ready soon? Should we open a branch to merge our changes? Or maybe you can open a branch I will push my changes.

[Deathfireofdoom]

@serena-ruan could you assign this one to me instead? Seems @rajveer43 gone MIA.

I can make the pipelines plus a suggestion on dockerfiles.

[aishwaryaprabhat]

Heylo! How are we doing on this issue? I have not contributed to MLFlow before, so quite unfamiliar with the pipelines and process but very eager to lend a hand!

[StianHanssen]

Bumping this issue in hopes of getting it moving. I think there are a lot of people waiting for this change.

[JMLizano]

Hi, @Deathfireofdoom are you working on this? I have a POC for the Dockerfiles, if you have already some work done for the pipelines we can merge them together. Otherwise I am happy to also take that part.

[Deathfireofdoom]

@JMLizano go for it, dont think @rajveer43 will come back, he was suppose to do the pipelines!

[JMLizano]

@serena-ruan I opened a PR for this, it would be great if you can take a look when you have some time, thanks!

[wj-c]

any update?