website icon indicating copy to clipboard operation
website copied to clipboard

add Model Registry doc to website

Open tarilabs opened this issue 1 year ago • 11 comments

Opening this PR for early feedback.

As feedback received by Release Team during KF community meetings and Model Registry meetings, As identified in the Model Registry KF 1.9 tracker issue on request by Release Team,

➡️ Documentation is needed for Model Registry alpha on the KF website, as part of the KF 1.9 deliverables by Model Registry wg.

This PR focus on the following received requests:

  • [x] The documentation is to highlight how to onboard users.
  • [x] A component is added to KF website sidebar.
  • [x] Use Alpha version marker.
  • [x] The doc highlight how to install, use Python client, examples of integrations with other components (notebooks) and add-ons (inference).

This documentations is loosely based on the content presented with this demo.

tarilabs avatar Mar 14 '24 16:03 tarilabs

@tarilabs thanks a lot for getting this started! I went through though the current version, I think it's a good first version.

First of all a comment on timeline: we do not have to rush this in time for feature freeze. We have a couple more weeks to finetune and improve the docs. So let's keep this PR running until we have a good version.

Then, I'll refrain from commenting specific sections and instead provide some higher level feedback:

  • Overview: We can write more about how a model registry fits within the e2e ecosystem. Good reference point is the AIIA Canonical Stack of Machine learning or Google’s MLOps maturity levels that shows how a model registry is necessary to achieve level 2 maturity. These may be things we want to discuss in an introduction here OR in a blog post. Up to you. But I do believe it’s important to provide some context on why this is needed and how the ecosystem benefits
    We should also document a list of use cases and jobs that the model registry solves within the Kubeflow ecosystem. Why do I, as a Kubeflow user, care about the model registry? How does the model registry help me solve my day to day tasks faster, better, more efficiently? What problems does the model registry solve that I wouldn’t otherwise be able to solve?

  • Getting Started: I would split up the getting started into two guides:

    1. Installation / pre-requisites → this is particularly important while this is in alpha and not included into Kubeflow core
    2. Actual "getting started" guide with a practical step-by-step tutorial (assuming one has already installed it)

    This is important because installation is a one off thing (done by the Kubeflow admin) whereas the getting started guide targets ML practitioners who just use the platform

  • I'd also love to see an architecture diagram under a "reference" section.

  • Additionally, we can plan for a separate page to discuss specific integrations and integration plans with other Kubeflow components and third-party software (can go under "reference")

I know it's a lot. Great documentation takes a lot of time and effort. Let's try and do these things incrementally.

I hope that @diegolovison and @hbelmiro can also help out a little bit here. Looking forward to hearing your thoughts!

StefanoFioravanzo avatar Apr 10 '24 15:04 StefanoFioravanzo

First of all a comment on timeline: we do not have to rush this in time for feature freeze. We have a couple more weeks to finetune and improve the docs. So let's keep this PR running until we have a good version.

ack, and agreed

  • We should also document a list of use cases and jobs that the model registry solves within the Kubeflow ecosystem

yes, this was discussed in the KF community-calls, in the KF MR bi-weekly Josh already suggested the same, we're iterating on a google doc already which will be "poured" in content into this PR as soon as the copy is ready

  • Getting Started: I would split up the getting started into two guides

~~noted, will do~~ 👉 done with 2f567ae

  • I'd also love to see an architecture diagram under a "reference" section.

~~noted, will do~~ 👉 done with 3bbf750

Thanks for the feedback @StefanoFioravanzo ! 📥 ✍️

tarilabs avatar Apr 10 '24 15:04 tarilabs

@tarilabs This is what I was talking about on Monday:

G2CM_FI427_Learn_Article_ Machine_learning_operationalization _Infographic_image1b_V1 2

I took a random picture from the web and added labels by hand. But you get the idea. It would be nice if the MLOps loop that we present in the overview showed how the model registry contributes to the various MLOps stages. Especially when paired with the descriptions you added here https://github.com/kubeflow/website/pull/3698/commits/be3ebf8be6d62ed3e5b5871784c753e5cac96cfd

We could add a small icon that represents the MR presence within the stages with the label, to highlight that MR has a contribution in that stage (what I did in green)

StefanoFioravanzo avatar Apr 18 '24 08:04 StefanoFioravanzo

We could add a small icon that represents the MR presence within the stages with the label, to highlight that MR has a contribution in that stage (what I did in green)

nice suggestion, thanks! Implemented on top of current diagram with: fca21205f6a58448839386dd7c0598a8fe722bec

tarilabs avatar Apr 21 '24 19:04 tarilabs

nice suggestion, thanks! Implemented on top of current diagram with: https://github.com/kubeflow/website/commit/fca21205f6a58448839386dd7c0598a8fe722bec

@tarilabs but what do you think about my proposal of moving the MR labeling to each individual section, removing it from the middle? Just want to understand if you like the idea and the mock I sent above. If you do, we can work together on an editable space.

StefanoFioravanzo avatar Apr 22 '24 13:04 StefanoFioravanzo

what do you think about my proposal of moving the MR labeling to each individual section, removing it from the middle? Just want to understand if you like the idea and the mock I sent above. If you do, we can work together on an editable space.

Removing a "single instance" of a Model Registry "box" and make a cloned "smaller boxes" repeated on the loop can arguably give the false impression there is no "single pane of glass". That is why I incorporated as much as possible from your original comment: https://github.com/kubeflow/website/pull/3698#issuecomment-2063330587 and adapted on top of existing work.

I'm not against iterating again on the diagram, but I would prefer moving forward with a "best candidate" (which imho is present now on this PR) and eventually iterate on it as a separate, focused PR: wdyt?

tarilabs avatar Apr 22 '24 15:04 tarilabs

can arguably give the false impression there is no "single pane of glass".

I don't agree with this but let's not block on it now. Let's iterate on this after this PR!

StefanoFioravanzo avatar Apr 23 '24 08:04 StefanoFioravanzo

Hey @tarilabs ! Is there something left before we can merge this one?

StefanoFioravanzo avatar May 02 '24 13:05 StefanoFioravanzo

Hey @tarilabs ! Is there something left before we can merge this one?

@StefanoFioravanzo to me this can be merged as this thread shows most of the feedback was incorporated, either as-is, either as incorporation into previous work done as part of this PR. From my pov this PR can be merged following https://github.com/kubeflow/website/pull/3698#issuecomment-2071694592 And further iteration on diagrams, tutorial, etc could be done in later, separate and potentially in-parallels PR :)

tarilabs avatar May 02 '24 16:05 tarilabs

Then let's go! 🚀 @andreyvelich can you approve?

StefanoFioravanzo avatar May 03 '24 06:05 StefanoFioravanzo

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

StefanoFioravanzo avatar May 20 '24 17:05 StefanoFioravanzo

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

yep thanks again for the feedback @andreyvelich , I addressed most of them, about the remaining kindly let me know if, as discussed previously in this thread, do you require them as part of this PR or could be follow-ed up in subsequent PRs (so as also to "parallelize" changes). Thank you!

tarilabs avatar May 20 '24 21:05 tarilabs

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

yep thanks again for the feedback @andreyvelich , I addressed most of them, about the remaining kindly let me know if, as discussed previously in this thread, do you require them as part of this PR or could be follow-ed up in subsequent PRs (so as also to "parallelize" changes). Thank you!

Sure, we can incorporate them in a following PR. Do you want to address this change in the next PR: https://github.com/kubeflow/website/pull/3698#discussion_r1607313025 ?

andreyvelich avatar May 20 '24 21:05 andreyvelich

Sure, we can incorporate them in a following PR. Do you want to address this change in the next PR: #3698 (comment) ?

unless anyone has any "blocker" or "veto" comments, since this PR has been open for a long time (March) and incorporated as many comments as possible in the time being (see thread), I'd be happy to have it merged, and parallelize any further comments/amendments in separate PRs (multiple).

Kindly let me know your guidance here, and once again thanks for all who contributed reviews!!

tarilabs avatar May 21 '24 11:05 tarilabs

Absolutely, thanks again for your hard work @tarilabs! /lgtm /assign @jbottum for the approval

andreyvelich avatar May 21 '24 12:05 andreyvelich

@andreyvelich: GitHub didn't allow me to assign the following users: for, the, approval.

Note that only kubeflow members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. For more information please see the contributor guide

In response to this:

Absolutely, thanks again for your hard work @tarilabs! /lgtm /assign @jbottum for the approval

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

google-oss-prow[bot] avatar May 21 '24 12:05 google-oss-prow[bot]

/lgtm

jbottum avatar May 21 '24 22:05 jbottum

/approve

jbottum avatar May 21 '24 22:05 jbottum

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jbottum

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

google-oss-prow[bot] avatar May 21 '24 22:05 google-oss-prow[bot]