ML Lineage UI for TFX

[theadactyl]

While all the data exists in MLMD, we currently have to rely on orchestrator to represent the executions and other metadata in a nice and organized UI. This would bring a frontend and backend to generate Web UIs from TFX metadata.

cc @casassg

[peteboothroyd]

Would love to see this too. In case you haven't come across it there is prior art within the tfx repo, and a frontend built into the kubeflow project

Edit: I guess you have seen the kubeflow UI... Anyway might be useful for anybody else who ends up here

[rcrowe-google]

• Similar to KF, Airflow lineage UI but with better support for artifact exploration
• Twitter has an implementation using React, has been useful
• What do people want to see in it? What functionality?
• KF tool has been useful for showing managers the use of lineage
• Should follow the library development

[htahir1]

We have a new implementation of a lineage explorer over at ZenML https://github.com/zenml-io/zenml/tree/main/examples/lineage. Would the community be interested in addition this as part of tfx-addons?

[casassg]

@htahir1 that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D

Curious on what you think this could be implemented like?

[rcrowe-google]

Coming back to this, I think it would be a nice addition! One question - I don't see an example of how lineage is displayed for components which produce multiple artifacts. Is there any issue with that?

Robert Crowe | TensorFlow Developer Engineer | @.*** | @robert_crowe https://twitter.com/robert_crowe

On Wed, Dec 8, 2021 at 4:27 PM Gerard Casas Saez @.***> wrote:

@htahir1 https://github.com/htahir1 that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D

Curious on what you think this could be implemented like?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/tensorflow/tfx-addons/issues/14#issuecomment-989337276, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKVWSW43QU333UOMQBR6GH3UP7ZVRANCNFSM42K2S2DQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.