tfx-addons
tfx-addons copied to clipboard
TFX MLMD Client library
Currently it's hard to query MLMD as it requires a lot of information on how TFX structures data internally in MLMD. There's several examples (including Airflow TFX example or Model Cards) that have repetitive functions just because they are not included in the core library. We can simplify MLMD querying by providing some of those functions ourselves.
cc @casassg
Some small previous example from Twitter: https://github.com/tensorflow/tfx/pull/2415
Can be used as a starting point for MLMD client library: https://github.com/google/nitroml/tree/master/nitroml/analytics
- Currently similar code in Model Cards
- Also related to lineage UI project
- Also similar to https://github.com/google/nitroml/tree/master/nitroml/analytics
- Project volunteers
- Gerard Casas Saez, Paul Selden, Suzen Fylke, (TFX team member TBD)
- Project proposal to be written
- Easily query lineage, what features generated what model.
Another similar example: https://github.com/zenml-io/zenml/blob/main/src/zenml/repository.py