Michael Collado
Michael Collado
Something like: ``` analyze risk ➡️ 💾 ⬆ Ingest -> 💾 ⬅ ⬅ ⬅ ⬇ ⬆ crop/clean ➡ ⬆
I think we can leverage the work in https://github.com/MarquezProject/marquez/issues/1928 for this
What's the reasoning behind steps 2 and 3? I can see the usefulness of the `external_version` column to note specifically that the dataset version is assigned by some other system....
Sorry for the radio silence here, Ryan. Please open a PR with the proposal and we can approve it.
> The advantages of using a dot (.) to maintain the STRUCT hierarchy are: > > No changes to the dataset_fields table > Each sub field in the STRUCT are...
> * One can still parse those types without having to push that complexity to each integration. Sorry, my read on Willy's proposal is to push the Struct parsing to...