Michael Collado

Results 26 comments of Michael Collado

While Marquez _will_ support an event of type `RUNNING`, when considering this in the context of a streaming job, we may need to consider the impact of this event on...

Some use cases to consider in this one include * Catalogs that point to external datasets * Hive tables that point to, e.g., S3 files * Spark catalog tables that...

Related: https://github.com/MarquezProject/marquez/issues/1977

I spent a bit of time trying to diagnose why Sentry traces don't work in the OpenLineage API. Seems Sentry uses a threadlocal stack to manage Spans. Even though we...

To get the graphs in the last example, I used this code ```java private static class SentryScope { private final String operation; private final SentryTraceHeader traceContext; private ITransaction transaction; SentryScope(String...

Marquez has a mix of layers- a `Resource` layer, for the dropwizard request handling, a `Service` layer, which is inconsistently used, and a `DAO` layer, which handles all the database...

Currently, the UI does nothing to link parent/child jobs. The relationships can be navigated in the API, but the `lineage` API only returns jobdataset links. Eventually, we've discussed using the...

The query [here](https://github.com/MarquezProject/marquez/blob/main/api/src/main/java/marquez/db/LineageDao.java#L41) can be updated to account for the specified jobs' parent and child jobs in the lineage calculation

Completed with https://github.com/MarquezProject/marquez/issues/1928

Given this is part of the legacy write APIs, can we just move forward with deprecating the old APIs?