marquez
marquez copied to clipboard
Collect, aggregate, and visualize a data ecosystem's metadata
Replacing the hardcoded port with env variable.
Let's write/publish a Kafka consumer lib. for `OLEvent` processing. The kafka consumer will: 1. Read `OLEvent`s of a topic 2. Write `OLEvent`s to Marquez's metadata store using `marquez.db` lib.
In [Dropwizard `3.X`](https://www.dropwizard.io/en/release-3.0.x/manual/upgrade-notes/upgrade-notes-3_0_x.html), upgrade to `Jetty 10.0.x` is introduced and other major dependencies upgrades. To address vulnerabilities (as discussed [offline](https://marquezproject.slack.com/archives/C01E8MQGJP7/p1717395905980019)), let's migrate to dropwizard `3.X`.
**Context** Since the 0.7.0 release (#1906), Marquez supports [pushing metrics to Prometheus](https://github.com/MarquezProject/marquez/blob/e54ffcae72941c369a65e0e244641cf2c61f2cc5/api/src/main/java/marquez/service/JobMetrics.java#L13-L39). This task proposes extending the current capability to give visibility to Marquez's SQL queries. Some of the questions...
i see only archive EVENTS under bookmark if i want fetching DATASETS i get message Something went wrong while fetching initial data and i don't have 'ns' field in WEB...
I have followed the steps [here](https://github.com/MarquezProject/marquez/tree/main/web#development) to run the web UI. I am running node v18.20.3 on Windows using nvm on gitbash. I was able to install the dependencies and...
For each of the main pages with tables (Jobs, Datasets, and Events) columns should have a way to filter out, sort in ascending or descending order, and search as best...
As #2373 got merged both Java and Python Marquez clients should have newly added endpoint `/jobs/runs/{id}/facets` implemented.
The Problem When opening a lineage from a table views, in crowded lineages - It's difficult to identify the node selected whose lineage is highlighted - The highlighted lineage also...
The Problem Currently the status indicator in the jobs and datasets table is only displayed as a colored circle. This has issues with accessibility ( color isn't registered well with...