marquez icon indicating copy to clipboard operation
marquez copied to clipboard

[Question] Using API Key with Spark Open Lineage integration

Open TejasRGitHub opened this issue 1 year ago • 1 comments

Hi Team,

We have multiple spark jobs, and we want to generate lineage using Spark integration for Open-lineage (https://openlineage.io/docs/integrations/spark/).

From this documentation, an API Key can be configured in the Spark Jobs ( https://openlineage.io/docs/integrations/spark/configuration/transport ).

From this GH issue , an API key support was added to the Java and Python Clients ( https://github.com/MarquezProject/marquez/issues/817 ).

Can you please confirm, if the API key support is present in Marquez and how can this authentication support be configured for Marquez API

TejasRGitHub avatar Nov 08 '24 18:11 TejasRGitHub

@wslulciuc , @phixMe , could you please help me with this.

TejasRGitHub avatar Jan 09 '25 15:01 TejasRGitHub