marquez
marquez copied to clipboard
[Question] Using API Key with Spark Open Lineage integration
Hi Team,
We have multiple spark jobs, and we want to generate lineage using Spark integration for Open-lineage (https://openlineage.io/docs/integrations/spark/).
From this documentation, an API Key can be configured in the Spark Jobs ( https://openlineage.io/docs/integrations/spark/configuration/transport ).
From this GH issue , an API key support was added to the Java and Python Clients ( https://github.com/MarquezProject/marquez/issues/817 ).
Can you please confirm, if the API key support is present in Marquez and how can this authentication support be configured for Marquez API
@wslulciuc , @phixMe , could you please help me with this.