Maxim Martynov
Maxim Martynov
I'm running Marquez inside company network which has no direct internet access. Opening any page of Marquez UI leads to showing a blank page for ~15 seconds, and only then...
## Description Using `queryId` as OpenLineage's job `name` field lead to registering all unique queries as ETL jobs. This is hardly useful in terms of lineage. Now integration allows to...
## Description Previously OpenLineage run.id was generated as `UUIDv3(hash(queryId))`. Now it is generated as `UUIDv7(queryCreateTime, hash(queryId))`, using [UUIDUtils.generateStaticUUID](https://github.com/OpenLineage/OpenLineage/pull/3672) method. ## Additional context and related issues According to [OpenLineage documentation](https://openlineage.io/docs/spec/object-model#run), it...
## Description - Name: G-Research Spark Extension - URL: https://github.com/G-Research/spark-extension - License: Apache-2.0 ## Why This project provides several transformation functions for Spark (both Scala and Python), like global row...
## Description ### Spark Measure - Name: Spark Measure - URL: https://github.com/LucaCanali/sparkMeasure - License: Apache-2.0 ### CERN Spark Plugins - Name: CERN Spark Plugins - URL: https://github.com/cerndb/SparkPlugins - License: Apache-2.0...
## Description - Name: Qbeast - URL: https://github.com/Qbeast-io/qbeast-spark - License: Apache-2.0 ## Why Qbeast is a storage layer which provides ACID capabilities, multicolumn indexes, and improves sampling performance (up to...
## Description ### Apache Gluten - Name: Apache Gluten - URL: https://github.com/apache/incubator-gluten - License: Apache-2.0 ### Apache DataFusion Comet - Name: Apache Gluten - URL: https://github.com/apache/datafusion-comet - License: Apache-2.0 ###...
## Description - Name: Apache Bahir - URL: - License: ## Why The project is moved to Apache Attic, the github repo https://github.com/apache/bahir was archived Feb 16 2024. Related: https://github.com/awesome-spark/awesome-spark/issues/199#issuecomment-2381578117...
## Description ### OpenLineage Spark integration - Name: OpenLineage Spark integration - URL: https://openlineage.io/docs/integrations/spark/, https://github.com/OpenLineage/OpenLineage/tree/main/integration/spark - License: Apache-2.0 ### DataHub Spark Agent - Name: DataHub Spark Agent - URL: https://datahubproject.io/docs/metadata-integration/java/acryl-spark-lineage,...
## Description ### Apache Celeborn - Name: Apache Celeborn - URL: https://github.com/apache/celeborn - License: Apache-2.0 ### Apache Uniffle - Name: Apache Uniffle - URL: https://github.com/apache/incubator-uniffle - License: Apache-2.0 ### Spark...