hudi

hudi copied to clipboard

The last published [hudi-presto-bundle, 1.0.2](https://mvnrepository.com/artifact/org.apache.hudi/hudi-presto-bundle/1.0.2), is using parquet-avro version `1.13.1` This unfortunately has two rather bothersome CVEs - 1. [CVE-2025-46762](https://github.com/advisories/GHSA-53wx-pr6q-m3j5), score 7.1/10 - Apache Parquet Java: Potential malicious code execution...

aaneja

[HUDI-9402] - Supporting Docker demo for Mac chips with ARM architecture

1

### Change Logs The currently supported Spark version for Mac chips is 2.4, which is outdated for the latest Hudi versions and Officially, the Docker demo does not support Hudi...

rangareddy

[HUDI-8746] Introduce SparkFileReader for general base file format

1

### Change Logs This PR 1. introduces SparkFileReader that could be extended to readers for different base file formats. 2. passes a map of [HoodieFileFormat, SparkFileReader] into Spark ReaderContext for...

linliu-code

[SUPPORT] Mac Aarch64 demo described in 'docker demo doc' is not worked

3

Mac Aarch64 demo described in 'docker demo doc' is not worked. This document might be out of date. Would Hudi community like to provide a version docker demo doc for...

b7wch

[HUDI-8746] Support multi base file formats through fg reader

1

### Change Logs Created a new file format `HoodieFileGroupReaderBasedFileFormat` to support multiple base file formats, which is guarded by the existing configuration. The main change that we do is to...

linliu-code

[HUDI-9235] Plugin FG reader into MDT

1

### Change Logs Since FG reader could support HFile format with predicates, we plugin into FG reader into MDT. ### Impact Unified MDT records read with DT record reads. ###...

linliu-code

Filegroup name seems incorrect for log file created with NBCC

2

Test in here "testMultiBaseFile": [^TestSparkNonBlockingConcurrencyControl.java]   bulkInsertFirst=true works fine, but the test will fail for bulkInsertFirst=false   This is because the name of the filegroup created by the bulk insert at the...

hudi-bot

Supporting a query task can read multiple file-slice to reduce spark task num

1

1. Supporting a query task can read multiple file-slice to reduce spark task num ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8393 - Type: Improvement - Fix version(s): - 1.1.0

hudi-bot

[HUDI-8431] Remove redundant table and timeline validity check in HoodieStreamer

1

### Change Logs - Remove `targetBasePath` check because Hudi should just throw `TableNotFoundException ` later on if this path is not valid/does not exist. - Remove redundant initialization of `HoodieTableMetaClient`...

xiaoxuandev

Remove redundant table and timeline validity check in HoodieStreamer

1

## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8431 - Type: New Feature - Fix version(s): - 1.1.0 --- ## Comments 24/Oct/24 16:11;yihua;https://github.com/apache/hudi/pull/12143;;;

hudi-bot