levishi

RecordReaderImpl.getValueRange() may cause incorrect results

7

orc version: 1.6.11, sql: `select xxx from xxx where str is not null` Recently i found some orc files wrote by trino didn't have complete statistics in files meta(maybe a...

`spark.blaze.enable.shuffle` doesn't work

2

**Describe the bug** I try to disable coverting `ShuffleExchangeExec`, but it doesn't work. And i found the code ``` def convertSparkPlan(exec: SparkPlan): SparkPlan = { exec match { case e:...

[FEATURE] Is there a better way to manage schema of tfrecord

1

### Describe the feature We have many tfrecords files on hdfs, these files were created by spark and treated as hadoop files. Currently, we face some issues: 1. The files...