incubator-gluten
incubator-gluten copied to clipboard
[backend-Velox] Use tpch_convert_parquet_dwrf.sh to convert parquet but cause exception 'double free or corruption (!prev)'
Describe the bug generate the parquet table file by use tpch-dbgen: https://github.com/databricks/tpch-dbgen
then convert the parquet file to dwrf format by use the tpch_convert_parquet_dwrf.sh script, and submit the spark job to yarn, the job fail and the error log as below
it seems the jni call make the exception
To Reproduce re-run tpch_convert_parquet_dwrf.sh script
Expected behavior convert parquet to dwrf without error
Additional context
parquet is supported now. You may try parquet file directly.
parquet is supported now. You may try parquet file directly.
OK