hive-testbench icon indicating copy to clipboard operation
hive-testbench copied to clipboard

hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists

Open powerLambda opened this issue 4 years ago • 4 comments

failed to execute tpch-setup.sh in hive2.3.5, hadoop2.8.5

DEBUG_SCRIPT=ON FORMAT=textfile ./tpch-setup.sh 100 /data Logging initialized using configuration in file:/usr/local/service/hive/conf/hive-log4j2.properties Async: true Query returned non-zero code: 1, cause: hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists.

powerLambda avatar Aug 31 '20 03:08 powerLambda

which file to configure the item and a valid value? i have no idea.

p-forest avatar Dec 23 '20 07:12 p-forest

you can modify the setting sql in the settings/load-flat.sql

lyzGithub avatar Jul 29 '21 03:07 lyzGithub

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

herrytco avatar Sep 02 '21 11:09 herrytco

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

Great! This fix the issue!!

davi16sm avatar Jun 03 '23 21:06 davi16sm