hive-testbench icon indicating copy to clipboard operation
hive-testbench copied to clipboard

load-partitioned.sql doesn't inherit shell value for ${REDUCERS}

Open scorpiienator opened this issue 6 years ago • 0 comments

The intent for the tpch-setup.sh command is to pass the REDUCERS variable into the final stage, which checks the table creation in the line

hive -i settings/load-${SCHEMA_TYPE}.sql -f ddl-tpch/bin_${SCHEMA_TYPE}/analyze.sql --database ${DATABASE};

But the $REDUCERS variable cannot be interpreted in load-partitioned.sql in the line

set hive.exec.reducers.max=${REDUCERS};

This results in a hive execution error

scorpiienator avatar Dec 18 '18 02:12 scorpiienator