hive-testbench icon indicating copy to clipboard operation
hive-testbench copied to clipboard

./tpcds-setup.sh 2 fails

Open herrytco opened this issue 3 years ago • 2 comments

Hello, I am running:

  • Hadoop 2.7.1
  • Hive 1.2.2

and I am trying to generate testdata.

I did:

./tpcds-build.sh
./tpcds-setup.sh 2

the latter fails then with this message:

[...]
TPC-DS text data generation complete.
Loading text data into external tables.
0: jdbc:hive2://localhost:2181/ (closed)> create database if not exists ${DB};

make: *** [load_orc_2.mk:3: date_dim] Error 2
Loading constraints
0: jdbc:hive2://localhost:2181/ (closed)> -- set hivevar:DB=tpcds_bin_partitioned_orc_10000
0: jdbc:hive2://localhost:2181/ (closed)>
0: jdbc:hive2://localhost:2181/ (closed)> alter table customer_address add constraint ${DB}_pk_ca primary key (ca_address_sk) disable novalidate rely;

Data loaded into database tpcds_bin_partitioned_orc_2.

But when I check, the database does not exist. How can I resolve this issue?

herrytco avatar Sep 02 '21 10:09 herrytco

Thanks, I have also encountered this problem. Have you solved it?

Aristohack avatar Apr 07 '22 08:04 Aristohack

For future generations: scripts in these repo connect to remote Hive via 2181 port, but it's non-conventional. The default port is 10000, see link 1 and link 2.

Change https://github.com/hortonworks/hive-testbench/blob/hdp3/tpcds-setup.sh#L73 to:

- HIVE="beeline -n hive -u 'jdbc:hive2://localhost:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2?tez.queue.name=default' "
+ HIVE="beeline -n hive -u 'jdbc:hive2://localhost:10000/' "

I believe it duplicates #35

frsv avatar Mar 28 '23 12:03 frsv