hive-testbench
hive-testbench copied to clipboard
makefile error for tpcds
I have been trying to setup hive-testbench for generating tpcds data. Upon running ./tpcds-setup.sh, I observed the following error.
I'm using hadoop- 3.3.6, hive - hive-4.0.0-alpha-1 versions.
gcc -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -DYYDEBUG -DLINUX -g -Wall -o dsdgen s_brand.o s_customer_address.o s_call_center.o s_catalog.o s_catalog_order.o s_catalog_order_lineitem.o s_catalog_page.o s_catalog_promotional_item.o s_catalog_returns.o s_category.o s_class.o s_company.o s_customer.o s_division.o s_inventory.o s_item.o s_manager.o s_manufacturer.o s_market.o s_pline.o s_product.o s_promotion.o s_purchase.o s_reason.o s_store.o s_store_promotional_item.o s_store_returns.o s_subcategory.o s_subclass.o s_warehouse.o s_web_order.o s_web_order_lineitem.o s_web_page.o s_web_promotinal_item.o s_web_returns.o s_web_site.o s_zip_to_gmt.o w_call_center.o w_catalog_page.o w_catalog_returns.o w_catalog_sales.o w_customer_address.o w_customer.o w_customer_demographics.o w_datetbl.o w_household_demographics.o w_income_band.o w_inventory.o w_item.o w_promotion.o w_reason.o w_ship_mode.o w_store.o w_store_returns.o w_store_sales.o w_timetbl.o w_warehouse.o w_web_page.o w_web_returns.o w_web_sales.o w_web_site.o dbgen_version.o address.o build_support.o date.o decimal.o dist.o driver.o error_msg.o genrand.o join.o list.o load.o misc.o nulls.o parallel.o permute.o pricing.o print.o r_params.o StringBuffer.o tdef_functions.o tdefs.o text.o scd.o scaling.o release.o sparse.o validate.o -lm
/usr/bin/ld: s_purchase.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_purchase.c:55: multiple definition of nItemIndex'; s_catalog_order.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_catalog_order.c:56: first defined here /usr/bin/ld: s_web_order.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_web_order.c:56: multiple definition of
nItemIndex'; s_catalog_order.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_catalog_order.c:56: first defined here
/usr/bin/ld: s_web_order_lineitem.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_web_order_lineitem.c:54: multiple definition of g_s_web_order_lineitem'; s_web_order.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_web_order.c:54: first defined here /usr/bin/ld: w_catalog_page.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/w_catalog_page.c:52: multiple definition of
g_w_catalog_page'; s_catalog_page.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_catalog_page.c:51: first defined here
/usr/bin/ld: w_warehouse.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/w_warehouse.c:53: multiple definition of g_w_warehouse'; s_warehouse.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_warehouse.c:51: first defined here /usr/bin/ld: w_web_site.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/w_web_site.c:59: multiple definition of
g_w_web_site'; s_web_site.o:/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools/s_web_site.c:51: first defined here
collect2: error: ld returned 1 exit status
make[1]: *** [makefile:233: dsdgen] Error 1
make[1]: Leaving directory '/work/tpcds-insights/hive-testbench/tpcds-gen/target/tools'
make: *** [Makefile:23: target/tools/dsdgen] Error 2
TPC-DS Data Generator built, you can now use tpcds-setup.sh to generate data.
hadoop@f1953c80b0cb:/work/tpcds-insights/hive-testbench$
could you please help me in resolving this issue?
The gcc version in your environment may be too high. Modify the makefile file by replacing gcc with gcc -fcommon.
I have solved the problem. As Tsxiaolei said, the gcc version is too high. Enter the tpcds-gen directory: make clean && make CC=gcc-9