shc icon indicating copy to clipboard operation
shc copied to clipboard

org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't get the locations

Open lonly197 opened this issue 7 years ago • 4 comments

Params spark-submit
--conf "spark.ui.port=4042"
--conf "spark.sql.codegen=true"
--conf "hbase.zookeeper.quorum=dmp1,dmp2,dmp3"
--conf "zookeeper.znode.parent=/hbase-unsecure"
--class test.Example
--master local[2]
--name test
--files /etc/hadoop/conf/core-site.xml,/etc/hbase/conf/hbase-site.xml
--jars /usr/hdp/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/current/hbase-client/lib/hbase-client.jar,/usr/hdp/current/hbase-client/lib/hbase-common.jar,/usr/hdp/current/hbase-client/lib/hbase-server.jar,/usr/hdp/current/hbase-client/lib/guava-12.0.1.jar,/usr/hdp/current/hbase-client/lib/hbase-protocol.jar,/usr/hdp/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,/root/lonly/shc-core-1.1.1-2.1-s_2.11.jar
/home/test/testshc_2.11-0.1.jar

Error image

lonly197 avatar Sep 12 '17 03:09 lonly197

Maybe you want to try: copy hbase-site.xml to spark conf directory.

weiqingy avatar Sep 13 '17 19:09 weiqingy

Is there anyway to set hbase properties programmatically instead of copy hbase-site.xml over? What if I want to connect to multiple hbase clusters?

thewilliamzhang avatar Oct 03 '17 01:10 thewilliamzhang

@thewilliamzhang Yes. You can put hbase properties into a config file or json format. Then, as this example shows here, you can pass config file (HBaseRelation.HBASE_CONFIGFILE) or json (HBaseRelation.HBASE_CONFIGURATION) into option() function.

weiqingy avatar Oct 03 '17 02:10 weiqingy

@weiqingy i will copy hbase-site.xml to spark conf directory, but don't work. my env: spark, hadoop, hbase also open kerberos 。 how i do it ?
can give me your email ?

weibingo avatar May 25 '18 07:05 weibingo