docker-hadoop-spark-workbench icon indicating copy to clipboard operation
docker-hadoop-spark-workbench copied to clipboard

Published 20 hours ago • verified publisher icon big-data-europe

Unable to query the hive table in container from spark-shell running in Windows

Open ZosBHAI opened this issue 4 years ago • 0 comments

I was able to start the hive server and metastore service using this project(bde2020/hive) in windows machine. And Spark shell which is running in Windows is able to connect this Hive metastore and display the hive tables. spark.sharedState.externalCatalog.listTables("default")

I was unable to display the hive table content using spark.table("demo_sales97").show , due to Caused by: java.net.UnknownHostException: namenode

I tried adding hostname to the compose file.Unfortuantely , it seems not working.

I could find couple of threads related to java.net.UnknownHostException: namenode, but nothing specific to connecting spark-shell running in Windows.

Please help on this.

ZosBHAI avatar Jul 29 '20 10:07 ZosBHAI