Spark-The-Definitive-Guide
Spark-The-Definitive-Guide copied to clipboard
databricks
Error while connecting to Databases in DataBrick Community Edition on Cloud .
HI, I have downloaded repository and I was able to execute and practice all example . But when I am trying to execute examples related to SQL data source from Chapter 9 Data Source I am getting following error. I don't have any clue on what to do so please guide me. Thanks in advance. Error"Java.sql.SQLException: path to '/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db': '/databricks-datasets' does not exist"
Path do exists when I run %fs ls and
dbfs:/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db
Following are parameters
driver = "org.sqlite.JDBC" path = "/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db" url = "jdbc:sqlite:" + path tablename = "flight_info"
try with /dbfs/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db"
how did you fix this? i am getting same error even after making above suggestion.
driver = "org.sqlite.JDBC" path = "/dbfs/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db" url = "jdbc:sqlite:" + path tablename = "flight_info"
dbDataFrame = spark.read.format("jdbc").option("url", url).option("dbtable", tablename).option("driver", driver).load()
Py4JJavaError: An error occurred while calling o608.load.
: java.sql.SQLException: path to '/dbfs/databricks-datasets/definitive-guide/data/flight-data/jdbc/my-sqlite.db': '/dbfs/databricks-datasets' does not exist
at org.sqlite.core.CoreConnection.open(CoreConnection.java:192)
at org.sqlite.core.CoreConnection.
