tweets temp table not exists error

[JhansiA]

@matthew-mcateer Hi, I am running the code in local instead of VM, the code was running fine in VM and able to see the twitter data but in local i am facing issue like Py4JJavaError: An error occurred while calling o25.sql. : org.apache.spark.sql.AnalysisException: Table or view not found: tweets; line 1 pos 23

Any help ?

While debugging, when i compare VM and local machine, after the streaming started, My local :

VM:

So the tweets table is not creating in my local. I have not figured the solution yet.

[kmillanr]

same issue

[MohammadHeydari]

I have the same issue either

[rpalaani30]

The issue could be

1. your spark default is in yarn, change it local mode.

2.There is only one executor working, which is receiving message, but no executor is processing message.

Solution: while opening your jupyter follow the below command.(ensure your pyspark2 by default opens in jupyter)

[cloudera@quickstart ~]$ pyspark2 --master local[2]

This should solve your problem.