Keivan Soleimani
Keivan Soleimani
Thanks for your response, There was no any error at runtime, I tested my code with "**apache/spark-py**" image (https://hub.docker.com/r/apache/spark-py) and the result was **correct** and the parquet file was created...
I tested the python code for saving dataframe to **json** format, but the result was the same problem as I mentioned before : ```python from pyspark.sql import SparkSession spark =...
with scala shell (spark-shell), everything is ok. ``` val df = spark.read.csv("csv/file.csv") df.write.mode("overwrite").format("json").save("file_name.json") ```   but with pyspark and spark-submit python code file not found !
I tested the java code for saving dataframe to json format, but the result was the same problem as I mentioned before :    ```java package arka; import...