spark icon indicating copy to clipboard operation
spark copied to clipboard

Couldn't Run Spark-Submit. Received an error.

Open briancuster opened this issue 3 years ago • 4 comments

Problem encountered on https://dotnet.microsoft.com/learn/data/spark-tutorial/install-spark Operating System: windows

Provide details about the problem you're experiencing. Include your operating system version, exact error message, code sample, and anything else that is relevant.

briancuster avatar Nov 29 '21 15:11 briancuster

Can you share some more details? The console output, particularly the stack traces would be useful (as well as the error message)

GoEddie avatar Nov 29 '21 15:11 GoEddie

I got the message that spark-submit was not an operable command, program, etc.

briancuster avatar Nov 29 '21 15:11 briancuster

It sounds like the folder where spark exists %SPARK_HOME%\bin isn't on your path - you can either pass the full path to spark-submit in the bin folder or add it to your path statement you can use spark-submit,

Make sure you have done everything in this list: https://the.agilesql.club/2019/08/help-my-apache-spark-configuration-on-windows-isnt-working-i-think/

GoEddie avatar Nov 29 '21 16:11 GoEddie

@briancuster were you able to resolve your issue ?

suhsteve avatar Jan 25 '22 18:01 suhsteve