Purview-Machine-Learning-Lineage-Solution-Accelerator icon indicating copy to clipboard operation
Purview-Machine-Learning-Lineage-Solution-Accelerator copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Older Spark Version Required, ARM Template Fails on Spark pool creation

Open mdowns75 opened this issue 3 years ago • 0 comments

Hi. It should be noted that you must deploy spark version 2.4 in order for this to work properly. Alternatively, the ARM template deployment could be fixed to properly deploy the spark pool and either set the "dynamically allocate executors" to "disabled" or keep "enable" and set the "Default number of executors" values. Currently the spark deployment in the ARM template fails. If the ARM template is fixed, ensure 2.4 spark version is set

mdowns75 avatar Aug 23 '22 17:08 mdowns75