Edward Sun

Hi Dosu, ``` sparkmagicsbase.py def execute_sqlquery( ..... # Add this line to wait for the Spark job to finish self.spark_controller.wait_for_idle() ``` Given spark_controller does not have wait_for_idle, I made change...

Thanks Dosu. I added the waiting code in sqlquery.py. Following is the output from jupyterlab. The new log("waiting in sqlquery execute....") is shown in cell output. While executing with papermill,...

request-timeout is not supported by papermill. execution-timeout is supported and tried that but not work. ``` --execution-timeout INTEGER Time in seconds to wait for each cell before failing execution (default:...

Thanks @devstein. I will give a try and get back soon. Do you happen to know call pattern difference between %%sql and running pyspark code? BTW, Dosu works awesome!

FYI - @devstein ``` ipykernel 5.5.6 ipython 7.33.0 ipython-genutils 0.2.0 ipywidgets 7.7.0 ``` Downgraded ipykernel to 5.5.6(ipykernel has no v7) and did not get any luck. ``` Do you happen...

FYI - @devstein Made some progress on the troubleshooting. I narrowed down this to the visualization. If comment out the follow two lines, it works. https://github.com/jupyter-incubator/sparkmagic/blob/master/sparkmagic/sparkmagic/kernels/wrapperkernel/sparkkernelbase.py#L118-L119 ``` if conf.use_auto_viz(): self._register_auto_viz()...

> Is there any difference in behavior if the first cell isn't %%sql? There is no much difference. Still see cell(%%sql) got stuck.

Thanks Seiji for reporting this. We will track this request and evaluate the default languageServer configuration internally.