Sarvesh Pradhan

> A potential problem is that both `count` and `median` return a row, even when called on any empty column: > > ```python > df = pl.DataFrame({'a': []}) > df.select([...

Facing the same issue. My setup is interactive spark jupyter notebook with sparkmagic via livy. Here is my setup Spark version 3.2.2.3.2.2 ``` { "driverMemory": "32G", "executorMemory": "16G", "numExecutors": 20,...

Thanks for the response. ``` >>> spark.version '3.2.2.3.2.2.0-1' ``` Meanwhile checking with our Spark admin if there is some misconfiguration on our end. Will come back in a few days.

Spoke to our Spark administrator and got to know that in our on-premise deployment there are mild changes made to it to suit the on-premise deployment. The in-house Spark team...

Came across the same problem. Taking inspiration from the engines in papermill, would like to propose that we move parameterising in the same manner ```py """Parameterizers to perform different parameterization"""...