Akif Cakir comments

Repositories
Issues
Comments

Results 2 comments of


                                            Akif Cakir

How to apply a function includes a class inside ? got the error: did not recognize Python value type when inferring an Arrow data type

@ueshin thanks a lot for your answer, with this approach it completes the job in example notebook and my original case. ![image](https://user-images.githubusercontent.com/27499720/90224264-b02f7f80-de0f-11ea-8032-f1d31d6cd732.png) Nevertheless when I tried to run df.head() in...

How to apply a function includes a class inside ? got the error: did not recognize Python value type when inferring an Arrow data type

Thanks for the answer, I tried with `spark.conf.set("spark.sql.execution.arrow.enabled", "false")` and it run after 38 min it crashed with the error in below. Also it scaled up to 8 worker during...