Sean Owen

icon indicating an email [email protected]

icon company @databricks icon location Austin, TX icon location Applied research @ Mosaic @ Databricks. Formerly Principal DS/ML Specialist @ Databricks. Apache Spark PMC / committer. Primary author, zxing and Oryx project.

Results 245 comments of Sean Owen

Fix Scala ArrayBuffer cast to Spark ArrayData for Scala 2.13

Hm, I don't think it's quite that simple unfortunately - it causes some test to fail. I'm not totally sure why. It seems like building an Array this way doesn't...

Fix title for spark 3.5.1 PySpark doc

We still want to merge this right?

[SPARK-37178][ML] Add Target Encoding to ml.feature

Let me call in @zhengruifeng for a look at this too. I think it's pretty good

[SPARK-37178][ML] Add Target Encoding to ml.feature

I think it looks good. There are 'failing' tests but it looks like a timeout. I'll run again to see if they complete. Anyone know about issues with the builder...

[SPARK-49923][core]Add a configuration item for disabling the setting of javaOptions.

I would say no to this change. It adds complexity, and is quite specific to your deployment use case, where you want to allow users a lot of control to...