qcert icon indicating copy to clipboard operation
qcert copied to clipboard

Published 20 hours ago • verified publisher icon querycert

Remove Spark bug workaround

Open fehrenbach opened this issue 8 years ago • 0 comments

There is a bug in Spark regarding nontotal user-defined functions: https://issues.apache.org/jira/browse/SPARK-16681

We work around it with 6f92f8272b64d3ac0950e88a5a87b28a84e58fed, by making the unbrand UDF "total" (return null instead of throwing) but it would be nice to get rid of the workaround, once the underlying bug is fixed in Spark.

fehrenbach avatar Jul 22 '16 13:07 fehrenbach