coffee_boat icon indicating copy to clipboard operation
coffee_boat copied to clipboard

Update example to use arrow for vectorized UDF funtime

Open holdenk opened this issue 7 years ago • 1 comments

We currently have one example notebook, would be good to update the example to distribute PyArrow since this will be useful in Spark 2.3+ for vectorized UDF users.

holdenk avatar Jan 11 '18 04:01 holdenk

So the test now distributes Arrow, but this is still important to do in the example. It might be more powerful to do after Spark 2.3 ships so we can show a UDF before and after installing arrow :)

holdenk avatar Jan 17 '18 04:01 holdenk