substrait icon indicating copy to clipboard operation
substrait copied to clipboard

Published 20 hours ago • verified publisher icon substrait-io

feat(proto): Add protobuf support for user-defined-function extension

Open rtpsw opened this issue 3 years ago • 2 comments

Currently, Ibis has vectorized UDF nodes that are not handled by Ibis-Substrait (see https://github.com/ibis-project/ibis-substrait/issues/236). This issue is specific for the protobuf changes needed.

rtpsw avatar Jun 27 '22 11:06 rtpsw

This issue is somewhat vague (is this for embedding UDF implementation into the plan? For calling pre-registered UDFs in the consumer? etc?) Could you clarify? I know we've all done some work in this area over the last six months. Alternatively, we could close this and reopen issues / discussion at a later time.

westonpace avatar Mar 01 '23 21:03 westonpace

This is for embedding vector UDF implementations - using the func member. See test_udf.py in Arrow for the scalar (rather than vector) UDF is currently implemented in a Substrait consumer.

AFAIK, this issue can be held for the time being. @icexelloss could bear on prioritization.

rtpsw avatar Mar 03 '23 07:03 rtpsw