velox
velox copied to clipboard
add substrait extension yaml files for further function registry
copy substrait extension yaml files from https://github.com/substrait-io/substrait/tree/main/extensions for further function registry
Hi @chaojun-zhang. For future reference, could you add more context on what these extensions are and why they are needed?
Hi @chaojun-zhang. For future reference, could you add more context on what these extensions are and why they are needed?
When convert a velox plan into substrait plan, we have logic to generate substrait function signature to represent function signature in velox , and these Substrait YAML extension files will be used as input to establish the function signatures instead of a hard-coded function signatures here
@chaojun-zhang ChaoJun, would it be possible to provide the overall design for how the function mappings will be handled in the Substrat-to-Velox plan conversions? I see that functions are currently hard-coded and hope we can move away from doing that. However, it is not clear to me what the new logic will be.
@chaojun-zhang ChaoJun, would it be possible to provide the overall design for how the function mappings will be handled in the Substrat-to-Velox plan conversions? I see that functions are currently hard-coded and hope we can move away from doing that. However, it is not clear to me what the new logic will be.
Sure, let's schedule a team meeting for this, how about 5:00-6:00 PM the day on 24/08 or 25/08 based on your time zone ? or you can provide your available time slot?
@chaojun-zhang Let's try to find a time slot on Slack. We would also need a written design document. Do you have something I can read ahead of the meeting?