Tao Wu

@masterclock Hi Without the schema field, may I ask how do you handle the schema change from the upstream? Do you use schema registry?

@tabVersion Let's make a progress on this issue. I agree that we can provide users with this flexibility, i.e, a WITH option: `schema.included`, by default to be false, meaning that...

Thanks @bakjos I am wondering what specific HTTP service do you intend to connect through the UDF source? While looking into this requirement, I also came up with another idea:...

@bakjos sorry for my late response. I generally align with your goal to provide enough flexibility for more sources. However, in terms of implementation, I believe that we should ensure...

Even we go toward this direction, I doubt if the UDF framework for stateless computation is suitable for ingestion as well. 🤔 Here are some points should be addressed in...

@ly9chee thanks for this advice. I agree with your opinion that we can introduce a plugin system to enable users to integrate with more sources. I am actually exploring in...

😄 Even Rust is acceptable. I exactly wrote the same thing in my design proposal. But please note that CDC is more complex. Our current CDC framework involves both Java...

> Things like state or backfilling could be implemented by exposing some objects/interfaces to the UDF Stateful UDF is not in our plan actually. cc @wangrunji0408 Because it can be...

A step forward is to apply this secret framework to our mysql/PG connectors, which also expose secrets like username and password in plain texts. @StrikeW

https://github.com/risingwavelabs/rfcs/issues/41#issuecomment-1407307168 What @TennyZhuang mentioned is absolutely essential that we should ensure the extensibility of our major components. But the reality is, even some trivial configuration changes could break the compatibility:...