Danny Chan

> > , I'm afraid the algorithm should be in-consistency too in order to operate the bucket pruning opimization > > not sure to understand. Do you mean the hashing...

> Hardcoding Murmur is likely a good idea Not hardcoding, I mean to make it configurable, the user chooses the algorithm they desire to use. > it would allow to...

> I am not sure it is a good design to introduce spark concepts within hudi-client-common Obviously it is a bad design that we should avoid to take, can we...

cc @parisni Are you still on this?

> So if we have to choose one between spark and hive, I think spark might be of higher priority I agree, do you have energy to complete that suspended...

I'm wondering how the table got written, is it written by Flink streaming pipeline?

@trushev Can you rebase the code again and i'm planning to review this code again ~

[3981.patch.zip](https://github.com/apache/hudi/files/9977268/3981.patch.zip) Thanks for the contribution, have reviewed some of the part, and left a local patch here and some comments ~

> withInternalSchema( Agree

> > [3981.patch.zip](https://github.com/apache/hudi/files/9977268/3981.patch.zip) Thanks for the contribution, have reviewed some of the part, and left a local patch here and some comments ~ > > Why we use writerSchema instead...