PARQUET-1337: Current block alignment logic may lead to several row groups per block

Open zivanfi opened this issue 7 years ago • 4 comments

Sep 18 '18 11:09 zivanfi

@zivanfi, @gszadovszky, can you explain how this was fixed?

Sep 27 '18 23:09 rdblue

@rdblue I started writing a DD about the solution that I plan to send to the dev list on Monday. Although Gabor approved this change, I don't plan to merge it soon as there are even more measures needed to address all problems and I will also have to resolve conflicts with the column indexes feature.

Sep 28 '18 16:09 zivanfi

Sounds great, thank you!

Sep 28 '18 17:09 rdblue

@rdblue, you can now review the design doc for details. Thanks!

Oct 01 '18 12:10 zivanfi