Yujiang Zhong
Yujiang Zhong
@V-yg No, I haven't.
@naushadahamad786 0.12.1 only supports copy-on-write MERGE INTO, matching data files will be replaced with new data files immediately, so it won't produce delete files.
@akghbti @naushadahamad786 0.13 supports merge-on-read delete: [0.13.0 Release Notes](https://iceberg.apache.org/releases/), and merge-on-read merge is still in progress, you can track progress [here](https://github.com/apache/iceberg/projects/11).
> Thus, to solve the problem of only-NaN pages, the comments in the spec are extended to mandate the following behavior: > > Once a writer writes the nan_count/nan_counts fields,...
@JFinis Thanks for your reply, just realized that the page value count is stored in the page header, not in the column index. I overlooked your comments above before asked...
@pvary Sure, no problem.
@pvary @stevenzwu Gentle ping.
> Flink reader has a problem if the residual filter changed when restoring from checkpoint. is it the same problem we are talking about here? @zhongyujiang @stevenzwu No, I think...
Hi @pvary Thanks for reviewing. I think the issue here is somewhat different from what you understand. > We have at least 3 FileScanTasks (FS1, FS2, FS3) to read >...
> I can see 2 ways to fix this: > > Count every file in the fileOffset - even the ones which are skipped. This seems more natural to me,...