Plan file scan task according scan file size.
Can I work on this ? Additionally is the expectation here is to add multiple FileScanTask based on the split size and the scan file size
Can I work on this ? Additionally is the expectation here is to add multiple FileScanTask based on the split size and the scan file size
Hi, @rahull-p Thanks for your interest, and welcome to contribute! In the basic version, we need to take the split size into account. In advanced version, we also need to take the file open cost into account. Java's reference implementation is here: https://github.com/apache/iceberg/blob/ab6391767e75357a9a12691513d9f83a4180f7e4/core/src/main/java/org/apache/iceberg/BaseTableScan.java#L43