flashJd

@trushev Good job, I've tested it and it works on the whole, but a little defects and I'll point out

@danny0405 @xiarixiaoyao this pr is pending for two mouths, when can we merge it, as spark only support full schema evolution in spark 3.x.x, my spark version is 2.4.

> obivously, operator priority problem @danny0405 can you help review it

> > obivously, operator priority problem > > @danny0405 can you help review it (numLogFilesSeen - 1) is the number of logFiles we have processed, logFilePaths.size() is the total number...

> > > obivously, operator priority problem > > > > > > @danny0405 can you help review it > > (numLogFilesSeen - 1) is the number of logFiles we...

> @flashJd thanks for your contribution. Would you make the commit message to reflect this bug fix and change the description of this PR to match with the PR template....

@danny0405 can you help review it, thx.

> If the end commit is active and is used as the filtering instant for scan, shouldn't `getLatestFileSliceBeforeOrOn` work here ? yes, it works, but it can't handle the condition...

> > > If the end commit is active and is used as the filtering instant for scan, shouldn't `getLatestFileSliceBeforeOrOn` work here ? > > > > > > yes,...

@danny0405 looking forward to your reply