quickwit
quickwit copied to clipboard
Refactor file source
Description
To prepare the S3 backed SQS source, this PR refactors the file source so that generates RawDocBatch
can be reused.
How was this PR tested?
Added extra unit tests to the new DocFileReader.