suzieq
suzieq copied to clipboard
Properly handle broken files
Description
This PR is aimed to fix the handling of the broken:
- The coalescer now correctly move the broken files to a separate directory
- The parquet engine raise an exception if we try to read a broken file, instead of returning an empty dataframe
Type of change
Please delete options that are not relevant.
- Bug fix (non-breaking change which fixes an issue)