parquet4s icon indicating copy to clipboard operation
parquet4s copied to clipboard

Published 20 hours ago • verified publisher icon mjakubowski84

feat(akkaPekko): Retry mechanism for ParquetPartitioningFlow

Open utkuaydn opened this issue 8 months ago • 4 comments

Hi,

In the akkaPekko module, I noticed that there is no handling mechanism in ParquetPartitioningFlow when calling write from the hadoop ParquetWriter which might throw an IOException. I thought it would also be neat to have a retrial mechanism in place for failed records so I created #350. I think this is something that would be nice to have, let me know if you agree.

utkuaydn avatar Jun 13 '24 11:06 utkuaydn