Frank Yin
Frank Yin
> Do you think we can have a test coverage here? > > https://github.com/apache/spark/blob/f1ae56b152bdf19246d698b65e553790ad54306b/core/src/test/scala/org/apache/spark/storage/FallbackStorageSuite.scala#L43 Added a unit test coverage.
hmm looks like the SQL test just timed out and I retried a couple times already. cc @dongjoon-hyun
I think I can answer 2). It seems shuffle blocks are deleted in between the `fs.exists` and `fs.copyFromLocal` calls. From the stack trace linked in the jira ticket, it fails...
@dongjoon-hyun friendly bump
This adds the missing case for https://github.com/apache/flink/pull/23881
@MartijnVisser can you help review this PR? and possibly https://github.com/apache/flink/pull/23881 as well?
Yes I would love to have review/test on this PR.
@kridai any updates on this bug?
@sbansla any updates on this issue?