hail
hail copied to clipboard
[hailtop.batch] Batch.run() does not work if executed more than once with temporary files
What happened?
Lindo tried to use JobResourceFiles a second time after updating the original batch, but got FileNotFoundError
. This is because the default behavior is to delete temporary files with b.run()
. We should add this use case to our documentation, but it might also be a good idea to eagerly catch these errors if possible and provide a better error message. I don't think we can change the default value at this point.
https://hail.zulipchat.com/#narrow/stream/223457-Hail-Batch-support/topic/File.20dependency.20error/near/416647170
Version
0.2.127
Relevant log output
No response