hail icon indicating copy to clipboard operation
hail copied to clipboard

[hailtop.batch] Batch.run() does not work if executed more than once with temporary files

Open jigold opened this issue 5 months ago • 2 comments

What happened?

Lindo tried to use JobResourceFiles a second time after updating the original batch, but got FileNotFoundError. This is because the default behavior is to delete temporary files with b.run(). We should add this use case to our documentation, but it might also be a good idea to eagerly catch these errors if possible and provide a better error message. I don't think we can change the default value at this point.

https://hail.zulipchat.com/#narrow/stream/223457-Hail-Batch-support/topic/File.20dependency.20error/near/416647170

Version

0.2.127

Relevant log output

No response

jigold avatar Jan 18 '24 21:01 jigold