Dan King
Dan King
I verified https://github.com/hail-is/hail/pull/14351 fixes this.
See also: https://github.com/hail-is/hail/issues/13009
These buckets remain: ``` (base) dking@wm28c-761 hail % cat x | jq -c '{location: .location, locationType: .locationType, name: .name, ubla: .iamConfiguration.uniformBucketLevelAccess.enabled } | select( (.ubla | not) or .locationType !=...
GCR is disabled. I can delete the artifacts whenever we're confident they are unneeded. I'll probably delete this week. Dataproc buckets exist, but we're waiting on https://github.com/hail-is/hail/pull/14270 to merge before...
Only these buckets remain and they are currently being deleted: - gs://dataproc-7f9e9d5e-03bd-4e95-bea1-fe0321239b35-us/ - gs://dataproc-temp-us-842871226259-x3fbdioe/ - gs://hail-datasets-eu/ - gs://hail-datasets-us/ - gs://hail-eu-vep/ - gs://hail-us-vep/
done ``` (base) dking@wm28c-761 ~ % gcloud storage ls --project broad-ctsa -b -j | jq '.[] | select(.metadata.locationType=="multi-region") | .url' (base) dking@wm28c-761 ~ % gcloud storage ls --project hail-vdc -b...
NOTE: This issue is **only** about the error message. We can definitely produce a more insightful error message (perhaps suggesting the use of `.rows()[key_field1, key_field2]`) without also addressing the confusing...
For now, downgrade: ``` pip3 install 'ipython
https://batch.hail.is/batches/8062723/jobs/204 ``` starting test is.hail.io.fs.GoogleStorageFSSuite.largeDirectoryOperations... Exception: org.scalatest.exceptions.TestFailedException: files not deleted: gs://hail-test-ezlis/fs-suite/delete-many-files/376b0a1e-ee61-43ab-abb4-d67a0978ee46/791.suffix at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:528) at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:527) at org.scalatest.testng.TestNGSuite.newAssertionFailedException(TestNGSuite.scala:67) at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:501) at is.hail.io.fs.FSSuite.largeDirectoryOperations(FSSuite.scala:413) at is.hail.io.fs.FSSuite.largeDirectoryOperations$(FSSuite.scala:398) at is.hail.io.fs.GoogleStorageFSSuite.largeDirectoryOperations(GoogleStorageFSSuite.scala:10) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)...
This still happens on the regular https://batch.hail.is/batches/8133279/jobs/203