hail
hail copied to clipboard
hail-is
Cloud-native genomic dataframes and batch computing
### What happened? PyPI supports organizations. We should create one for hail (maybe hail-is) and add all the core devs to it. Only a handful of us should be “owner”....
### What happened? This dataset has 1000 rows so it should be able to have as many as 1000 partitions. As seen below, either `n_partitions` is wrong or `read_matrix_table(..., _n_partitions=...)`...
[batch] Submitting a Batch using the hailtop.batch library may raise "Cannot enter into task" errors
### What happened? Ben tried to submit a batch with 0.2.126 and it kept failing with errors due to not able to enter into a task. A quick google search...
### What happened? https://hail.zulipchat.com/#narrow/stream/223457-Hail-Batch-support/topic/Too.20many.20open.20files.20exception - [ ] Replicate - [ ] Attempt to reduce parallelism to 75x and see if that resolves it. ### Version 0.2.124 ### Relevant log output...
### What happened? A job that is attempted more than, say, 5 times, is probably going wrong. We should at the least log an error. Users should probably be able...
### What happened? A user running RHEL 9 [reported an error](https://discuss.hail.is/t/hail-fails-after-installing-it-on-a-single-computer/3653) importing movie lens data when running 0.2.126 but succeeded on 0.2.120. This error did not reproduce on MacOS. We...
### What happened? `add_liftover` fails when provided a local chain file on Dataproc. The error says the file does not exist, even though it does. ## To reproduce This is...
### What happened? Our Zstd buffer size is currently 64KiB. Zstd supports window sizes of at least 512 MiB. In Meta's data warehouse [1] they commonly use 256KiB block sizes....
### What happened? This issue is complete when: 1. We have merged a PR that provides a `hl.vds.export_svcr_vcf` with clear documentation and examples. The examples should include a `show` of...
### What happened? When the SVCR paper is made public, we should be able to point people at an example VDS. ### Version 0.2.126 ### Relevant log output _No response_