hail
hail copied to clipboard
hail-is
Cloud-native genomic dataframes and batch computing
### What happened? It might also be good to consider a better public-facing name. While nearly all jobs in Batch are scheduled on shared machines, a user sometimes wants a...
Right now, we perform a full scan in `to_dense_mt`, we have information to do less work and densify in a single pass. - Expose partitioning in python - For each...
### What happened? while trying to run the following code I get the error mention in the title (Invalid maximum heap size: -Xmx0m). import hail as hl hl.init(default_reference="GRCh38") However I...
### What happened? I’ve had multiple conversations now with users that don’t know how to get started with Query-on-Batch, and often are not aware of how such a thing would...
### What happened? Batch now has the ability to offer a metadata server endpoint in the network namespaces of a `DockerJob`. We should add this functionality to `JVMJob`s so that...
### What happened? We do not have a formal deprecation and removal process for Batch features. Users might not realize that they need to upgrade until they try to run...
### What happened? Batch does not guarantee that there is always at most 1 running attempt for a job at any given time. While rare, this double scheduling can sometimes...
### What happened? The infrastructure necessary to run a Hail Batch deployment (network, buckets, DB, Kubernetes cluster) are managed through Terraform in `infra/gcp` and `infra/azure`. In order to migrate terraform...
### What happened? Below is a high level overview of how the batch driver communicates scheduled jobs to worker nodes. Scheduling loop on the driver: 1. Select N ready jobs...
### What happened? See #14385 for details. The minimum supported TLS version for the `batch` and `CI` ABS storage accounts is 1.0, but since these are internal storage accounts, we...