batch-shipyard
batch-shipyard copied to clipboard
Simplify HPC and Batch workloads on Azure
#### Problem Description I am trying to run a simple OpenMPI test code using mpi4py and this docker image (aalati/mpi_ex_mit). The container includes a python script with mpi4py that checks...
I would like to use YAML anchors and aliases to help us simplify repeated configuration When I add node above job_specifications ``` docker_image_definition: &docker_image_definition docker_image: ****.azurecr.io/*** ``` I get an...
#### Problem Description If I deploy a pool with Standard_NC4as_T4_v3 without the `gpu:nvidia_driver:source` specification in pool.yaml, the pool succeeds but the NVIDIA drivers are not installed. If I specify `gpu:nvidia_driver:source`,...
'custom' tasks can have named placeholders to be applied to the 'command' Issue: https://github.com/Azure/batch-shipyard/issues/374 ### Pull Request Checklist - [x] Review the [contributing guidelines](https://github.com/Azure/batch-shipyard/blob/master/CONTRIBUTING.md) - [x] Outstanding issue linked, if...
#### Improvement Request Description - When the `generate` yields a tuple with more than a handful of elements to be applied to the task's `command` it is hard to read/understand...
#### Problem Description When initiating a pool with shipyard pool add, using the microsoft-azure-batch publisher 20-04-lts ubuntu image, the python executable is not available in the newly created node's $PATH...
#### Problem Description Currently we cannot configure completion condition behavior of merge task, it will always default to tasksuccess. However, in my use case it can happen that the merge...
Following the TensorFlow CPU quickstart, I run into a couple of issues 1. When creating the pool, I get a > RuntimeError: Could not find an Azure Batch Node Agent...
I have a question about using a service principal to access a storage account that lives in a different subscription to the subscription of my batch account. I have the...
Publish to pypi checklist: - [ ] `pykwalify` requirements changes (1.7.1+) - [ ] Create setup.py - [ ] Migrate requirements.txt - [ ] Add `entry_points` - [ ] Add...