HPCCloud-deploy
HPCCloud-deploy copied to clipboard
VM Deploy for HPC-Cloud
Note: The vagrant deployment will soon be depreciated. We will be moving to a containerized solution.
HPC Cloud / Cumulus VM Deploy
Linux
Example usage
ansible-playbook -vvvv \
--private-key ec2.pem \
-u ubuntu \
-i ansible/inventory/test \
ansible/site.yml \
-e girder_version=master \
-e cumulus_version=master
Local Installation
If VirtualBox, Vagrant and Ansible are installed, cumulus may also be deployed on a local virtual machine by running vagrant up
from the project root directory. Otherwise each of these components may be installed on 64 bit Ubuntu 14.04 as follows:
Install VirtualBox 5.0
First you must add the Oracle repository to Ubuntu's package manage apt
by executing the following commands:
wget -q http://download.virtualbox.org/virtualbox/debian/oracle_vbox.asc -O- | sudo apt-key add -
sudo sh -c 'echo "deb http://download.virtualbox.org/virtualbox/debian trusty contrib" >> /etc/apt/sources.list.d/virtualbox.list'
Then update and install virtualbox 5.0
sudo apt-get update && sudo apt-get install virtualbox-5.0
Install Ansible
Add the ansible repository to apt
and install ansible
sudo apt-get install software-properties-common
sudo apt-add-repository ppa:ansible/ansible
sudo apt-get update && sudo apt-get install ansible
Install Vagrant 1.8.1
Ubuntu's default version of vagrant (1.4.3) is nearly 2 years old, to use this deployment script you must have a newer version of vagrant installed. To do this download the following .deb
file and install it. important: if you already have vagrant installed, please do a sudo apt-get remove --purge vagrant
before running the following commands:
wget https://releases.hashicorp.com/vagrant/1.8.1/vagrant_1.8.1_x86_64.deb -O /tmp/vagrant_1.8.1_x86_64.deb
sudo dpkg --install /tmp/vagrant_1.8.1_x86_64.deb && rm /tmp/vagrant_1.8.1_x86_64.deb
Creating a HPCCloud VM
- Clone this repo
- Run
vagrant up
in the folder that you cloned this repository too - Point your browser to http://localhost:8888
##OSX
- Clone this repo
- Download and install the following in order:
- VirtualBox 5.0
- Vagrant 1.8.1
- Ansible -
sudo pip install ansible
- Run
vagrant up
in the folder that you cloned this repository too- It will err if there's anything already running on the ports it needs (definitely 8888, 8080, probably 27017)
#HPC traditional cluster requirements
In order to use a cluster with HPCCloud the following requirements need to be available:
-
The Bash shell.
-
The curl command line utility. On an Ubuntu distro this can be installed using the following command:
sudo apt-get install curl
-
ParaView is used for running visualization tasks on the cluster so needs to be installed, the latest release can be downloaded here. ParaView can also be build from source
Local Development Installation
if HPCCloud, girder, or cumulus are available in the folder above the HPCCloud-deploy checkout and the environment variable DEVELOPMENT
is set to 1, then these folders will be linked through the VM rather than checked out from github. E.g. with the directory structure:
./HPCCloud-deploy/
Vagrantfile
ansible/
...
./cumulus/
...
./hpccloud/
...
./girder/
...
running DEVELOPMENT=1 vagrant up
from within the HPCCloud-deploy/
folder will link cumulus, hpccloud and girder folders. This should allow those folders to be changed locally, and for those changes to be picked up on restart from within the VM. Note: if a folder is not available it will be checkout from github. the HPCCloud folder must be lowercase!