dockernized-digdag-server
dockernized-digdag-server copied to clipboard
Dockerfile to run digdag-server on Amazon ECS
trafficstars
dockernized-digdag-server
Dockerfile to run digdag-server on Amazon ECS.
The dockerfile is based on one in this repository.
Pull and Run Docker image in Dockerhub
You can used our prepared docker image in Dockerhub.
docker pull myui/digdag-server:latest
docker run -p 65432:65432 myui/digdag-server
http://localhost:65432/
Pushing image to Amazon ECR
1. login to ECS
eval $(aws ecr get-login --region us-east-1 --profile ${YOUR_PROFILE} --no-include-email)
2. build a docker image
docker build -t ${YOUR_REPOS}/digdag-server -f Dockerfile .
${YOUR_REPOS}/digdag-server is ECR repository name
3. Push a docker image to ECR
docker tag ${YOUR_REPOS}/digdag-server:latest xxxxxxxxxx.dkr.ecr.us-east-1.amazonaws.com/${YOUR_REPOS}/digdag-server
docker push xxxxxxxxxx.dkr.ecr.us-east-1.amazonaws.com/ml-api/digdag-server
Run docker image on ECS
You can run digdag-server instance on ECR GUI.
CLI command to appear.
Connect from DigDag client
1. Configure client endpoint to the docker server
cat ~/.config/digdag/config
client.http.endpoint = http://ec2-aaa-bbb-ccc-ddd.compute-1.amazonaws.com:65432
2. Connect to Digdag server
digdag sessions
digdag push hackathon-project
Environment
If you don't set the env, digdag use the default env.
| name | default | description |
|---|---|---|
| DB_TYPE | memory | exp.) postgresql |
| DB_USER | digdag | for postgresql |
| DB_PASSWORD | digdag | for postgresql |
| DB_HOST | 127.0.0.1 | for postgresql |
| DB_PORT | 5432 | for postgresql |
| DB_NAME | digdag | for postgresql |