beekeeper icon indicating copy to clipboard operation
beekeeper copied to clipboard

Published 20 hours ago • verified publisher icon beeware

Investigate replacing AWS ECS with AWS EKS

Open freakboy3742 opened this issue 7 years ago • 5 comments

BeeKeeper currently uses AWS Elastic Container Service (ECS) to deploy build jobs. However, this is an AWS-specific API.

Amazon just announced EKS - Elastic Kubernetes Service - which would still be an Amazon service, but would allow us to use Kubernetes APIs, rather than proprietary AWS ones.

This should ultimately allow end users to run their own build clusters on their own machines, or deploy to infrastructure other than AWS.

We need someone to investigate the feasibility of this, and if it's plausible, implement a port to EKS (ideally abstracting away any AWS-specific API calls)

freakboy3742 avatar Nov 29 '17 23:11 freakboy3742

I'm interested in working on this.

bkarlovitz avatar Nov 30 '17 00:11 bkarlovitz

@bkarlovitz Then by all means - please have a shot! The internals of Beekeeper aren't all that well documented, but if you have any questions, or want to have a video chat to get you started, let me know!

freakboy3742 avatar Nov 30 '17 01:11 freakboy3742

@freakboy3742 I'll take a first look through everything and let you know here if I need anything to get going. Thanks!

bkarlovitz avatar Nov 30 '17 01:11 bkarlovitz

Hello! I did some digging, and have posted my notes on the wiki here: https://github.com/pybee/beekeeper/wiki/Notes-on-Getting-Beekeeper-on-Kubernetes

I'm going to keep plugging away, but there's at least a start.

phildini avatar May 20 '18 18:05 phildini

Also we probably want to explore https://kubernetes.io/docs/concepts/workloads/controllers/jobs-run-to-completion/

phildini avatar May 20 '18 18:05 phildini