iceberg
iceberg copied to clipboard
A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
Convert https://github.com/stelligent/dromedary/tree/master/pipeline to use https://github.com/stelligent/stelligent_pipelines. This will likely require some modifications to [stelligent_pipelines](https://github.com/stelligent/stelligent_pipelines). The idea behind [stelligent_pipelines](https://github.com/stelligent/stelligent_pipelines) is that it's supposed to support pipelines for various infrastructure types and applications/services....
Now that we're using nested CloudFormation stacks for most of Dromedary, we no longer need to use many of the shell scripts that we're being used to manage stack creation/deletion...
Automated as much of the process as possible that's described here: https://github.com/stelligent/dromedary#configure-jenkins-security (providing password as an environment variable or other input)
Determine if Jenkins AMI exists and it’s the correct version; otherwise, it will launch Packer. Jenkins is maintained in https://github.com/stelligent/tophat
the `dromedary-accountId` (where accountid is the AWS account number) bucket is a requirement of Dromedary as whole, though the system does not create it.
People just running the Dromedary stack can use the publicly-available S3 bucket to run the stacks without additional setup (assuming we keep it up to date). But, if they want...
To improve demo speed, use a CloudFormation condition to display certain CodePipeline actions (and, perhaps, entire Stages?)
If we can run the [Jenkins configuration](https://github.com/stelligent/dromedary/blob/master/bin/configure-jenkins.sh) in Lambda, we wouldn't need to launch a "transient" EC2 instance (it actually doesn't get terminated) that's not currently in a VPC. The...
Regularly launch the https://github.com/stelligent/dromedary/blob/master/pipeline/cfn/dromedary-master.json (or equivalent) per branch from CloudFormation
Do this in CFN. So that we don't have to SSH into the instance to get simple answers.