ci-matters icon indicating copy to clipboard operation
ci-matters copied to clipboard

Integration (comparison) of different continuous integration services on Android project

ci-matters

Integration (comparison) of different continuous integration services on Android project.

CI's integration

  • [x] Jenkins
  • [x] Travis CI Build Status
  • [x] Bitrise Build Status
  • [x] TeamCity
  • [x] BuddyBuild BuddyBuild
  • [x] Shippable Run Status Coverage Badge
  • [x] Circle CircleCI
  • [x] GitHub Actions

TODO

  • [ ] Nevercode.io
  • [ ] Gitlab CI
  • [ ] Drone.io

Comparison

Comparison table

This table should help people make a decision which CI to choose for the project.

CI :dancers:,:construction_worker:,:mag_right::bug:,:vertical_traffic_light:,:mailbox_with_mail: :iphone::eyes: :rocket: :page_facing_up: :chart_with_upwards_trend: :bust_in_silhouette::raised_hands:/:cloud: :radio:/:computer: :dollar:
Jenkins :star: :star: :star: :star: :star: :bust_in_silhouette::raised_hands: :radio:/:computer: :free:
TeamCity :star: :star: :star: :star: :star: :bust_in_silhouette::raised_hands:/:cloud: :computer: :moneybag::moneybag::moneybag:
Travis CI :star: :star: :star: :star: :x: :cloud: :computer: :moneybag::moneybag:
Bitrise :star: :star: :star: :star: :x: :cloud: :computer: :moneybag::moneybag:
Shippable :star: :star: :star: :star: :x: :cloud: :radio: :moneybag:
Circle CI :star: :star: :star: :star: :x: :cloud: :computer: :moneybag::moneybag:
Buddybuild :star: :star: :x: :x: :x: :cloud: :computer: :moneybag::moneybag:
GitHub Actions :star: :star: :star: :star: :x: :cloud: :computer: :free:
Gitlab CI . . . . . . . :moneybag:
Nevecode.io . . . . . . . :moneybag::moneybag:
Drone.io . . . . . . . :moneybag:
. . . . . . . .
:dancers: clone
:construction_worker: build
:mag_right::bug: test
:vertical_traffic_light: analyse
:mailbox_with_mail: notify
:iphone::eyes: UI tests :rocket: deploy :page_facing_up: configuration file :chart_with_upwards_trend: visual reports :bust_in_silhouette::raised_hands:/:cloud: self-hosted/cloud :radio:/:computer: CI user interface (old/new) :dollar: price

Pricing

All listed CI's provide free plan with some restrictions like "open-source projects only" or "only 1 build node", but it's enough to configure the build process and check if CI suits or not.

Free plans

Choosing a free plan for a project is more suitable for a freelance project. Usually, some services provide limits on such plans for understandable reasons.

Paid plans

CI's have different approaches and different paid plans. Check every CI pricing information for more details and choose the best option for you.

:warning: This information can get outdated very quickly as services evolve. :warning:

What might matter is the starting price for paid plan:

  • Jenkins - starts with X$. (paid version (Cloudbees), no public information)
  • Travis CI - starts with 69$/month. (1 concurrent build, ∞ projects, ∞ build time)
  • Bitrise - starts with 50$/month. (1 concurrent build, ∞ projects, 45 min. max build time)
  • TeamCity - starts with 299$. (4 concurrent builds, 30 project configurations, ∞ build time)
  • Shippable - starts with 25$/month. (2 concurrent builds, ∞ projects, ∞ build time)
  • Gitlab CI - starts with 15$/month. (2 concurrent builds, ∞ projects, ∞ build time)
  • Circle CI - starts with 39$/month. (2 concurrent builds, ∞ projects, 500 minutes build time per month)
  • Nevercode.io - starts with 5$/month. (1 concurrent build, ∞ projects, 90 min. max build time)
  • Drone.io - starts with 25$/month. (1 concurrent build, 5 private projects, ∞ build time)
  • Buddybuild - starts with 79$/month. (1 concurrent build, ∞ projects, ∞ build time)

Presentation

I gave a talk back in 2016 and this repository was a technical part for it. I am describing there configured CI's and providing my personal opinion about which CI to choose depending on your needs (in :ru: language ).

It doesn't contain information about ALL existing CI services, but should be a good start.

CI comparison presentation

In few words:


Checkstyle

Project uses custom Checkstyle rules.


Fabric/Crashlytics project configuration

In order to upload APK to Crashlytics project should have following configuration: ${projectDir}/fabric.properties file with apiSecret and io.fabric.ApiKey in AndroidManifest.xml(1, 2) file. Both keys should not be uploaded to the repository for security reasons!

Pass both parameters to your build from command line:

./gradlew -PfabricApiKey="YOUR_API_KEY" -PfabricApiSecret="YOUR_API_SECRET" crashlyticsUploadDistributionDebug

or export these keys as environment variables on a build machine and they will be automatically read from there during the build (no need to pass keys as parameters in this case).


Coveralls

Coverage Status

Coveralls provides test coverage information. COVERALLS_REPO_TOKEN environment variable should be exported on the build machine.