GitHub to GitLab (r)Evolution
Continuous Integration ?
What it is not
What it is
A method of finding software bugs and defects as early as possible in the development cycle.
Something that can be bypassed because it takes too much time or effort.
Novasalt
Average test time: 1h30
Wait time: 0 to 4h
No distro matrix
Time wasted during provisionning
Solved by executing tests on a pre-built binary image, either by maintaining custom scripts, either OOTB with drone.io and gitlab-ci
Time wasted while waiting in queue
Solved by maintaining a CI infra with parallel build slots
Must grow continuously
CI Systems Landscape
- Jenkins
- Buildbot
- CruiseControl
- TeamCity
- Travis
- Drone.io
- Strider-CD
- GitLab-CI
- CircleCI
- Codeship
- Travis
Can 1 CI rule them all ?
Perhaps, if it meets all requirements of all projects:
- Sends feedback to the git tracker UI
- Test matrix
- Programable pipeline
- Does not require maintenance
- Is able to run on pre-provisioned systems
- Does not require waiting in line
- Can run on our VPN
CircleCI
28K/year
Dedicated box
3.6k/year
SaaS
+ no maintenance
- shared CPU: how secure ?
- shared RAM: how much ?
- shared bandwidth: how much ?
- developers waiting: how long ?
- closed source
- paid option for container cache
- cache over network: slow
- highly expensive
Dedicated
+ maintained by a hacker*
* that you already have when you need 48 executors of CI !
+ dedicated CPU
+ dedicated RAM: 256G
+ dedicated bandwidth: 1Gbps
+ CI *jumps* on patches
+ container cache on host
+ triple 1TB NVME SSD: fast !
+ super cheap
+ best ROI
+ Open Source
nomatch :)
Feature story
- User runs tests on patch
- Commits pushed in branch
- User waits for a turn in CI
- User waits for code review
- Approval is manual
- CI runs tests on patch (again)
- User rebases branch
- User merges OR
- User rebases branch again
- User commits on branch
- CI tests on the user machine
- Peers approve the patch
- User clicks rebase and merge
GitHub
GitLab
Extra Automation
In GitLab, User can also click to enable merge when CI and approvals validate the PR
Aprovals
Merge Methods
Fast-forward merge
No merge commits are created and all merges are fast-forwarded, which means that merging is only allowed if the branch has been rebased.
When the branch has not been rebased, the user is given the option to do so.
Git Hooks
Private container registry
Of course, for CI pre-provisioning !
Also: deployment pipelines
Distributing CI on developer machines
- The developer machine needs to be able to run tests exactly like in CI
- Why not publish the result directly ?
GitLab CI
Developer
Public Repository
Push commit
Request test execution on runner
Fork, register runner for fork
Publish runner logs and result
DEMO
Fork Project
Optionnal step, allowing me to run my own dedicated CI on my laptop, otherwise I can push in a branch of the main repo like on GitHub
Get the runner token
In my fork, settings:
Register runner
(Developer machine)
Git Push,
CI Started
Build history for commit anyone ?
On GitHub UI, only the last build is shown for 1 commit
No time wasted while waiting in line
No test on the developer machine is wasted or has to be re-run
Merge request
Prepare for OMFG
Merge request created
Rebasing onto master
Tests passed
Approving as James Pic
Approving as James Pitt
Merging as James Pic
Issue board
Scheduled for GitLab 8.10 (current: 8.8)
Performance
gitlab-workhorse is a proxy for HTTP and git pull/push
Cost
GitHub | GitLab |
---|---|
$108/user/year ($9 / month) + Jenkins maintenance + Container registry maintainance |
$39/user/year - includes CI - includes container registry |
2011: Start of GitLab
Dmitriy was unsatisfied with the options for git repository management. So together with Valery, he started to build GitLab as a solution for this.
2012: GitLab.com
Sid saw GitLab for the first time. He thought it was natural that a collaboration tool for programmers was open source. Being a Ruby programmer he checked out the source code and was impressed with the code quality of GitLab. He started GitLab.com as the first SaaS offering for GitLab.
In November 2012, Dmitriy also made the first version of GitLab CI.
2013: "I want to work on GitLab full time"
In 2013, Dmitriy tweeted that he wanted to work on GitLab full time. Sid and Dmitriy teamed up and started bootstrapping GitLab as a company.
In the same year in August, we introduced GitLab Enterprise Edition.
2014: GitLab was incorporated
In 2014 GitLab was officially incorporated as a limited liability corporation. GitLab released a new version every month on the 22nd, just as every year before and after. The first release of the year at January 22nd: GitLab 6.5. At the end of 2014, December 2014, GitLab 7.6 was released.
2015: Y Combinator
In the very start of 2015, almost the entire GitLab team flew over to Silicon Valley to participate in Y Combinator.
At this point, over 1000 people worldwide have contributed to GitLab and more than 100,000 organizations are using GitLab.
Logo
Our Tanuki logo symbolizes this with a smart animal that works in a group to achieve a common goal.
GitLab: Vision
At GitLab we have one vision. Everyone can contribute to all digital content.
To ensure that everyone can contribute to our organization we have open business processes that allow all team members to suggest improvements to our handbook.
Conclusion by Richard Stallman
GitLab
Y'a moins bien
mais c'est plus cher
GitLab: CI revolution
By James Pic
GitLab: CI revolution
- 2,762