Traditional Software Development

Operations goals:

• Server uptime;
• Application response time.

Traditional Software Development

Development goals:

• Faster development.           

Source: ITSM/Serena.com 2012 study of IT professionals

Traditional Software Development

What if we...

• Were faster in time-to-market by deploying more often?
• Didn't had to choose between stability and new features?
• Could increase our effectiveness?

DevOps

DevOps (Development and Operations) describes a culture in which business owners and the development, operations, and quality assurance departments collaborate to deliver software in a continuous manner and encourages practices to evolve to meet that culture focusing on business instead of departmental objectives. [Sharma and Coyne, 2015].

DevOps

DevOps

Automation

• Automate Code Testing;

• Automate Workflows;

• Automate Infrastructure.

Source:  Stephen Elliot, 2014 - DevOps and the Cost of Downtime: Fortune 1000 Best Practice Metrics Quantified 

DevOps metrics from 20+ Fortune 1000 organizations:

• Infrastructure failure costs $100,000 per hour;
• Critical application failure costs $500,000 to $1 million per hour;
• The number of deployments per month is expected to double in two years;
• During an application’s development, testing, deployment, and operations life cycle 25% of spent time is considered wasteful and unnecessary.
• DevOps-led projects will accelerate the delivery of functionalities to the customer by 15–20%.

IT operations statistics

The Road So Far

DevOps Categories

Cloud

Cloud

• Cloud Computing allows companies to consume computing resources as a utility;
• Companies no longer require  investment in hardware and people operating it;
• The same server can serve multiple applications depending the work hours of a country or continent.

About Cloud Providers

About Cloud Providers

Infrastructure Management

Infrastructure Management

Scheduling

0 6 * * 1-5
"At 06:00 on Mon, Tue, Wed, Thu and Fri."

5 0 * 8 *
"At 00:05 every day in Aug."

Scheduling

• Cron
• Chronos (Mesos)

UNIX's Cron Example:

Automation

Automation - Provisioning

The development environment should be as similar as possible to the production environment

• Ubuntu 16.04 LTS => python 3.5
• > Ubuntu 15.10  =>  python >3.4

Automation - Provisioning

Automation - Provisioning

Vagrant.configure(2) do |config|
  config.vm.box = "hashicorp/precise64"
  config.vm.provision :shell, path: "bootstrap.sh"
  config.vm.network :forwarded_port, guest: 80, host: 4567

  config.vm.provider :virtualbox do |vb|
    vb.customize [
      "modifyvm", :id,
      "--cpuexecutioncap", "50",
      "--memory", "256",
    ]
  end

  config.vm.provision :puppet do |puppet|
    puppet.manifests_path = "puppet/manifests"
    puppet.manifest_file = "site.pp"
    puppet.module_path = "puppet/modules"
  end
end

Automation - Test

Automation - Test

E2E Tools

Unit Testing Tools

TESTNG

Automation - Test

public class CalculatorTest {

  private Calculator classUnderTest;

  @Test
  public void testSubstract() {
    assertEquals("substract", 2, classUnderTest.substract(5, 3));
  }

  @Test
  public void testMultiply() {
    assertEquals("multiply", 56, classUnderTest.multiply(7, 8));
  }
}

Automation - Test

describe('adding user to application', function() {

  var random = browser.params.random;

  it('should fill and submit a user', function(){
    element(by.id('a_user_dropdown')).click();
    element(by.id('a_user_add')).click();

    expect(browser.getCurrentUrl()).toContain('users/add');

    element(by.model('form_user.name')).sendKeys('user' + random);
    element(by.model('form_user.username')).sendKeys('user'+ random);
    browser.params.handleSelect2('form_user.country', 'Portugal');
    element(by.model('form_user.email')).sendKeys('user' + random + '@gmail.com');
    element(by.model('form_user.password')).sendKeys('user' + random);
        
    element(by.id('btn_user_submit')).click();

    expect(browser.getCurrentUrl()).toEqual(browser.params.url + '/#/users');
  });
});

Automation - Deploy

Automation - Deploy

---
- hosts: webservers
  vars:
    http_port: 80
    max_clients: 200
  remote_user: root
  tasks:
  - name: ensure apache is at the latest version
    yum: name=httpd state=latest
  - name: write the apache config file
    template: src=/srv/httpd.j2 dest=/etc/httpd.conf
    notify:
    - restart apache
  - name: ensure apache is running (and enable it at boot)
    service: name=httpd state=started enabled=yes
  handlers:
    - name: restart apache
      service: name=httpd state=restarted

[webservers]
webserver1
webserver2
webserver3

[dbservers]
dbserver1
dbserver2

hosts.example

site.yml - Ansible Script

Automation - Roll Back

puppi rollback <project_name>

Puppi command - Puppet Module

deploy_revision 'name' do
  ...
  action :rollback
end

Chef Recipe

Automation - Applications

About Automation Tools

Monitoring

Monitoring - Servers/VMs

Information about:

• CPU;
• RAM;
• Disk space;

• Network traffic;
• Processes;
• Services;

Monitoring - Applications

• Application performance impacts:
  • SQL statements;
  • Specific code segments;
• ​Flag key transactions;​

Monitoring - R.U.M.

• Geolocation and load times of users;
• User's movement through the application;
• Find application bottlenecks;
• Application performance in real time;
• Javascript errors.

Monitoring - Applications

About Monitoring Tools

Supervision

Supervision

"In the early days of Reddit, we didn’t really have any crash protection. I used to have to sleep with my laptop and I would wake up every couple of hours and see if Reddit was working, and restart it. It was the worst feeling in the world." - Steve Huffman, Reddit Founder's

• Boot Application/Service at Boot;
• Ensure Application/Service is Running;
• Restart Application/Service if it fails.

Supervision

Loggers

Loggers

2016-06-14 17:44:15,814 DEBUG TcpListener - New connection accepted
2016-06-14 17:44:15,820 ERROR HttpServerConnection - Aborting encrypted 
connection to hostname.pt/192.168.1.1:46650 due to 
[SSLHandshakeException:Client requested protocol SSLv3 not enabled or not supported] -> 
[SSLHandshakeException:Client requested protocol SSLv3 not enabled or not supported]
2016-06-14 17:44:15,820 DEBUG HttpServerConnection - Connection was Aborted, awaiting TcpConnection termination...
2016-06-14 17:44:15,820 DEBUG HttpServerConnection - TcpConnection terminated, stopping

Loggers

Service Discovery

Service Discovery