Brave 

New

World

Goals

  • Replace old hardware
  • Virtualise
  • Clean up
  • Drop Wigwam
  • Upgrade Debian
  • Introduce config management
  • Speed up test->release cycle

Physical Hardware


Dell R515

  • Dual 8-core AMD CPUs
  • 128GB memory
  • RAID controller with 1GB cache
  • 6 x 1TB drives
    • RAID10
    • Empty bays for expansion



Architecture

KVM

  1. It's a Linux standard
  2. It's free
  3. Chris said so

 sudo apt-get install virt-manager

Layout

  • Servers split across yin/yang
  • Naming:
    • Flowers
      • lily, clover, lupin, poppy, etc
      • Run standard services
      • Debian 7
    • 'new'
      • newstage1, newdev, etc
      • P2V migrations
      • Debian 6
    • Dev VMs
      • Naming convention..?


Flower Servers

  • Servers are not named after services
  • Services are managed by Puppet
  • Data files are kept under /lokku/
  • Services are CNAMEs

 > host gitgit.lon.lokku.net is an alias for poppy.lon.lokku.net.poppy.lon.lokku.net has address 10.10.10.54
twiki           CNAME clover.lon.lokku.net.
proxy           CNAME yin.lon.lokku.net.
puppet          CNAME clover.lon.lokku.net.
smarthost       CNAME yin.lon.lokku.net.
svn             CNAME clover.lon.lokku.net.
www             CNAME poppy.lon.lokku.net.

Puppet / Standard Services

All hosts have the following:
  • Mail
  • Time (NTP for physical)
  • Full access to 
    • /lokku/ filesystems hosted on yin/yang
    • /home/ filesystems
  • DNS (including lon.lokku.net)
  • Users (dev team + service accounts)
  • APT configured (with proxy.lon.lokku.net:3128)
  • sudo
  • Standard packages



Migration

Service Migration / Creation

  • DNS
  • VPN
  • DHCP
  • Email (via sendgrid)
  • Backups
  • Puppet
  • Git
  • Subversion
  • Twiki
  • Trac
  • WWW - ops_duty - w3c validator
  • Local Debian repo
  • NTP
  • Proxy

Old Hardware

stage.lokku.net

lokku -> lokku@newstage1
nestoria-staged -> lokku@staged
nestoria-utils -> lokku@utils

dev.lokku.net

wigwam -> wigwam@newdev

lokku -> lokku@newdev


stage2.lokku.net


geobuild.lokku.net

What's Next?

  • Migrate lokku-shared into ~/code
  • Test /opt/lokku on 
    • newstage2 for Debian 6
    • newstage3 for Debian 7
  • Juan: 
    • Migrate awrtool to virtual
    • Move services from dev -> newdev
  • Migrate stage2
  • Turn off all the old hardware
  • Migrate geobuild to old stage hardware

Brave NEW WORLD

By chris_lokku

Brave NEW WORLD

  • 323