Gregory Chomatas @gchomatas
PaaS team
Thales of Miletus - 624 BC
Those who can, do, the others philosophise... Really?
Miletus
Invest in a Mesos-powered PaaS and keep doing what you love most; building your product
* Optionality is the property of asymmetric upside (preferably unlimited) with corresponding limited downside (preferably tiny)
Blogging
SEO
Social Media
CMS
Lead Management
Landing Pages
Calls-to-Action
Marketing Automation
Analytics
CRM Sync
12-factor apps
.net monolith to microservices
Small, autonomous teams with end-to-end ownership - no ops
~100 engineers
800+ components that can be updated/scaled independently
QA: ~400 small to medium AWS machines
PROD: ~750 medium to large AWS machines
Source: Martin Fowler
http://martinfowler.com/bliki/MicroservicePremium.html
1. Develop locally
2. Provision QA aws instance
3. Deploy via local Python script
4. Provision PROD aws instance
5. Deploy via local Python script
6. Repeat 4 & 5 to scale
…
10. Repeat 4&5 at 4am to replace hw
High operational overhead
Poor utilisation & elasticity
Higher rate of failures
Abstract away machines
Homogenous environment
Scale out in seconds
Centralized deployables registry
Sept 2013: Our First Mesos Cluster
To Boldly go...to Singularity
Great UI & HTTP API
Native Docker Support
Health Checks
Load Balancing API
Log Maintenance
Oct 2013: Start building Singularity
Security / artifact signature verification
Agent & Rack maintenance
Webhooks
Auto-rollback
Email Notifications
Executor cleanup
Singularity Components
BUILD
DEPLOY
RUN
Jenkins
Orion
Singularity
buildpack runner
S3
Stateful Services
Single Process services
Hard coded stationary hosts
Cgroups memory isolation
User resistance
All eggs in one basket
Mesos / Framework issues (pingback port)
Failures (Zookeeper, Mesos, Singularity)
Cluster Maintenance
Missing features
Phased rollout of new Kernel, Instance types
Rolling upgrade of instance basic SW with puppet vars
Rolling upgrade of master/agent process with ansible
Local testing on docker cluster
Roll out at infra-QA then product-QA and last to Production cluster
Deploy tools deploy themselves but maintain command line alternative with fabric
Singularity
Ghidorah - Load Balancers in Mesos
Massive Builds in Mesos
Baragon - Tasks Load Balancer Manager
Mesos Spark Cluster
Source: Mark Leslie (http://firstround.com/review/The-Arc-of-Company-Life-and-How-to-Prolong-It/)