Jacob Tomaw
2000: One-App, On-Demand
Mid 2001: One-App, Weekly
Spring 2002: Two-App, Weekly
Fall 2002: More Sites, Bi-Weekly
2005: Bi-weekly - technically
2006: Releases nearly halted
2006: Global Platform Refactoring
2010: Weekly, but...
2011: Bi-Weekly
Everything was under control
Business needs and wants us to take measured risk.
Technically comfortable with less than the best.
When everything is under control, you are not taking enough risk.
Transformed into a learning organization.
Innovate Sooner
Obstacles: A Sampling
10+ Teams - 100+ Contributors
Multiple Products
Lengthy Regression Testing
Compliance
Deployment Procedures
User Acceptance Testing
Third Party Integration
Evolving Infrastructure
Different Team Priorities
Large Change Sets
Practice
Team Effort
Pre-Prod
Prod
Roll Procedures
Can this remain in this environment?
Can this go to the next environment?
Existing Standards
Simple Deployment Procedures
Low Impact Deployment
Forwards or Back
A deployment is a deployment
Is the solution known?
Is the cost of the issue worth more than a deployment?
Roll Time
Roll Cost
Roll forward/Roll back variation
Certification Requirements
Product Owners
Dev<-->Ops communication is not perfect
Large Change Sets are bad
Roll Back Early
Be Ready to Re-Roll
Use the Rubric
Hidden Change Sets are worse
Use the Rubric
Architecture Has Improved
There is always another release
Have since further decoupled the releases
Applications and Process are now Independent
"Hardest" application has achieved the most
The System Worked!
Used the Rubric
Don't Let Perfect be the Enemy of the Good
Asymmetric Testing Requirements
Two Testing Environments with Limited Scope
Historic Procedure was too costly
Internal Cloud
Simplified Standard Deploys
Clearer Ownership
Infrastructure as a Service
On Demand Environments
Work in Progress
This is some of what we have done.
There are other problems we have not solved yet.
There are even more problems we don't know we need to solve.
You have your own things.
Everything changes
People
Market
Process
You
There is no Pre-Prod
Continuous Delivery Means Tearing Down more Silos
Empower Testers
Enable Product
Allow Specialists to focus
Build Rubrics.
Make more frequent release a normal part of work.
Plan for failure.
Have only Prod Environment.