Rollback remarks
gergo.toth
"emarsys deployer"
may.eighteen
post mortem
may.eighteen
01
02
03
snapshot
validate
production
01
snapshot
02
validate
deploy to prod-like env
activation test
03
production
deploy 15 env
monitoring
D-06
innocent commit
D-05
D-04
rm: cannot remove
permission denied
D-03
D-day
may.eighteen
01
02
snapshot
validate
03
deploy to production
.
.
.
.
10:20
monitoring
10:23
mail sending errors
10:26
ROLLBACK
10:20
ROLLBACK
20160518
20160513
20160512
20160513
20160518
10:26
rollback env1-6
10:28
blank page on env1-6
10:31
loadbalancer
10:40
reroute traffic
10:40
re-deploy
10:55
back to normal
10:20
10:55
15 million email
half million contact
27.000
push msg
post mortem
2
D+01
20160518
20160513
20160512
20160511
20160510
ls -ltd
20160510
20160511
20160513
20160512
20160518
ls -ltd
20160510
20160511
20160513
20160512
20160518
20160510
20160518
post mortem
2
D+01
D+133
automatic deployment and monitoring
"Why do we fall?
So we can learn to pick ourselves up."
