Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Put a Button on it: Removing Barriers to Going Fast.

Bfd6b681ec6e8c9bef82ff0521c364f7?s=47 kastner
September 26, 2011
Technology
56
2k

Put a Button on it: Removing Barriers to Going Fast.

For most companies, pushing code to production is a slow and painful process that can span hours or days, and is done very infrequently because of this and other general anxieties behind public facing launches. At Etsy, we built a tool called Deployinator to make it a painless process for everyone to push code at will. We pair this with a suite of tests, graphs, and metrics to make high velocity change safe and transparent.

Bfd6b681ec6e8c9bef82ff0521c364f7?s=128

kastner

September 26, 2011
Tweet

More Decks by kastner

See All by kastner
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
0
280
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
5
150

Other Decks in Technology

See All in Technology
842515eaf8fbb2dfcc75197e7797dc15?s=48 sat
0
180
195f71c8183f8d27da66aa0618f293b6?s=48 task4233
17
12k
3ac512f1cbab89f8671ff4718f23d150?s=48 takewell
0
260
53850955f15249a1a9dc49df6113e400?s=48 line_developers
PRO
4
280
Cd931bc05e7cee46b9a950a63e47ba4c?s=48 you
0
150
2037978e199b5947c8304d0435de9944?s=48 irisuinwl
0
410
7cd783377515bdf8207062840b7b2f4e?s=48 soracom
PRO
0
250
3235eeacb4ddecfba39e1eee75069da2?s=48 taksan0
0
130
2cf373725ded741824c50fd571eda6e1?s=48 udzura
0
100
E0db06b2e246ef948efc84bfc3909117?s=48 stkzk3110
0
450
966e29b84ae7dbde170f66b0bc75b7a6?s=48 ishiayaya
0
190
B1bddcb899ec3060fe9913f3cb70dbb6?s=48 lmt_swallow
4
1.2k

Featured

See All Featured
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
147
20k
245cee81a9c424266e5e401d844ea881?s=48 lara
595
62k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
253
11k
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
98
15k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
277
17k
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
350
20k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
105
11k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
364
63k
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
10
730
812e1705ff0f8bc1bcf18587bde687d5?s=48 62gerente
593
210k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
297
39k
5b6a2bd86ef643786a381a212e0ef2f1?s=48 geoffreycrofte
41
1.5k

Transcript

  1. [email protected] / @kastner [email protected] / @johngoulah Put a Button on

    it Removing Barriers to Going Fast
  2. None

  3. 1+ Billion Pageviews Per Month

  4. Speed

  5. ~80 Engineers

  6. Barriers

  7. Deployinator

  8. None

  9. We’re Hiring http://etsy.com/jobs

  10. None

  11. Optimization

  12. Happiness

  13. Sad Engineers are Bad Engineers

  14. Barriers

  15. Process

  16. “Process is an embedded reaction to prior stupidity” – Clay

    Shirky

  17. Fear

  18. None

  19. Correctness

  20. Text "My strategy has always been: be wrong as fast

    as we can, Which basically means, we're gonna screw up, … Let's not be afraid of that." – Andrew Stanton

  21. Legacy

  22. How?

  23. Communication

  24. Trust

  25. Openness

  26. Constant Improvement

  27. Then vs. Now

  28. 2009

  29. 2009 2011

  30. 2009 Single Deploy Master

  31. 2009 2011 Single Deploy Master Anyone Can Deploy

  32. 2009 Rollback in Fear

  33. 2009 2011 Rollback in Fear Roll Forward to Victory

  34. 2009 All Day Deploys

  35. 2009 2011 All Day Deploys Deploy All Day

  36. How… for reals

  37. So, what does Etsy optimize for?

  38. MTTR vs. MTBF

  39. Default to Open

  40. Culture First

  41. If it’s your first day at Etsy, you must deploy!

  42. None

  43. Doing the dumbest thing that can possibly work

  44. Committing to Trunk

  45. Branching in Code

  46. if ($cfg["new_search"]) { // new hotness $resp = search_solr(); }

    else { // old busted $resp = search_grep(); }

  47. Configuration is Code

  48. $cfg["new_search"] = true;

  49. Blameless Post-mortems

  50. Databases are Different

  51. Does it Work?

  52. None
  53. None

  54. 6 Change-related incidents in 2010

  55. November code-freeze

  56. November code-freeze 721 Deploys

  57. Deployinator

  58. None
  59. None
  60. None

  61. Capistrano

  62. Puppet Capistrano

  63. Fabric Puppet Capistrano

  64. Fabric Chef Puppet Capistrano

  65. None
  66. None
  67. None
  68. None
  69. None

  70. “Framework”

  71. STACK=search rake new_stack

  72. run_cmd %Q{cap deploy}

  73. log_and_stream "Starting Web deploy<br>"

  74. log_and_shout({ :old_build => old_build, :build => build, :send_email => true

    })

  75. Communication

  76. None
  77. None
  78. None
  79. None
  80. None
  81. None

  82. Dashboard Driven Development

  83. None

  84. 5:27 < devbot> PRODUCTION deployed by vthommeret version: 7f08b7a-20110722-191739-UTC took:

    131.042598 seconds diff: http://deployinator.etsycorp.com/diff/web/0cbf2f0/7f08b7a

  85. Etsy Confidential

  86. Deployinator Deploy Host Web 1 Web 2 Web N

  87. Deployinator Deploy Host Web 1 Web 2 Web N ssh

  88. Deployinator Deploy Host Web 1 Web 2 Web N ssh

    dsh

  89. Deployinator Deploy Host Web 1 Web 2 Web N ssh

    dsh

  90. Deployinator Deploy Host Web 1 Web 2 Web N ssh

    dsh Rsync

  91. What’s Stopping You?

  92. Know what you’re optimizing for

  93. Deployinator is Open Source Software!

  94. Deployinator is Open Source Software! http://github.com/etsy/deployinator

  95. Deployinator is Open Source Software! http://github.com/etsy/deployinator (right after this talk)

  96. Thank you

  97. Thank you http://github.com/etsy/deployinator