{"id":5204,"date":"2014-05-02T16:14:48","date_gmt":"2014-05-03T00:14:48","guid":{"rendered":"http:\/\/www.chesnok.com\/daily\/?p=5204"},"modified":"2014-05-02T16:39:14","modified_gmt":"2014-05-03T00:39:14","slug":"release-engineering-a-draft-of-an-architecture-diagram","status":"publish","type":"post","link":"https:\/\/www.chesnok.com\/daily\/2014\/05\/02\/release-engineering-a-draft-of-an-architecture-diagram\/","title":{"rendered":"Release Engineering: A draft of an architecture diagram"},"content":{"rendered":"<p>One of the things that I like to do is create architecture diagrams of complicated systems.<\/p>\n<p>We had Release Engineering and Release Operations in the Portland Mozilla office this week, providing a perfect opportunity to pick everyone&#8217;s brains about what the current state of our release infrastructure is like.<\/p>\n<p>Behold: <a href=\"http:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-300x231.png\" alt=\"releng flow onepage\" width=\"300\" height=\"231\" class=\"aligncenter size-medium wp-image-5207\" srcset=\"https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-300x231.png 300w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-1024x791.png 1024w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-520x401.png 520w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage.png 1056w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>And here&#8217;s a version that includes some &#8220;tree closure reasons&#8221; in magenta:<\/p>\n<p><a href=\"http:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons-300x231.png\" alt=\"Releng infra with tree closure reason codes\" width=\"300\" height=\"231\" class=\"aligncenter size-medium wp-image-5205\" srcset=\"https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons-300x231.png 300w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons-1024x791.png 1024w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons-520x401.png 520w, https:\/\/www.chesnok.com\/daily\/wp-content\/uploads\/2014\/05\/releng-flow-onepage-treeclosure-reasons.png 1056w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>A tree closure is defined as an hg hook that prevents people from committing to a tree (like mozilla-central). It looks up status at <a href=\"http:\/\/treestatus.mozilla.org\">treestatus.mozilla.org<\/a> to figure out whether or not the tree is closed, and this value is updated manually by &#8220;sheriffs&#8221; who track tree status.<\/p>\n<p>And the an initial key to the tree closure reasons (the numbers on the magenta blobs), is documented on the <a href=\"https:\/\/wiki.mozilla.org\/ReleaseEngineering\/OverviewArchitectureDiagram\">Mozilla wiki<\/a>.<\/p>\n<p>The goal of this document was to take brain dump information from everyone in the meeting, and create a relationship diagram of all the systems that everyone here supports. As you can see, it is pretty complex.<\/p>\n<p>What I took away from creating this was:<\/p>\n<ul>\n<li>The cognitive load is very high for trying to diagnose the root cause for several kinds of tree closures.<\/li>\n<li>People loved being able to look at how each systems related to the others.<\/li>\n<li>No single person really had a model in their head of how everything represented in this diagram was related.<\/li>\n<\/ul>\n<p>There&#8217;s a lot more work to do to link in documentation and create some related diagrams, which I&#8217;ll tackle next week. The kinds of questions I&#8217;d like to try to answer based on the information that I&#8217;ve gathered include:<\/p>\n<ul>\n<li>How does my patch get a build created for it? <\/li>\n<li>What single points of failure can we mitigate? <\/li>\n<li>What kinds of resilience do we need for our typical transient failures?<\/li>\n<\/ul>\n<p>I really enjoyed identifying sources of tree closure and the kinds of failures that cause it. These are the kinds of problems I love working on solving &#8212; complicated, often unpredictable and largely driven by the normal work that people need to do to get their jobs done. There&#8217;s rarely a simple solution to things like experimental patches taking down large portions of a build infrastructure, and how we solve, or at least mitigate, these problems is fascinating.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the things that I like to do is create architecture diagrams of complicated systems. We had Release Engineering and Release Operations in the Portland Mozilla office this week, providing a perfect opportunity to pick everyone&#8217;s brains about what &hellip; <a href=\"https:\/\/www.chesnok.com\/daily\/2014\/05\/02\/release-engineering-a-draft-of-an-architecture-diagram\/\">Continue reading &rarr;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[609],"tags":[607,610,669],"class_list":["post-5204","post","type-post","status-publish","format-standard","hentry","category-releng","tag-mozilla","tag-release-engineering","tag-releng"],"_links":{"self":[{"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/posts\/5204","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/comments?post=5204"}],"version-history":[{"count":6,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/posts\/5204\/revisions"}],"predecessor-version":[{"id":5213,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/posts\/5204\/revisions\/5213"}],"wp:attachment":[{"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/media?parent=5204"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/categories?post=5204"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.chesnok.com\/daily\/wp-json\/wp\/v2\/tags?post=5204"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}