DEVOPS WEEKLY ISSUE #147 - 27th October 2013
Several posts this week touching on service discovery in distributed systems. It feels like with easier to use tools like Serf, and lower level systems like etcd we’re approaching a point where this will become, if not easy, then at least available to everyone. I’m pretty interested in how that changes the overall systems we design and build for do send me links about that if you come across any.
Sponsor
Devops Weekly is sponsored by Brightbox Cloud - launch cloud servers in multiple UK datacentres in seconds…
http://brightbox.com
News
A excellent piece about team structures that support a devops approach. Good examples of why different structures work, and examples of others that don’t.
http://blog.matthewskelton.net/2013/10/22/what-team-structure-is-right-for-devops-to-flourish/
Knight Capital managed to lose $460m due to a software problem last year, and the administrative proceedings from the SEC litigation have been published. Anyone interested in how systems fail should read the full report, but the blog post highlights a few interesting parts.
http://pythonsweetness.tumblr.com/post/64740079543/how-to-lose-172-222-a-second-for-45-minutes
http://www.sec.gov/litigation/admin/2013/34-70694.pdf
Powershell has a number of nice features and with the release of Powershell 4 it has introduced Desired State Configuration (DSC). This works in a very similar way to Puppet or Chef, with the ability to regularly check a central source for configuration information.
http://redmondmag.com/blogs/it-decision-maker/2013/06/desired-state-configuration.aspx
Good slides explaining some of the advantages of a micro-services architecture, as well as discussing why functional programming works well in this context.
http://www.slideshare.net/michaelneale/microservices-and-functional-programming
A good list of practices and problems to overcome when adopting devops in an organisation, focusing on some of the challenges found in a larger, more traditional, company.
http://www.infoq.com/articles/pivot-beyond-pockets
Interesting use of DNS for service discovery. Discusses implementing a custom DNS server which uses SRV records to announce services and a simple JSON post to the DNS server to announce availability and update TTL on the DNS record.
http://blog.gopheracademy.com/skydns
A blog post about evolving a deployment and code merging strategy, specifically using CircleCI. Includes code examples and a good explanation of how the team incorporate deployment in their workflow.
http://blog.mightyhive.com/post/64729152708/faster-than-you-read-this-simple-deployments-with
Jobs
FreeAgent are looking for a talented Operations Engineer to work on the FreeAgent app, internal services and supporting infrastructure. You’ll be working alongside our (remote) Ops team squashing single points of failure, fixing bottlenecks, profiling load and solving interesting scaling and automation problems.
http://www.freeagent.com/company/jobs/operations-engineer
Tools
Serf is described as decentralized solution for service discovery and orchestration that is lightweight, highly available, and fault tolerant. Lots of use cases from datastore clustering, load balancing web servers or triggering events across a dynamic cluster.
http://www.serfdom.io/
confd is a lightweight configuration management tool focused on keeping local configuration files up-to-date by polling etcd and processing template resources and reloading applications to pick up new config file changes.
https://github.com/kelseyhightower/confd
The latest release of Collectd now supports collecting metrics via the StatsD protocol. If you’re running both statsd and collectd you may be able to run only the latter.
https://collectd.org/wiki/index.php/Plugin:StatsD