Everything from data engineering to Serverless operations and consensus algorithms to Kubernetes this week.

StackHawk sponsors Devops Weekly

Did you catch the news? StackHawk now offers a free Developer Plan. Getting up and running with application security testing has never been easier. Give it a try.
https://sthwk.com/free-plan

News

There are lots of tools for storing data, but how do you find the right dataset for analysis? This post explores a number of different architectural approaches and discusses pros and cons.
https://engineering.linkedin.com/blog/2020/datahub-popular-metadata-architectures-explained

A good writeup from a recent AWS reInvent talk focused on AWS’s Serverless services. This post focused on what this means for operations, which is often neatly ignored in the marketing.
https://www.stackery.io/blog/reinvent-2020-serverless-leadership-recap/

Related to a large CDN outage, this post looks at some of the theory behind the RAFT consensus algorithm, and whether it provides liveness guareeness during network failures and what can be done about it.
https://decentralizedthoughts.github.io/2020-12-12-raft-liveness-full-omission/

This long read introduces YOLOSec and FOMOSec as terms to describe problematic but all-to-common approaches to security strategy, driven either by short-termism or by chasing fashion.
https://swagitda.com/blog/posts/on-yolosec-and-fomosec/

More and more teams are now needing to manage multiple Kubernetes clusters. This post takes a look at the monitoring challenges that brings, and how to solve them with Prometheus and Grafana.
https://inlets.dev/blog/2020/12/15/multi-cluster-monitoring.html

A post exploring DNS routing in Kubernetes, stepping through several potential solutions to a specific problem.
https://wgtwo.com/blog/forbidden-lore-hacking-dns-routing-for-k8s

Ensuring SSL certificates don’t expire is an essential if annoying problem, and several services exist to help. This post runs down a list of different solutions.
https://sematext.com/blog/ssl-certificate-monitoring/

A look at building a Kubernetes-based platform using Argo Workflows and Argo Events.
https://tomas-valasek.medium.com/building-kubernetes-clusters-using-kubernetes-dde332c77d65