DEVOPS WEEKLY ISSUE #567 - 7th November 2021
Two posts this week on large scale CI systems, and the interesting engineering around them. Also a great post on building trust in complex systems, a new Lua-derived embeddable language and some good observability links too.
StackHawk sponsors Devops Weekly
All of our quality testing has been automated in CI/CD. So why hasn’t security? Learn what keeps security from shifting left:
https://sthwk.com/ci-pipeline
News
An excellent post on the subtleties of building trust in systems, including the technical systems and the people that make complex software work.
https://medium.com/mercadona-tech/in-our-systems-we-trust-cb92cfb43417
Another great post, this one on a long term effort to reduce the cost and improve the developer experience of a large, and growing, CI infrastructure.
https://slack.engineering/infrastructure-observability-for-changing-the-spend-curve/
A new programming language based on Lua! Luau is described as a fast, small, safe, gradually typed embeddable scripting language. Lots of use cases for this, I hope it attracts an active community.
https://luau-lang.org/2021/11/03/luau-goes-open-source.html
https://github.com/Roblox/luau
CI systems are so key to modern software development that some companies develop their own custom solutions. Not something most folks should do, but an interesting post from one team that took the custom approach.
https://databricks.com/blog/2021/10/14/developing-databricks-runbot-ci-solution.html
A handy list of observability themed talks from the recent KubeCon event. Compiled by https://monitoring.love.
https://www.youtube.com/playlist?list=PLGJrMkJUF3M1uLHaTpHdZgTzQUGl1CDdP
Nginx was always one of my favourite bits of software to manage. This post looks into how to monitor it and provides an overview of various mainly SaaS solutions that can help, written by one of those SaaS providers.
https://sematext.com/blog/nginx-monitoring/
A post introducing the monitoring golden signals (latency, traffic, errors and saturation) from first principles.
https://dev.to/squadcast/golden-signals-monitoring-from-first-principles-kpn
Tools
A useful public GitHub template for bootstrapping an AWS EKS cluster using Terraform. Good accompanying blog post as well about the usefulness of such boilerplate templates.
https://maddevs.io/insights/blog/terraform-aws-eks/
https://github.com/maddevsio/aws-eks-base