cron.weekly issue #35: cgroups, sqlmap, etcd3, Elasticsearch, Charles, Packer & more!


cron.weekly is a newsletter about Linux, open source & webdevelopment. Want to get it in your inbox every Sunday? Subscribe below!

I respect your privacy and you won't get spam. Ever. Just a weekly-ish newsletter about Linux and open source.

Want to help support this blog? Try out Oh Dear, the best all-in-one monitoring tool for your entire website, co-founded by me (the guy that wrote this blogpost). Start with a 10-day trial, no strings attached.

We offer uptime monitoring, SSL checks, broken links checking, performance & cronjob monitoring, branded status pages & so much more. Try us out today!

Image of Mattias Geniar

Mattias Geniar, July 03, 2016

Follow me on Twitter as @mattiasgeniar

Welcome to_ __cron.weekly_ issue #35 for Sunday, July 3rd, 2016.

Once again, a packed edition! Sorry about last week, it seems using smilies and emoji’s in newsletter isn’t always the best plan. I learned my lesson, I’ll never smile again.

Enjoy this week’s issue!

And if you have a spare moment, I’d love to hear from you: what do you like, dislike, recommend, … If you like the newsletter, share it with friends & colleagues, it’s a great kick to see the newsletter grow in size every week!

News

Nike open source projects

Nike has open sourced a few projects. Mostly developer-oriented now, with frameworks for parsing JSON and tracing in Java, but it’s a very cool move from an otherwise rather close company. Can’t wait to see what else they release!

NASA Open Source Software

NASA also open sources many of their code and projects. Quite a few more than the Nike example, as you can tell by the scrollbar on the site.

DevOps vs SRE: delayed coverage of the dumbest war

Inspired by a presentation at VelocityConf, this post further dives into the roles of a “DevOps” vs a “Site Reliability Engineer” (SRE), a term coined by Google. Many arguments for skillsets to have when working at scale vs. skillsets most organisations are actually looking for, because they aren’t Google-sized.

Making (Github’s) open source data more available

All of Github’s data is now also available in Google’s BigQuery tables, allowing interesting queries to be run over all of Github’s open source projects.

This is a fun read for everyone that’s had the pleasure of maintaining a popular open source project. It describes all the emotional steps involved: being embarrassed to open source your code, frustration, anxiety for the burden of maintaining the project, …

Control Groups (cgroups) for the Web?

This is a proposal to take the concepts of cgroups on Linux, to limit and control resources, to the web. Soon, web browsers may get the same primitives that control CPU, memory, network and I/O as we do on Linux.

Come Together: a new video parody by Suse

The Suse team made another music cover: this time it’s The Beatles with “Come Together”. In case you missed it, a few months earlier they did a fabulous parody with Uptime Funk (“Don’t reboot it, just patch”)!

Tools & Projects

sqlmap

The sqlmap project turned 10 years last week, so a well-deserved mention here: sqlmap is an open source penetration testing tool that automates the process of detecting and exploiting SQL injection flaws and taking over of database servers. In short, it’s a scanner you can launch at any website (with permission!) and it’ll find SQL injection vulnerabilities.

Codemoji

This is a fun tool to learn and teach about encryption ciphers: by using an emoji substitution algoritme, you can “encode” and “decode” messages. Looks like a good way to teach kids about ciphers, too.

etcd3

etcd is a distributed, consistent key-value store for shared configuration and service discovery (like Consul), and the CoreOS team has just released version 3.0! The post highlights the efforts involved in moving from etcd2 to etcd3, the differences, how concurrency works and much more.

Turtl

Tired of paying Evernote as a document/note syncer? Turtl is a self-hosted, open source alternative. It lets you take notes, bookmark websites, and store documents for sensitive projects, all on your own hardware.

Docker Volume Driver for vSphere

If you run a VMware environment, this driver allows your Docker containers to consume vSphere storage (like vSAN, VMFS or NFS) directly. If you want to know more about Docker’s storage drivers, I recommend the podcast I recorded a few weeks ago about Docker.

Charles Proxy

Charles is an HTTP proxy / HTTP monitor / Reverse Proxy that enables a developer to view all of the HTTP and SSL / HTTPS traffic between their machine and the Internet. This includes requests, responses and the HTTP headers (which contain the cookies and caching information).

Guides & Tutorials

Anatomy of an Elasticsearch Cluster: Part I

A promising series! The first part describes the terminology, master vs. data nodes, the storage model of Elasticsearch and how basic CRUD (Create, Read, Update & Delete) operations work.

Papertrail: easily linking to logs

As a sysadmin, it’s your job to be as efficient as possible. Papertrail allows you to easily give developers or colleagues access to relevant logs to help them troubleshoot. No API or coding required, just an easy-to-customise URL, and they can see everything they need. (Sponsored)

Change your default Linux shell without root access

A good reminder that you can use the .profile file to customise your shell upon login, even replacing the shell altogether.

Managing passwords and security on your Linux server

A good guide on password management, monitoring login attempts, SSH ports and the like.

A Good Plan for building containers

This post describes some of the problems of Docker containers and introduces Habitat, a new tool to manage dependencies, with a “docker layer” on top of it. It keeps the Docker layers clean and focuses the container on just the bare minimum.

Introduction to performance analysis on openSUSE using Perf (video)

Many of these principles apply to other Linux distro’s too. A very good introduction to using the ‘perf’ tool and framework to troubleshoot performance issues on Linux.

Using Packer and Ansible to Build Immutable Infrastructure

This post introduces Ansible, Packer, Vagrant and containers to build “immutable” servers.

Writing good code: how to reduce the cognitive load of your code

With many of the sysadmins tasks moving to automation and config management, it becomes more and more important to structure the code you write and make it as readable and maintainable as possible. Whether that’s Ansible, Chef, Puppet or something else, this post has good examples of “easy to read code” you can inherit.

How to use Let’s Encrypt with multiple domains on Nginx

A step-by-step guide on getting multiple certificates issued using Let’s Encrypt (the free Certificate Authority) for use in Nginx.

Linux lockfile explained, how to use them the easy or hard way

This is a very good explanation of “lock files” in Linux and in which different forms they can come. Since a lot of tools use lock files, this is a good basic set of knowledge any Linux sysadmin should have.



Want to subscribe to the cron.weekly newsletter?

I write a weekly-ish newsletter on Linux, open source & webdevelopment called cron.weekly.

It features the latest news, guides & tutorials and new open source projects. You can sign up via email below.

No spam. Just some good, practical Linux & open source content.