cron.weekly issue #46: Kimchi, MySQL, Zabbix, Varnish, Logtrail, Swift, DHCP & more!


cron.weekly is a newsletter about Linux, open source & webdevelopment. Want to get it in your inbox every Sunday? Subscribe below!

I respect your privacy and you won't get spam. Ever. Just a weekly-ish newsletter about Linux and open source.

Want to help support this blog? Try out Oh Dear, the best all-in-one monitoring tool for your entire website, co-founded by me (the guy that wrote this blogpost). Start with a 10-day trial, no strings attached.

We offer uptime monitoring, SSL checks, broken links checking, performance & cronjob monitoring, branded status pages & so much more. Try us out today!

Image of Mattias Geniar

Mattias Geniar, September 18, 2016

Follow me on Twitter as @mattiasgeniar

Welcome to cron.weekly issue #46, for Sunday, September 18th, 2016.

Loads of new tools this time, plenty of variation all around. Enjoy!

News

Some questions about Docker and rkt

This is a fun introduction comparing Docker to rkt by running over the steps involved to get both to work in production, each with its’ pro’s and con’s.

Uber’s Self-driving Pickups In Pittsburgh are Powered by Ubuntu

What else but Linux would power self-driving cars?

May the Fork Be with You: A Short History of Open Source Forks

A nice overview of ‘what’s a fork of what’: ubuntu vs debian, centos vs red hat, openbsd vs netbsd, …

Scalable and secure access with SSH

A description of how Facebook handles SSH: signed certificates, security domains, lots of info on the implementation.

Remote Code Execution in MySQL

Nearly all MySQL variants (Oracle, MariaDB) are vulnerable to a critical remote code execution that grants root privileges. While the requirements to exploit are rather complicated, it’s best to schedule your upgrades.

Tools & Projects

Fiaas

The project stands for “Full install as a Service”: a collection of Ansible roles and playbooks to setup an configure a full LAMP stack with additional services like Varnish, Memcached or Redis where required. The FIAAS playbooks generate more than just the standard service on your VM.

Bash 4.4

It’ll probably take a while until this release hits the DEB/RPM repo’s, but some nifty new features: different signal handling for async jobs, loadable plugins, better –help output and loads of bugfixes.

dingo

A caching DNS proxy for the Google DNS-over-HTTPS. It effectively encrypts all your DNS traffic.

Naxsi

NAXSI is an open-source, high performance, low rules maintenance Web Application Firewall for Nginx.

Logtrail

LogTrail is a plugin for Kibana to view, analyze, search and tail log events from multiple hosts in realtime with devops friendly interface inspired by Papertrail.

Goofy

Goofy is an HTTP load testing tool that simulates waves of surfers in a somewhat unusual way.

Varnish 5.0

A new release for the popular Varnish caching daemon: first (experimental) support for HTTP/2, a new shard directory (load balancing base on strings/keys) and the ability to more easily split the VCL files among multiple files.

Zabbix 3.2

The latest stable release of the Zabbix monitoring solution adds event tags, event correlation, nested host groups, better alert flapping detection & prevention.

Swift 3.0

The Swift language (originally developed by Apple) has reached a new milestone. It now has a stable API, so if you’re thinking of getting started with Swift, now is a good time – the runtime, syntax & usage of Swift isn’t likely to change much any time soon.

mysqlslap

A load testing tool for MySQL, simulating client connections & SQL queries, all fully configurable.

MySQL 8.0

A new release of Oracle’s version of MySQL: 8.0. It implements SQL roles, new character sets, invisible indexes, better IPv6 manipulation, improved performance schema & much more.

alwsl

This project adds support for Arch Linux as the WSL (Windows Subsystem for Linux) host. So, you can now run Arch Linux as a native Linux system on Windows.

DHCP Load Balancer

You know you’re working at scale when you need a DHCP load balancer! This tool, dhcplb, comes from the Facebook team.

Vim 8.0

A new release of the popular text editor: Asynchronous I/O support, channels, JSON, Jobs, Timers, Partials, Lambdas and Closures.

pyinfra

pyinfra automates service deployment. It does this by diff-ing the state of the server with the state defined in the deploy script. Deploys are asyncronous and highly performant. The inventory & deploy are managed with pure Python, allowing for near-infinite extendability.

borg

A terminal based search engine for bash commands. Borg was built out of the frustration of having to leave the terminal to search for bash commands.

kimchi

An HTML5 management interface for KVM.

frp

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

Guides & Tutorials

An Updated Performance Comparison of Virtual Machines and Linux Containers (PDF)

This is an interesting paper comparing the performance of VMs (in this case on KVM) to the performance of containers running via Docker.

From Kafka to ZeroMQ for real-time log aggregation

This post describes how challenges involving high-available Kafka setups drove them to ZeroMQ to process application & server logs in a streaming, real-time, fashion.

Turtles on the wire: understanding how the OS uses the modern NIC

A really in-depth article explaining everything that goes on network-wise in your server: virtualized NICs, buffer addresses & lengths, MAC address filtering & promiscuous mode, how CPU’s relate to packet handling, …

Building Docker images with Puppet

Lots of examples in this post explaining how you can use your Puppet config management to create and manage containers.

An introduction to Linux network routing

A good introduction to the routing table, Linux servers acting as routers, how to configure routing via the route tool & a solid reminder of the TCP stack.

Apache Hadoop Explained: Kafka, ZooKeeper, HDFS and Cassandra

This post gives a high level overview of how the Kafma, ZooKeeper, HDFS & Cassandra work together.



Want to subscribe to the cron.weekly newsletter?

I write a weekly-ish newsletter on Linux, open source & webdevelopment called cron.weekly.

It features the latest news, guides & tutorials and new open source projects. You can sign up via email below.

No spam. Just some good, practical Linux & open source content.