Collectd to InfluxDB v2 with downsampling using Tasks

In a previous blog post I wrote about collecting server statistics with Collectd, passing them to InfluxDB and graphing them with Grafana. Using “Retention Policies” (RPs) and “Continuous Queries” (CQs) metrics could be downsampled to reduce storage usage. This blog post shows how to do the same with InfluxDB v2. InfluxDB v2 At the end of 2020 InfluxDB v2 was released. Moving to InfluxDB v2 with the setup I had (Collectd input, downsampling) came with some challenges:...

November 3, 2022 · 5 min · pommi
Tesla Powerwall

Simulating a Tesla Powerwall with InfluxDB

It’s a little over a year ago that I got solar panels installed on my roof. Not a Tesla Solar Roof, but the most efficient solar panels available last year. From SunPower. The SPR-X21-350-BLK. Together with a SolarEdge SE5K converter its producing 5300 Watt during peak hours. I’m interested if a Tesla Powerwall is worth it financially. Will it pay back the investment in a reasonable amount of time? In the Netherlands there is still a net metering policy until 2023, which means that you can administratively subtract the electricity you have delivered to, from what you have used from the electricity network....

May 31, 2020 · 11 min · pommi
Cloud Foundry

Saving costs with a new scheduler in Cloud Foundry Diego

In the Mendix Cloud we run thousands of Mendix apps on Cloud Foundry on AWS. Mendix Runtime Engines that currently run in 2, 4, 8 or 16 GB memory containers. Mendix developers have the possibility to start, stop, scale and upload new versions of their app themselves via our Developer Portal. This results in the fact that we must have diego-cell instances with at least 16 GB memory available at all times so that a Mendix developer can start their 16 GB memory Runtime Engine....

December 23, 2019 · 7 min · pommi

Server stats with collectd, InfluxDB and Grafana (with downsampling)

Almost 10 years ago I started developing a web frontend for collectd, Collectd Graph Panel (CGP). A PHP frontend that displays graphs in PNG format using rrdtool and the RRD files created by collectd. A lot has happened since then. Because of the IoT hype time series databases like Graphite, InfluxDB and TimescaleDB became more popular. Also visualization tools gained more traction, of which Grafana is the most popular one....

June 25, 2019 · 9 min · pommi

Measuring Power Consumption with Broadlink SP3S, python, influxdb and grafana

A while ago I was researching the possibilities to measure the power consumption of some devices in my house via Wifi. I came across the Broadlink SP3S Smart Plug. It met my requirements: relatively cheap, power measurement and Wifi. It comes with an IOS and Android App. There a big chance the app is not directly connecting to the SP3S, but to “the Cloud” where the SP3S sends its data to....

May 4, 2019 · 7 min · pommi

Routed IPTV via a Debian router (XS4ALL or KPN)

At home my FTTH Internet connection is provided by XS4ALL. They provide a FRITZ!Box router to connect to the Internet. Instead of using the FRITZ!Box I’ve always used my own Debian GNU/Linux machine to route traffic to the internet. The XS4ALL uplink has 2 VLANs: VLAN4: TV (bridged, RFC1483) VLAN6: PPPoE IPv4 + IPv6 internet connection My XS4ALL uplink is connected to a managed switch. My Motorola 1963 TV Receiver is directly connected to an untagged VLAN4 port on my switch....

February 16, 2019 · 5 min · pommi
Top 2000

Download “NPO Radio 2 – Top 2000” in mp3 format

In a marathon program from Christmas to New Year’s eve NPO Radio 2 broadcasts the so called “Top 2000“. A list of the 2000 most popular songs of all time. Because I’m not able to listen all 2000 songs in one go, I like to have them on a USB drive in MP3 format, so that I’m able to listen for example in my car. The shell script below downloads the full “Top 2000” of 2023 in MP3 format from the official website....

January 20, 2019 · 1 min · pommi

Safe in-place upgrade to a slim Debian stretch running i3

Debian Stretch was released last month, so it is time to upgrade my laptop. I’m an i3 window manager user. Previously my procedure was to backup /home, reinstall using the network installer (I don’t like apt-get dist-upgrade, I like to start clean) and tick the “Debian Desktop Environment … GNOME” checkbox and after the installer was done, install i3 and the rest of my tools. While I use some of the tools from Gnome, like gnome-terminal, network manager, nautilus and Eye of Gnome, I do not really need the complete Gnome desktop environment and 100s of software packages that come with it....

July 29, 2017 · 5 min · pommi

Collectd Graph Panel v1

v1 is here. CGP is finished 😆 Joking aside. It has been requested multiple times. So let’s get it over with. The last version was more then 3.5 years ago. This will be the last tagged version of CGP. Every commit in the master branch after this release can be considered as a new release. 😉 Use git and “git pull” to keep up-to-date or download the latest version here....

March 5, 2017 · 1 min · pommi

Nagios notifications via Telegram

This post shows you how to use Telegram for Nagios notifications. First create a Telegram Bot by talking to the BotFather. The Telegram Bot will be the sender of the Nagios alerts. You’ll receive an API token that also includes the UserID of the Bot: Token: 200194008:AAEG6djWC9FENEZaVIo3y3vZm24P3GTMetw UserID: 200194008 Download the script that will send the alerts via Telegram: wget -O /usr/local/bin/ chmod 755 /usr/local/bin/ This is the configuration you need in Nagios (of course replace the token with your own):...

March 24, 2016 · 3 min · pommi