Sit down with any developer today, even those at pretty new software companies, and you’ll see them doing something that programmers have been doing for years — you’ll see them tailing log files.
But why? Why are we still tailing logs?
Software engineering, distributed systems, databases, and the teams that build them
Software engineering, distributed systems, databases, and the teams that build them
Sit down with any developer today, even those at pretty new software companies, and you’ll see them doing something that programmers have been doing for years — you’ll see them tailing log files.
But why? Why are we still tailing logs?
I’ve mentored, coached, managed, and reviewed many software developers throughout the years. There are many different areas one can discuss, but my most importance advice for engineers early in their career has never changed.
Continue reading “Mentoring junior programmers: What I tell them is job number one”
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine.
There have been a series of releases recently, which make deployment on Linux even easier, and significantly decrease the Docker footprint.
Continue reading “rqlite: static linking and smaller Docker images”
I recently had a chance to speak about rqlite, the distributed, lightweight database built on SQLite, to the Carnegie Mellon Database Group.We discussed the goals of rqlite, its design and use of the Raft consensus protocol, as well as testing strategies and real world applications.
A video of talk has been posted, and presentation itself is also available.
Full details for my upcoming talk on rqlite to the Carnegie Mellon Database Group are now available.
I will discuss rqlite goals, design, and implementation, with particular reference to its use of the Raft consensus algorithm, and its embedding of SQLite. I will also discuss rqlite testing, performance, lessons learned during development, and some of its real-world applications.
rqlite
is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. 6.1.0 enables new SQLite options including JSON1 support and the DBSTAT table. It also supports proper concurrent database reads for in-memory databases, and write requests no longer block those reads.
You can download the release from GitHub.
I recently took part in the GCP Podcast, along with my colleague Reed Taylor. On the podcast we spoke about Cloud Logging, which is GCP‘s centralized Logging product, and has released lots of new features to help customers meet their Compliance and Regulatory needs.
Be sure to check out the podcast episode.
rqlite
is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features.
Continue reading “rqlite 6.0: the evolution of a distributed database design”
The Database of Databases website is a great resource to learn about databases, and related storage systems. It allows you search by various criteria, including storage model, durability, and query interface.
I recently updated the entry for rqlite, which you check out here.
It was April 9th 2016, and I tagged my first official release of rqlite — two years after I actually started coding it. Since then there has been 58 releases, 277 closed issues, 416 closed pull requests, 32,785 insertions, 1954 deletions, and 100 files have changed.
Continue reading “7 years of open-source database development: lessons learned”
Thanks to Zac Medico, there is a new PyPI Project and package for rqlite. You can find it on the PyPI website.
Version 2.1 is now available.
My most recent post on Reddit got a reader’s attention, and they remarked that rqlite 5.10.0 memory usage grew during the load test, but no such increase in memory usage was seen during the same testing of 5.6.0. Sure enough, there was a memory leak in 5.10.0.
rqlite
is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. 5.10.0 is now out, capping a series of releases that brings significant improvements in disk usage and startup times.
Continue reading “rqlite 5.10.0 released: comparing its disk usage to 5.6.0”
rqlite is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. v5.8.0 is now out, fixes some minor bugs, and adds support for HTTP/2 over TLS. It also stores a compressed copy of the SQLite database in the Raft snapshot, saving disk space.
You can download the release from GitHub.