Software engineering, distributed systems, databases, and the teams that build them
Software engineering, distributed systems, databases, and the teams that build them
I recently had a chance to speak about rqlite, the distributed, lightweight database built on SQLite, to the Carnegie Mellon Database Group.We discussed the goals of rqlite, its design and use of the Raft consensus protocol, as well as testing strategies and real world applications.
A video of talk has been posted, and presentation itself is also available.
Full details for my upcoming talk on rqlite to the Carnegie Mellon Database Group are now available.
I will discuss rqlite goals, design, and implementation, with particular reference to its use of the Raft consensus algorithm, and its embedding of SQLite. I will also discuss rqlite testing, performance, lessons learned during development, and some of its real-world applications.
rqlite
is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. 6.1.0 enables new SQLite options including JSON1 support and the DBSTAT table. It also supports proper concurrent database reads for in-memory databases, and write requests no longer block those reads.
You can download the release from GitHub.
I recently took part in the GCP Podcast, along with my colleague Reed Taylor. On the podcast we spoke about Cloud Logging, which is GCP‘s centralized Logging product, and has released lots of new features to help customers meet their Compliance and Regulatory needs.
Be sure to check out the podcast episode.
rqlite
is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features.
Continue reading “rqlite 6.0: the evolution of a distributed database design”
The Database of Databases website is a great resource to learn about databases, and related storage systems. It allows you search by various criteria, including storage model, durability, and query interface.
I recently updated the entry for rqlite, which you check out here.
It was April 9th 2016, and I tagged my first official release of rqlite — two years after I actually started coding it. Since then there has been 58 releases, 277 closed issues, 416 closed pull requests, 32,785 insertions, 1954 deletions, and 100 files have changed.
Continue reading “7 years of open-source database development: lessons learned”
Thanks to Zac Medico, there is a new PyPI Project and package for rqlite. You can find it on the PyPI website.
Version 2.1 is now available.
My most recent post on Reddit got a reader’s attention, and they remarked that rqlite 5.10.0 memory usage grew during the load test, but no such increase in memory usage was seen during the same testing of 5.6.0. Sure enough, there was a memory leak in 5.10.0.
rqlite
is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. 5.10.0 is now out, capping a series of releases that brings significant improvements in disk usage and startup times.
Continue reading “rqlite 5.10.0 released: comparing its disk usage to 5.6.0”
rqlite is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. v5.8.0 is now out, fixes some minor bugs, and adds support for HTTP/2 over TLS. It also stores a compressed copy of the SQLite database in the Raft snapshot, saving disk space.
You can download the release from GitHub.
rqlite
is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. v5.7.0 is now out, and introduces a major implementation change — replacing JSON encoding with Protocol Buffers for the Raft Log Entries.
Continue reading “Moving to Protocol Buffers with rqlite 5.7.0”
There is a popular image out there, among the general public, that small startups — particularly small software startups — are a hotbed of technical innovation, constantly creating new technology. But is it true?
Continue reading “Where is technical innovation actually happening?”
rqlite is a lightweight, open-source, distributed relational database written in Go, with SQLite as its storage engine. v5.5.0 is now out, and adds support for Parameterized SQL statements.
If you work in the logging, monitoring — or even Observability — space long enough, you eventually end up on team that tries to build a system that handles both logs and time series in a high-performant and cost-efficient manner.
Well, it’s a lot harder than it sounds — because logs and time-series are not the same.
