Software engineering, distributed systems, databases, and the teams that build them
Software engineering, distributed systems, databases, and the teams that build them
In this post I describe how I built a serverless cluster discovery service for rqlite, the distributed relational database built on SQLite. Built using the AWS API Gateway service, AWS Lambda, and DynamoDB, it means rqlite nodes no longer need…
rqlite is a lightweight, open-source distributed relational database, with SQLite as its storage engine. v3.10.0 has been released. This release includes some minor configuration control and logging enhancements. You can download the release from GitHub.
rqlite is a lightweight, open-source distributed relational database, with SQLite as its storage engine. v3.9.2 is now out. This release includes a couple of significant bug fixes. You can download the release from GitHub.
I’ve started experimenting with one of the newest packaging systems — Canonical’s Snap format. I learned about Snap from Mark Shuttleworth when he let me know that he had created a rqlite Snap. It seems pretty clean and straightforward so far — I’ve…
rqlite is a lightweight, open-source distributed relational database, with SQLite as its storage engine. v3.8.0 is now out. This release includes some minor enhancements and bug fixes. You can download the release from GitHub.
In every field there is a question that, while it sounds interesting, betrays a naiveté and lack of sophistication. In my field — SaaS and data platforms — it’s how much data do you have?
I was recently asked by some colleagues about my favourite books on programming. And not just books on coding, but on improving their understanding of successful teams.
rqlite is a lightweight distributed relational database, with SQLite as its storage engine. With release v3.7.0 you can load SQLite dump files directly into rqlite. This makes restoring from a backup, or migrating an existing SQLite database to rqlite much…
I gave a presentation on Ekanite — the syslog server with built-in search — tonight at the San Francisco Go Meetup. It was an enjoyable evening, and I had a chance to discuss why I built Ekanite, how it works, and…
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.6.0 is out. With this release a new node can now join an existing cluster though any node of that cluster, not just through the leader node.…
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.5.0 is out. This release supports important control of foreign key constraints, in the underlying SQLite database. You can download the release from GitHub.
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.4.1 is out. This release includes some minor fixes as well as source code improvements (linting). You can download the release from GitHub.
rqlite is an open-source distributed relational database, with SQLite as its storage engine. Check out this cool video, showing the evolution of the source code.
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.4.0 is out, which includes a minor change to the HTTP responses. You can download the release from GitHub.
I’m a conviction engineer. To me it’s the only way to be an effective engineer, software developer, and technical leader. You’ve simply got to truly believe in the value of what you do, and you’ve got to believe in doing…
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.3.0 has been released and includes new functionality to control the Raft consensus subsystem, along with improvements to the CLI. You can download the release from GitHub.
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.2.1 has been released and includes new functionality for cluster management, along with new documentation on running clusters. v3.2.0 also includes some bug fixes. You can download the…
Some fellow developers, using Go for the first time, recently asked me how to organise a Go project and for some high-level guidance on programming using the language. I thought the most effective way to answer this question was to…
rqlite is an open-source distributed relational database, which uses SQLite as its storage engine. rqlite is written in Go and uses Raft to achieve consensus across a set of SQLite databases. It gracefully handles leader election, and can tolerate machine…
rqlite is an open-source distributed relational database, with SQLite as its storage engine. v3.0.1 has been released and it is a significant upgrade relative to the 2.0 series. The 3.0 series allows more sophisticated clusters to be built and simplifies rqlite…
Thanks to Zac Medico, there are new Python clients available for rqlite — a pure Python client, and a SQLAlchemy mapper. Check them out on GitHub.
I made a presentation on rqlite tonight at the San Francisco Go Meetup. It was an enjoyable evening, and I had a chance to discuss why I built rqlite, how it works, and where it might go in the future.
Programming a database is fascinating work. I’ve been deeply involved with developing open source databases for the past two years and programming a database is possibly the most instructive project one can ever complete as a software developer. What’s really…
I’ve started replacing go-raft within rqlite with the implementation from Hashicorp. go-raft is no longer maintained, and I’ve good experience with the Hashicorp code, due to my work with InfluxDB and hraftd. I’m also going to change the API, so…
Ekanite is an open-source Syslog server with built in log search. Thanks to some nice work by Fabian Zaremba, Ekanite now supports searching your logs via a browser. If you’d like to understand more about the design and development of…