Software engineering, distributed systems, databases, and the teams that build them
Software engineering, distributed systems, databases, and the teams that build them
My teams recently delivered support for the OpenTelemetry Protocol (OTLP) into Google Cloud Observability. This marks a significant step toward open, vendor-neutral observability. By adopting OTLP, customers gain interoperability across tools, simpler data pipelines, and a future-proof path as the…
rqlite is a lightweight, open-source, distributed relational database written in Go, utilizing SQLite as its storage engine. Version 8.39 has been released and now includes support for automated backup and restore to and from Google Cloud Storage. This enhancement offers…
I recently co-authored a blog post for the Google Cloud Platform Blog, along with my colleague Keith Chen. In the blog post we spoke about our latest features, which help organizations builds their own multi-tenant log management features on Cloud…
rqlite is a lightweight, open-source, distributed relational database written in Go, utilizing SQLite as its storage engine. Version 7.16.0 has been released and now includes support for restoring your rqlite system automatically from AWS S3. With this in place you…
rqlite is a lightweight, open-source, distributed relational database written in Go, utilizing SQLite as its storage engine. Version 7.15.0 has been released and now includes support for automated backups to Amazon Web Services (AWS) S3. This enhancement offers increased data…
I’ve finally completed the migration of this site from Rackspace to GCP. I switched over the DNS record this afternoon, and everything seems fully functional. I’m even using Cloud Logging and BigQuery to analyze my Apache access logs.
I recently took part in the GCP Podcast, along with my colleague Oscar Guerrero. On the podcast we spoke about Audit Logging, which is a critical security feature of GCP. Be sure to check out the podcast episode.
Following up on my earlier post, it has been pretty straightforward to so far to migrate this blog from Rackspace to GCP. It’s going pretty much as expected, but the architecture is going to be slightly different than I initially…
Another interesting paper came my way, thanks to the Morning Paper mailing list. Nines are Not Enough:Meaningful Metrics for Clouds discusses a topic that I deal with regularly in my role at Google. SLIs, SLOs, and SLA are easy to…
Since I recently joined Google Cloud Platform (GCP), I thought it’s time to get some practical experience with the platform. As a result I’m going to migrate this blog from Rackspace to GCP — specifically I’ll use GCE for WordPress, and…
Real-time — or near real-time — data pipelines are all the rage these days. I’ve built one myself, and they are becoming key components of many SaaS platforms. SaaS Analytics, Operations, and Business Intelligence systems often involve moving large amounts…
I’ve been thinking a lot recently about what makes computer services and products sticky — what makes users and customers come back again and again to what you’ve built. There are lots of ways to summarize it, but when it…
Over 16 years, I’ve written software up-and-down the entire stack. Earliest in my career I wrote boot ROM software for specialized embedded devices. This kind of programming taught me so much about how computers really work.
This blog describes working with InfluxDB 0.8. InfluxDB 0.8 is no longer supported, and has been superseded by the 1.0 release. I recently came across InfluxDB — it’s a time-series database built on LevelDB. It’s designed to support horizontal as…
AWS have posted the video online of Jim Nisbet’s and my talk at AWS:reinvent 2013. In it, Jim and I describe the system we built at Loggly, which uses Apache Kafka, Twitter Storm, and elasticseach, to build a high-performance log…
This past week I had the opportunity to speak, with my colleague Jim Nisbet, at AWS re:Invent 2013. Titled “Unmeltable Infrastructure at Scale: Using Apache Kafka, Twitter Storm, and Elastic Search on AWS“, Jim and I described the architecture of…
Loggly recently held an elasticsearch meetup, which was a great success. One question that was repeatedly asked was how to ensure elasticsearch does not suffer a partition — known as a split-brain. This can be a particular problem in AWS…
Another post for the Riverbed Technology Blog, on the value of looking back. You can read it here.
I recently wrote a entry for the Riverbed Technology blog, describing an interesting collaborative development experience I had with the AWS EC2 Cloud. You can read it here.