Software engineering, distributed systems, databases, and the teams that build them
Software engineering, distributed systems, databases, and the teams that build them
A new version of Ekanite, the syslog server with built-in search, has been released. v1.3.0 includes some bug fixes, including to shard management. It also moves Ekanite to Go 1.9. You can download v1.3.0 from the GitHub releases page.
A new version of Ekanite, the syslog server with built-in search, has been released. v1.2.3 includes a fix to the diagnostic output. You can download v1.2.3 from the GitHub releases page.
A new version of Ekanite, the syslog server with built-in search, has been released. v1.2.1 includes a very important bug fix, for an issue that affected TCP operation. You can download v1.2.1 from the GitHub releases page.
A new version of Ekanite, the syslog server with built-in search, has been released. v1.2.0 includes some minor fixes and improvements. You can download v1.2.0 from the GitHub releases page.
I gave a presentation on Ekanite — the syslog server with built-in search — tonight at the San Francisco Go Meetup. It was an enjoyable evening, and I had a chance to discuss why I built Ekanite, how it works, and…
A new version of Ekanite, the syslog server with built-in search, has been released. v1.1.0 includes an important bug fix related to TCP connection handling, as well as some other minor fixes and improvements. You can download v1.1.0 from the…
Ekanite is an open-source Syslog server with built in log search. Thanks to some nice work by Fabian Zaremba, Ekanite now supports searching your logs via a browser. If you’d like to understand more about the design and development of…
It’s been 18 months since the first commit to my first significant Go project — syslog-gollector. After an initial burst of activity to create a functional Syslog Collector that streamed to Apache Kafka, the source code hadn’t been updated much…
This is the last part of a 3-part series “Designing and building a search system for log data”. Be sure to check out part 1 and part 2. In the last post we examined the design and implementation of Ekanite,…
This is the second part of a 3-part series “Designing and building a search system for log data”. Be sure to check out part 1. Part 3 follows this post. In the previous post I outlined some of the high-level…
This is the first part of a 3-part series “Designing and building a search system for log data”. Part 2 is here, and part 3 is here. For the past few years, I’ve been building indexing and search systems, for…
I’ve started coding in Go (golang), and I received some advice recently from Robert Griesemer, whom I was fortunate enough to sit beside at a recent Go Meetup. To learn Go, Robert suggested that I code a solution in Go…
AWS have posted the video online of Jim Nisbet’s and my talk at AWS:reinvent 2013. In it, Jim and I describe the system we built at Loggly, which uses Apache Kafka, Twitter Storm, and elasticseach, to build a high-performance log…
This past week I had the opportunity to speak, with my colleague Jim Nisbet, at AWS re:Invent 2013. Titled “Unmeltable Infrastructure at Scale: Using Apache Kafka, Twitter Storm, and Elastic Search on AWS“, Jim and I described the architecture of…
After 14 months of hard work, the next generation of Loggly has been released. It’s been a great time to be part of the Software Infrastructure team at Loggly and we have put together a superb log aggregation & real-time…