The Oliver blog

Notes from the engine room.

What the team building Oliver measured, and what we learned from it.

Subscribe by RSS

Two indexes over the same log data drawn one tile per megabyte: 128 tiles for the existing index and 37 for the new one, which finds a common word 714 times faster.714×faster on a common word7 µsto find it, in under a third of the spaceexisting index · 128 MBnew index · 36.9 MBone tile = 1 MB of index · same log data
Search

Full-text search is now up to 714× faster.

We built a new full-text index for Oliver. It finds a common word in 7 microseconds, takes up to 3.5 times less space, builds nearly five times faster, and returns exactly the same answers as our existing index.

7 October 20262 min read