I've supported A/B testing of Algolia search systems at three companies now, and have dived deep into A/B testing generally as well as specifically for search. The Algolia documentation on search A/B testing is technically adequate for getting started, and the dashboard has improved, but there are still many ways that …

Engineering leadership knows the standard playbook for product teams: the Product Trio, the Spotify model, outcome-based roadmaps, and so on. I've seen teams adopt these practices and still struggle when they add responsibility for advanced algorithms -- search, recommendations, predictive modeling, or generative AI -- …

If AI helps me get ideas from my head to the readers' heads faster, that's good. Society thrives when ideas are shared, critiqued, and built on. But authors shouldn't take credit for other peoples' ideas -- they should synthesize others' ideas, including the "blurry JPG of the web" that is LLMs. The question …

What are Post-Query Refinement Suggestions?

One of my favorite search UX patterns is post-query refinement suggestions — buttons that appear between the search box and results, adjusting the query in various ways. See, for instance, these suggestions on Etsy, which recommend that I filter by shipping speed, seller …

I keep seeing AI skeptic takes like "AI is useless" or "LLMs are only good at Natural Language Processing", usually because of hallucinations and AI slop. Both are real problems. But that conclusion still misses the point: it misidentifies what LLMs are actually good at.

My take is: LLMs are great …

Algolia is a tremendously powerful search platform, especially for e-commerce. But like most SaaS tools, the management dashboard doesn't do everything you need it to do. In particular, it's hard to compare search result rankings across variations in indexes -- a super common pattern when you're testing and iterating …

The rise of AI-assisted coding tools has made it dramatically easier and faster to build small side projects than ever before. What used to take weeks of evenings and weekends can now be done in a few focused sessions, with an AI pair programmer handling much of the boilerplate, debugging, and implementation details. …

As I've written about before, as a data scientist supporting a product or marketing team with A/B testing, the job is communication -- helping to translate between business requirements and what we can learn from statistics. I (and many, many others) have found that there is a lot of value in having a document, shared …

The other day, I was reading a post by Venkatash Rao (thousands of words of under-edited brilliance, as usual), and was struck by this note about the complexity of climate solutions:

I tend to take as an article of faith the systems science rule of thumb that the complexity of solutions generally matches the …

There’s been an immense amount of discussion about Large Language Models (LLMs) such as ChatGPT over the last year, of course. Some of that discussion has been whether they are intelligent, conscious, or on the path to Artificial General Intelligence.

I’m particularly interested in the "consciousness" …