When I Fed Poems to an LLM, I Realized I Was Measuring Temperature with a Screwdriver

The most important truths about a product aren't found in A/B test results, says Justin Houck. He says the most important things about a user experience are found in the things that resist measurement. Houck: Our job isn't just to build powerful decoders, it's to build systems that recognize what lies beyond the data.