What You’re Getting Wrong About A/B Tests (And How to Fix Them)
A/B tests are a powerful statistical tool, commonly used (or abused) for making decisions about everything from button colors to machine learning models. But, we’ve seen A/B tests frequently used incorrectly. This blog post describes a light framework for planning out A/B tests, influenced by best practices at places like Square and Stitch Fix.
RecSys Metrics Laddering
To optimize on CLTV, stop trying to iterate on CLTV. By setting appropriate goals at different levels of granularity, every team has a metric they can move fast to improve. That’s the fastest route to strategic success, whether improved CLTV, growth, or whatever is right for your business.
From Frustration to Function: How Great Teams Get Great Results from RecSys
To paraphrase Tolstoy: All happy RecSys systems teams are alike, all unhappy RecSys teams are unhappy in their own way. What differentiates a successful team is the ability to experiment with ideas quickly to find the few that truly make a difference. This post lays out common pitfalls and outlines the best practices of successful recommender systems teams.
Announcing our Seed Round
Today, I’m excited to announce our $1.5 million seed investment round led by Bain Capital Ventures with participation from Cadenza Ventures, Y Combinator, and angel investors Brad Klingenberg (ex-Chief Algorithms Officer at Stitch Fix), Patrick Hayes (co-founder of SigOpt), and Dave Aronchick (co-founder of Bacalhau and Expanso).