1<!DOCTYPE html><!--z3OchgUaaRsS7fyZXdwiX--><html lang="en" class="scroll-smooth"><head><meta charSet="utf-8"/><meta name="viewport" content="width=device-width, initial-scale=1"/><link rel="preload" href="/_next/static/media/03fc1b4a8d284b5e-s.p.af4fcd24.woff2" as="font" crossorigin="" type="font/woff2"/><link rel="preload" href="/_next/static/media/70bc3e132a0a741e-s.p.15008bfb.woff2" as="font" crossorigin="" type="font/woff2"/><link rel="stylesheet" href="/_next/static/chunks/c15cd36f61e26982.css" data-precedence="next"/><link rel="stylesheet" href="/_next/static/chunks/17c5e71924241240.css" data-precedence="next"/><link rel="preload" as="script" fetchPriority="low" href="/_next/static/chunks/ebd04cfcea9e90b2.js"/>
1<script src="/_next/static/chunks/82abf2d65f5428ae.js" async=""></script>
1<script src="/_next/static/chunks/b5bc0b0f3d1111a2.js" async=""></script>
1<script src="/_next/static/chunks/1f58588c4d505917.js" async=""></script>
1<script src="/_next/static/chunks/618d8b7ed0ddc0a1.js" async=""></script>
1<script src="/_next/static/chunks/turbopack-015d37d43f01d6b3.js" async=""></script>
1<script src="/_next/static/chunks/4f01e4ae416e0626.js" async=""></script>
1<script src="/_next/static/chunks/85a6122b0d628955.js" async=""></script>
1<script src="/_next/static/chunks/5f0524cd67aada7c.js" async=""></script>
1<script src="/_next/static/chunks/3cb18c5b18e98c2d.js" async=""></script>
1<script src="/_next/static/chunks/ff1a16fafef87110.js" async=""></script>
1<script src="/_next/static/chunks/a2dfb6fc5208ab9b.js" async=""></script>
1<script src="/_next/static/chunks/b0e08fbc9c09ad34.js" async=""></script>
1<script src="/_next/static/chunks/85b6dce4c24fc9bd.js" async=""></script>
1<script src="/_next/static/chunks/24fd35f1c412cc11.js" async=""></script>
1<script src="/_next/static/chunks/60cd64dfb12f5951.js" async=""></script>
1<meta name="apple-mobile-web-app-capable" content="yes"/><meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"/><meta name="msapplication-TileColor" content="#1A1837"/><meta name="msapplication-navbutton-color" content="#1A1837"/><link rel="preconnect" href="https://eu.i.posthog.com"/><link rel="preconnect" href="https://cdn.brandfetch.io"/><link rel="dns-prefetch" href="https://eu.i.posthog.com"/><link rel="dns-prefetch" href="https://cdn.brandfetch.io"/><meta name="next-size-adjust" content=""/><meta name="theme-color" content="#1e1b4b"/><title>A/B Testing Articles & Expert Guides | ABTestResult.com</title><meta name="description" content="Curated articles on A/B testing covering statistical methods, sample sizing, experimentation frameworks, and non-inferiority testing from industry experts."/><meta name="application-name" content="ABTestResult"/><meta name="author" content="ABTestResult.com"/><link rel="manifest" href="/manifest.webmanifest"/><meta name="keywords" content="ab testing articles,experimentation guides,one-tailed vs two-tailed test,TOST equivalence testing,sample size determination,statistical power ab testing,multiple comparisons correction,non-inferiority testing,guardrail metrics ab testing,non-binomial metrics ab testing,interaction effects experimentation,experiment brief template,explore exploit cro,underpowered ab tests,ab testing methodology,statistical significance articles"/><meta name="robots" content="index, follow"/><meta name="googlebot" content="index, follow, max-video-preview:-1, max-image-preview:large, max-snippet:-1"/><link rel="canonical" href="https://abtestresult.com/articles"/><meta name="format-detection" content="telephone=no, address=no, email=no"/><meta name="msvalidate.01" content="8A0AD1084F0F69CEB6EC8B546244828E"/><meta name="mobile-web-app-capable" content="yes"/><meta name="apple-mobile-web-app-title" content="ABTestResult"/><meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"/><meta property="og:title" content="A/B Testing Articles & Expert Guides"/><meta property="og:description" content="Curated articles on statistical testing methods, sample sizing, and experimentation frameworks from industry experts."/><meta property="og:url" content="https://abtestresult.com/articles"/><meta property="og:image:alt" content="A/B Testing Articles - Expert Guides on Experimentation"/><meta property="og:image:type" content="image/png"/><meta property="og:image" content="https://abtestresult.com/articles/opengraph-image?16c36f98f3f853ba"/><meta property="og:image:width" content="1200"/><meta property="og:image:height" content="630"/><meta property="og:type" content="website"/><meta name="twitter:card" content="summary_large_image"/><meta name="twitter:title" content="A/B Testing Articles"/><meta name="twitter:description" content="Curated articles on statistical testing methods, sample sizing, and experimentation frameworks."/><meta name="twitter:image:alt" content="A/B Testing Articles - Expert Guides on Experimentation"/><meta name="twitter:image:type" content="image/png"/><meta name="twitter:image" content="https://abtestresult.com/articles/opengraph-image?16c36f98f3f853ba"/><meta name="twitter:image:width" content="1200"/><meta name="twitter:image:height" content="630"/><link rel="icon" href="/favicon.ico" sizes="48x48"/><link rel="icon" href="/icon.png" type="image/png" sizes="512x512"/><link rel="apple-touch-icon" href="/icon.png"/>
1<script type="application/ld+json">{"@context":"https://schema.org","@graph":[{"@type":"WebSite","@id":"https://abtestresult.com/#website","url":"https://abtestresult.com","name":"ABTestResult.com","description":"Free statistical calculators for A/B testing and experimentation","potentialAction":{"@type":"SearchAction","target":"https://abtestresult.com/glossary?q={search_term_string}","query-input":"required name=search_term_string"}},{"@type":"Organization","@id":"https://abtestresult.com/#organization","name":"ABTestResult.com","url":"https://abtestresult.com","logo":{"@type":"ImageObject","url":"https://abtestresult.com/icon.png"}}]}</script>
1<script src="/_next/static/chunks/a6dad97d9634a72d.js" noModule=""></script>
1</head><body class="ibm_plex_sans_19dceeb6-module__3R2tZq__variable jetbrains_mono_9a2f2d6c-module__wsyXyG__variable font-sans antialiased min-h-screen flex flex-col"><div hidden=""><!--$--><!--/$--></div>
1<script>((a,b,c,d,e,f,g,h)=>{let i=document.documentElement,j=["light","dark"];function k(b){var c;(Array.isArray(a)?a:[a]).forEach(a=>{let c="class"===a,d=c&&f?e.map(a=>f[a]||a):e;c?(i.classList.remove(...d),i.classList.add(f&&f[b]?f[b]:b)):i.setAttribute(a,b)}),c=b,h&&j.includes(c)&&(i.style.colorScheme=c)}if(d)k(d);else try{let a=localStorage.getItem(b)||c,d=g&&"system"===a?window.matchMedia("(prefers-color-scheme: dark)").matches?"dark":"light":a;k(d)}catch(a){}})("class","theme","system",null,["light","dark"],null,true,true)</script>
1<nav class="sticky top-0 z-50 w-full bg-[#1e1b4b] bg-gradient-to-r from-[#1e1b4b] via-[#1e1b4b] to-[#312e81] shadow-lg shadow-indigo-950/20"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="flex h-[72px] items-center justify-between"><a class="flex items-center gap-2.5 sm:gap-3 group min-w-0" href="/"><img alt="ABTestResult.com Logo" loading="lazy" width="40" height="40" decoding="async" data-nimg="1" class="rounded-lg transition-transform duration-200 group-hover:scale-105 flex-shrink-0" style="color:transparent" srcSet="/_next/image?url=%2Ficon.png&w=48&q=75 1x, /_next/image?url=%2Ficon.png&w=96&q=75 2x" src="/_next/image?url=%2Ficon.png&w=96&q=75"/><span class="font-semibold text-base sm:text-lg lg:text-xl text-indigo-100 group-hover:text-white transition-colors duration-200 truncate">ABTestResult<span class="text-indigo-400">.com</span></span></a><div class="hidden md:flex items-center gap-1"><a class="relative px-4 py-2.5 text-base font-medium rounded-lg transition-all duration-200 text-indigo-200 hover:text-white hover:bg-white/10" href="/">Home</a><div class="relative"><button aria-expanded="false" aria-haspopup="true" aria-controls="calculators-dropdown" class="flex items-center gap-2 px-4 py-2.5 text-base font-medium rounded-lg transition-all duration-200 text-indigo-200 hover:text-white hover:bg-white/10">Calculators<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-chevron-down w-4 h-4 transition-transform duration-200" aria-hidden="true"><path d="m6 9 6 6 6-6"></path></svg></button><div id="calculators-dropdown" class="absolute top-full right-0 mt-2 w-56 rounded-xl overflow-hidden transition-all duration-200 origin-top-right bg-[#1e1b4b] border border-indigo-800/50 shadow-xl shadow-indigo-950/50 opacity-0 scale-95 -translate-y-2 invisible"><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/statistical-calculators"><span class="">All Calculators</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/bayesian-calculator"><span class="font-semibold">Bayesian Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/duration-calculator"><span class="">Duration Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/mde-calculator"><span class="">MDE Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/normality-test"><span class="">Normality Test</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/roi-calculator"><span class="">ROI Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/sample-ratio-mismatch"><span class="">SRM Checker</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/sample-size-calculator"><span class="font-semibold">Sample Size Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/statistical-significance-calculator"><span class="font-semibold">Significance Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/standard-deviation-calculator"><span class="">Standard Deviation</span></a></div></div><a class="relative px-4 py-2.5 text-base font-medium rounded-lg transition-all duration-200 text-indigo-200 hover:text-white hover:bg-white/10" href="/jobs">Jobs</a><div class="relative"><button aria-expanded="false" aria-haspopup="true" aria-controls="resources-dropdown" class="flex items-center gap-2 px-4 py-2.5 text-base font-medium rounded-lg transition-all duration-200 text-amber-400 bg-white/5">More<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-chevron-down w-4 h-4 transition-transform duration-200" aria-hidden="true"><path d="m6 9 6 6 6-6"></path></svg></button><div id="resources-dropdown" class="absolute top-full right-0 mt-2 w-56 rounded-xl overflow-hidden transition-all duration-200 origin-top-right bg-[#1e1b4b] border border-indigo-800/50 shadow-xl shadow-indigo-950/50 opacity-0 scale-95 -translate-y-2 invisible"><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/resources">All Resources</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/ab-testing-tools">A/B Testing Tools</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/api-access">API Access</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/mcp-server">MCP Server</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-amber-400 bg-white/5" href="/articles">Articles</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/books">Books</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/courses">Courses</a><a class="block px-4 py-3 text-base transition-colors duration-150 text-indigo-200 hover:text-white hover:bg-white/10" href="/glossary">Glossary</a></div></div><div class="w-px h-9 bg-indigo-700/50 mx-3"></div><button class="flex items-center gap-2 px-3 py-2 rounded-lg text-indigo-300 hover:text-white hover:bg-white/10 transition-all duration-200" aria-label="Search"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-search w-4.5 h-4.5" aria-hidden="true"><path d="m21 21-4.34-4.34"></path><circle cx="11" cy="11" r="8"></circle></svg><span class="text-sm text-indigo-400/80 hidden lg:inline">Search</span></button><div class="flex items-center gap-0.5 p-1 rounded-lg bg-indigo-800/40"><div class="w-7 h-7"></div><div class="w-7 h-7"></div><div class="w-7 h-7"></div></div></div><div class="flex md:hidden items-center gap-1"><button class="p-2.5 rounded-xl text-indigo-200 hover:text-white hover:bg-white/10 active:bg-white/15 transition-all duration-200 active:scale-95" aria-label="Search"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-search w-5 h-5" aria-hidden="true"><path d="m21 21-4.34-4.34"></path><circle cx="11" cy="11" r="8"></circle></svg></button><button class="p-2.5 -mr-2 rounded-xl text-indigo-200 hover:text-white hover:bg-white/10 active:bg-white/15 transition-all duration-200 active:scale-95" aria-label="Open menu" aria-expanded="false"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-menu w-6 h-6" aria-hidden="true"><path d="M4 5h16"></path><path d="M4 12h16"></path><path d="M4 19h16"></path></svg></button></div></div><div class="md:hidden transition-[opacity,visibility] duration-300 ease-out overflow-hidden max-h-0 opacity-0 invisible"><div class="pt-3 border-t border-indigo-800/50 max-h-[calc(100dvh-72px-1rem)] overflow-y-auto overscroll-contain"><div class="flex flex-col gap-1"><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/">Home</a><div class="border-t border-indigo-800/50 mt-3 pt-3"><p class="px-4 py-2 text-sm text-indigo-400 uppercase tracking-wider font-semibold">Calculators</p><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/statistical-calculators"><span class="">All Calculators</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/bayesian-calculator"><span class="font-semibold">Bayesian Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30 whitespace-nowrap">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/duration-calculator"><span class="">Duration Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/mde-calculator"><span class="">MDE Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/normality-test"><span class="">Normality Test</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/roi-calculator"><span class="">ROI Calculator</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/sample-ratio-mismatch"><span class="">SRM Checker</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/sample-size-calculator"><span class="font-semibold">Sample Size Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30 whitespace-nowrap">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/statistical-significance-calculator"><span class="font-semibold">Significance Calculator</span><span class="text-xs font-medium px-1.5 py-0.5 rounded bg-amber-500/20 text-amber-400 border border-amber-500/30 whitespace-nowrap">Popular</span></a><a class="flex items-center justify-between gap-2 px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/standard-deviation-calculator"><span class="">Standard Deviation</span></a></div><div class="border-t border-indigo-800/50 mt-3 pt-3"><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/jobs">Jobs</a></div><div class="border-t border-indigo-800/50 mt-3 pt-3"><p class="px-4 py-2 text-sm text-indigo-400 uppercase tracking-wider font-semibold">More</p><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/resources">All Resources</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/ab-testing-tools">A/B Testing Tools</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/api-access">API Access</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/mcp-server">MCP Server</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] bg-white/10 text-amber-400" href="/articles">Articles</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/books">Books</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/courses">Courses</a><a class="flex items-center px-4 py-3.5 text-base font-medium rounded-lg transition-all duration-200 active:scale-[0.98] text-indigo-100 hover:bg-white/5 hover:text-white active:bg-white/10" href="/glossary">Glossary</a></div><div class="border-t border-indigo-800/50 mt-3 pt-4 px-3 flex items-center gap-3"><div class="flex items-center gap-0.5 p-1 rounded-lg bg-indigo-800/40"><div class="w-7 h-7"></div><div class="w-7 h-7"></div><div class="w-7 h-7"></div></div><span class="text-base text-indigo-400">Theme</span></div></div></div></div></div></nav><main class="flex-1"><!--$?--><template id="B:0"></template><div class="flex flex-col items-center justify-center min-h-[60vh] gap-4"><div class="relative"><div class="w-12 h-12 rounded-full border-4 border-slate-200 dark:border-slate-700 border-t-violet-500 animate-spin"></div></div><p class="text-sm text-slate-500 dark:text-slate-400 animate-pulse">Loading...</p></div><!--/$--></main>
1<footer class="bg-slate-100 dark:bg-slate-950 border-t border-slate-200 dark:border-slate-800"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="py-12 grid grid-cols-1 md:grid-cols-2 lg:grid-cols-6 gap-8 lg:gap-12"><div class="lg:col-span-2"><a class="inline-flex items-center gap-2.5 group mb-4" href="/"><img alt="ABTestResult.com Logo" loading="lazy" width="36" height="36" decoding="async" data-nimg="1" class="rounded-lg" style="color:transparent" srcSet="/_next/image?url=%2Ficon.png&w=48&q=75 1x, /_next/image?url=%2Ficon.png&w=96&q=75 2x" src="/_next/image?url=%2Ficon.png&w=96&q=75"/><span class="font-semibold text-lg text-slate-900 dark:text-slate-100">ABTestResult<span class="text-violet-600 dark:text-violet-400">.com</span></span></a><p class="text-sm text-slate-600 dark:text-slate-400 max-w-sm mb-4">Free statistical tools for A/B testing and experimentation. Calculate sample sizes, analyze test results, and make data-driven decisions with confidence.</p><a href="https://www.linkedin.com/in/andreacorvi/" target="_blank" rel="noopener noreferrer" class="inline-flex items-center gap-1.5 text-sm text-slate-500 hover:text-[#0A66C2] transition-colors" aria-label="LinkedIn Profile"><svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24" fill="currentColor" class="w-4 h-4"><path d="M20.447 20.452h-3.554v-5.569c0-1.328-.027-3.037-1.852-3.037-1.853 0-2.136 1.445-2.136 2.939v5.667H9.351V9h3.414v1.561h.046c.477-.9 1.637-1.85 3.37-1.85 3.601 0 4.267 2.37 4.267 5.455v6.286zM5.337 7.433c-1.144 0-2.063-.926-2.063-2.065 0-1.138.92-2.063 2.063-2.063 1.14 0 2.064.925 2.064 2.063 0 1.139-.925 2.065-2.064 2.065zm1.782 13.019H3.555V9h3.564v11.452zM22.225 0H1.771C.792 0 0 .774 0 1.729v20.542C0 23.227.792 24 1.771 24h20.451C23.2 24 24 23.227 24 22.271V1.729C24 .774 23.2 0 22.222 0h.003z"></path></svg><span>LinkedIn</span></a></div><div><h3 class="font-semibold text-sm text-slate-900 dark:text-slate-100 uppercase tracking-wider mb-4">Calculators</h3><ul class="space-y-3"><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/statistical-calculators">All Calculators</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/statistical-significance-calculator">Statistical Significance Calculator</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/sample-size-calculator">Sample Size Calculator</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/bayesian-calculator">Bayesian Calculator</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/duration-calculator">Duration Calculator</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/roi-calculator">ROI Calculator</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/mde-calculator">MDE Calculator</a></li></ul></div><div><h3 class="font-semibold text-sm text-slate-900 dark:text-slate-100 uppercase tracking-wider mb-4">Articles</h3><ul class="space-y-3"><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles">All Articles</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/ab-testing-mistakes">Common A/B Testing Mistakes</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/continuous-metrics">Continuous Metrics</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/guardrail-metrics">Guardrail Metrics</a></li><li>
1<a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/non-inferiority">Non-Inferiority Testing</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/practical-significance">Practical Significance</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/articles/region-beta-paradox">Region-Beta Paradox</a></li></ul></div><div><h3 class="font-semibold text-sm text-slate-900 dark:text-slate-100 uppercase tracking-wider mb-4">Learn</h3><ul class="space-y-3"><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/resources">All Resources</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/glossary">A/B Testing Glossary</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/books">Books</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/courses">Courses</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/ab-testing-for-beginners"><span class="flex items-center gap-2">Crash course<span class="inline-flex items-center rounded-full font-medium border border-violet-300 text-violet-700 bg-violet-50 dark:border-violet-700 dark:text-violet-400 dark:bg-violet-950/30 gap-1 px-2 py-0.5 text-xs">Free</span></span></a></li></ul></div><div><h3 class="font-semibold text-sm text-slate-900 dark:text-slate-100 uppercase tracking-wider mb-4">More</h3><ul class="space-y-3"><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/api-access">API Access</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/mcp-server">MCP Server</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/ab-testing-tools">A/B Testing Tools Comparison</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/jobs">Experimentation Jobs</a></li><li><a class="text-sm text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors" href="/privacy-policy">Privacy Policy</a></li></ul></div></div><div class="py-6 border-t border-slate-200 dark:border-slate-800"><div class="flex flex-col sm:flex-row items-center justify-between gap-4"><p class="text-sm text-slate-500 dark:text-slate-500">© <!-- -->2026<!-- --> ABTestResult. All rights reserved.</p><div class="flex items-center gap-4 text-sm text-slate-500 dark:text-slate-500"><span>Version <!-- -->3.3</span><span class="hidden sm:inline">·</span><span class="hidden sm:inline">Made with <span class="text-red-500">â¥</span> by<!-- --> <a href="https://www.linkedin.com/in/andreacorvi/" target="_blank" rel="noopener noreferrer" class="text-violet-600 dark:text-violet-400 hover:underline">Andrea Corvi</a></span></div></div></div></div></footer>
1<script>requestAnimationFrame(function(){$RT=performance.now()});</script>
1<script src="/_next/static/chunks/ebd04cfcea9e90b2.js" id="_R_" async=""></script>
1<div hidden id="S:0">
1<script type="application/ld+json">{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://abtestresult.com"},{"@type":"ListItem","position":2,"name":"Articles","item":"https://abtestresult.com/articles"}]}</script>
1<script type="application/ld+json">{"@context":"https://schema.org","@type":"CollectionPage","name":"A/B Testing Articles & Expert Guides","description":"Curated articles on A/B testing covering statistical testing, sample sizing, and experimentation frameworks from industry experts.","mainEntity":{"@type":"ItemList","numberOfItems":23,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://www.awa-digital.com/blog/balancing-experimentation-portfolios/","name":"Explore vs Exploit: Finding the Balance in CRO"},{"@type":"ListItem","position":2,"url":"https://amplitude.com/blog/experiment-brief","name":"Use Experiment Briefs to Design Better Experiments"},{"@type":"ListItem","position":3,"url":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/","name":"Facts and Fictions About Multiple Comparisons"},{"@type":"ListItem","position":4,"url":"https://abtestresult.com/articles/continuous-metrics","name":"Continuous Metrics in A/B Testing: Revenue, AOV, and Session Duration"},{"@type":"ListItem","position":5,"url":"https://abtestresult.com/articles/guardrail-metrics","name":"Guardrail Metrics in A/B Testing: How to Protect Experiments from Hidden Harm"},{"@type":"ListItem","position":6,"url":"https://abtestresult.com/articles/winners-curse","name":"The Winner's Curse in A/B Testing: Why Wins Overestimate Impact"},{"@type":"ListItem","position":7,"url":"https://abtestresult.com/articles/experiment-velocity","name":"Experimentation Velocity for Small Teams: Ship More A/B Tests Without Breaking Everything"},{"@type":"ListItem","position":8,"url":"https://abtestresult.com/articles/ab-testing-interview-questions","name":"Top 20 A/B Testing Interview Questions (with Answers)"},{"@type":"ListItem","position":9,"url":"https://abtestresult.com/articles/ab-testing-mistakes","name":"The 10 Most Common A/B Testing Mistakes (And How to Avoid Them)"},{"@type":"ListItem","position":10,"url":"https://abtestresult.com/articles/journey-testing","name":"From Page Tests to Journey Tests: Designing Experiments That Match How Users Actually Convert"},{"@type":"ListItem","position":11,"url":"https://abtestresult.com/articles/ab-test-design-template","name":"A/B Test Design Template: How to Prevent Bad Decisions"},{"@type":"ListItem","position":12,"url":"https://abtestresult.com/articles/experimentation-team-models","name":"Experimentation Team Models: How to Structure Your A/B Testing Team"},{"@type":"ListItem","position":13,"url":"https://abtestresult.com/articles/practical-significance","name":"Understanding Practical Significance in A/B Testing"},{"@type":"ListItem","position":14,"url":"https://abtestresult.com/articles/region-beta-paradox","name":"The Region-Beta Paradox: Why Small Losses Outlast Big Ones"},{"@type":"ListItem","position":15,"url":"https://abtestresult.com/articles/non-inferiority","name":"Maximising Insights with Non-Inferiority Tests"},{"@type":"ListItem","position":16,"url":"https://positivejohn.substack.com/p/experimentation-itech-media-from","name":"Experimentation: From startup to multiple agile teams"},{"@type":"ListItem","position":17,"url":"https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/","name":"One-tailed vs Two-tailed Tests of Significance in A/B Testing"},{"@type":"ListItem","position":18,"url":"https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit","name":"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing"},{"@type":"ListItem","position":19,"url":"https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/","name":"Underpowered A/B Tests: Confusions, Myths, and Reality"},{"@type":"ListItem","position":20,"url":"https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/","name":"Statistical Significance for Non-Binomial Metrics"},{"@type":"ListItem","position":21,"url":"https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html","name":"Interaction effects in online experimentation"},{"@type":"ListItem","position":22,"url":"https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/","name":"Is non-inferiority on par with superiority?"},{"@type":"ListItem","position":23,"url":"https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html","name":"Power and Sample Size Determination"}]}}</script>
1<article class="flex flex-col"><section class="relative overflow-clip py-16 sm:py-20 lg:py-12 lg:py-24" style="background:linear-gradient(135deg, #1A1837 0%, #24214D 50%, #3B367E 100%)"><div class="pointer-events-none absolute inset-0 z-0" aria-hidden="true"><canvas class="size-full"></canvas></div><div class="absolute inset-0 overflow-hidden pointer-events-none"><div class="absolute top-0 left-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-rose-500/15 rounded-full blur-3xl"></div><div class="absolute bottom-0 right-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-pink-500/15 rounded-full blur-3xl"></div></div><div class="relative z-10 max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="text-center"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="inline-flex items-center gap-2 px-4 py-2 rounded-full bg-white/10 backdrop-blur-sm border border-white/10 mb-6"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-4 h-4 text-rose-400" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg><span class="text-sm text-white/80">Curated Articles</span></div></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><h1 class="text-4xl sm:text-5xl lg:text-6xl font-bold tracking-tight mb-6"><span class="text-white/90">Expert </span><span class="bg-gradient-to-r from-rose-400 via-pink-400 to-rose-300 bg-clip-text text-transparent pb-2">Articles</span></h1></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><p class="text-lg sm:text-xl max-w-2xl mx-auto text-slate-300 leading-relaxed">Our own guides and curated articles from industry experts on A/B testing methodology, statistical testing, sample sizing, and experimentation frameworks.</p></div></div></div><div class="absolute bottom-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent"></div></section><nav aria-label="Breadcrumb" class="w-full bg-slate-50 dark:bg-slate-950"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8 py-2.5 sm:py-3"><ol class="flex items-center gap-1 sm:gap-1.5 text-xs sm:text-sm flex-wrap"><li class="flex items-center gap-1 sm:gap-1.5 min-w-0"><a class="text-slate-600 dark:text-slate-400 hover:text-violet-600 dark:hover:text-violet-400 transition-colors truncate max-w-[120px] sm:max-w-none" href="/"><span class="flex items-center gap-1"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-house w-3 h-3 sm:w-3.5 sm:h-3.5" aria-hidden="true"><path d="M15 21v-8a1 1 0 0 0-1-1h-4a1 1 0 0 0-1 1v8"></path><path d="M3 10a2 2 0 0 1 .709-1.528l7-6a2 2 0 0 1 2.582 0l7 6A2 2 0 0 1 21 10v9a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2z"></path></svg><span class="sr-only">Home</span></span></a></li><li class="flex items-center gap-1 sm:gap-1.5 min-w-0"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-chevron-right w-3 h-3 sm:w-3.5 sm:h-3.5 text-slate-400 dark:text-slate-600 flex-shrink-0" aria-hidden="true"><path d="m9 18 6-6-6-6"></path></svg><span class="text-slate-500 dark:text-slate-400 truncate max-w-[180px] sm:max-w-none" aria-current="page">Articles</span></li></ol></div></nav><section class="pt-12 pb-0 bg-slate-50 dark:bg-slate-950"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><p class="text-body-lg text-slate-600 dark:text-slate-400">A curated collection of articles on A/B testing, statistical analysis, and experimentation strategy. These resources cover everything from sample size calculations and test design to advanced topics like multiple comparisons and interaction effects. Each article includes a summary and ke
1y takeaways to help you apply these concepts to your own experiments.</p></div></div></section><section class="py-12 lg:py-24 bg-slate-50 dark:bg-slate-950"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="mb-10"><div class="mb-2"><h2 class="text-h2 text-slate-900 dark:text-slate-100">Our Articles</h2></div><p class="text-body text-slate-600 dark:text-slate-400">In-depth articles written by our team on experimentation methodology and decision making.</p></div></div><div class="grid grid-cols-1 sm:grid-cols-2 lg:grid-cols-3 gap-6"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/winners-curse"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #b91c1c, #f43f5e)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_634avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Sample Size & Power</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>5 February 2026</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">The Winner's Curse in A/B Testing: Why Wins Overestimate Impact</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Significant A/B test wins overstate lift. Learn why selection bias inflates results, how power affects exaggeration, and how to report impact honestly.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/guardrail-metrics"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #22c55e, #0ea5e9)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_654avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-trans
1parent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Guardrail Metrics</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>2 February 2026</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Guardrail Metrics in A/B Testing: How to Protect Experiments from Hidden Harm</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Guardrail metrics protect your experiments from unintended damage. Learn how to choose, test, and implement guardrails with non-inferiority testing, including Spotify's decision framework.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/experimentation-team-models"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #38bdf8, #818cf8)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_674avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>
1Framework</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>31 January 2026</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Experimentation Team Models: How to Structure Your A/B Testing Team</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Compare centralized, decentralized, and Center of Excellence experimentation team models. Find the right structure for your organisation.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/ab-testing-interview-questions"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #8b5cf6, #d946ef)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_694avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Interview Prep</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>02 January 2026</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Top 20 A/B Testing Interview Questions (with Answers)</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Master the essential A/B testing interview questions covering p-values, statistical power, sample sizes, and one/two-tailed tests. Practice with real calculations.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/ab-testing-mistakes"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #dc2626, #fb923c)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6b4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-trans
1parent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Best Practices</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>15 November 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">The 10 Most Common A/B Testing Mistakes (And How to Avoid Them)</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Learn the most common A/B testing mistakes beginners make, from peeking too early to choosing wrong metrics. Includes statistical impact charts and a pre-test checklist.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/journey-testing"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #06b6d4, #f59e0b)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6d4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Framework</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>18 October 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">From Page Tests to Journey Tests: Designing Experiments That Match How Users Actually Convert</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Move beyond page-level CRO. Learn how to define journeys, pick the right unit and metrics, plan sample size, and avoid attribution traps.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/continuous-metrics"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #0ea5e9, #475569)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6f4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-trans
1parent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Non-Binomial</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>15 September 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Continuous Metrics in A/B Testing: Revenue, AOV, and Session Duration</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">How to test revenue per user, AOV, and session duration with t-tests, proper sample sizes, and variance estimation for non-binomial metrics.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/experiment-velocity"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #14b8a6, #a3e635)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6h4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Framework</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>15 June 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Experimentation Velocity for Small Teams: Ship More A/B Tests Without Breaking Everything</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">A practical playbook to increase experiment velocity on a small team with templates, guardrails, and a realistic monthly cadence.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/ab-test-design-template"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #059669, #3b82f6)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6j4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-trans
1parent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Framework</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>15 April 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">A/B Test Design Template: How to Prevent Bad Decisions</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Turn experimentation tribal knowledge into a structured checklist that enforces trustworthy tests. Includes copy-ready template with hypothesis, metrics, pre-flight checks, and stop rules.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/practical-significance"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #3b82f6, #6366f1)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6l4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Practical Significance</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>29 January 2025</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Understanding Practical Significance in A/B Testing</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Statistical significance tells you if a result is real. Practical significance tells you if it matters.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/region-beta-paradox"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #f97316, #ef4444)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6n4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-trans
1parent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Decision Making</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>15 May 2024</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">The Region-Beta Paradox: Why Small Losses Outlast Big Ones</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Small negative A/B test results damage your program more than big failures. The psychology behind why, and what to do about it.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a class="group block h-full" href="/articles/non-inferiority"><div class="h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]" style="background:linear-gradient(135deg, #8b5cf6, #a855f7)"><svg aria-hidden="true" class="pointer-events-none h-full w-full text-neutral-400/80 absolute inset-0 fill-white/15"><defs><radialGradient id="_R_6p4avpfelb_-gradient"><stop offset="0%" stop-color="currentColor" stop-opacity="1"></stop><stop offset="100%" stop-color="currentColor" stop-opacity="0"></stop></radialGradient></defs></svg><div class="absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50"></div><div class="relative z-10 p-6 sm:p-8 flex flex-col h-full"><div class="flex items-center justify-between mb-4"><span class="inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-bookmark w-3 h-3" aria-hidden="true"><path d="M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z"></path></svg>Non Inferiority</span><span class="inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-calendar-days w-3 h-3" aria-hidden="true"><path d="M8 2v4"></path><path d="M16 2v4"></path><rect width="18" height="18" x="3" y="4" rx="2"></rect><path d="M3 10h18"></path><path d="M8 14h.01"></path><path d="M12 14h.01"></path><path d="M16 14h.01"></path><path d="M8 18h.01"></path><path d="M12 18h.01"></path><path d="M16 18h.01"></path></svg>28 February 2024</span></div><div class="mt-auto"><h3 class="text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]">Maximising Insights with Non-Inferiority Tests</h3><p class="text-sm text-white/80 mb-4 line-clamp-3">Non-inferiority tests are often overlooked in A/B testing. Learn how to use them to your advantage.</p><div class="flex items-center justify-between"><span class="flex items-center gap-2 text-sm text-white/70"><img alt="Andrea Corvi" loading="lazy" width="20" height="20" decoding="async" data-nimg="1" class="w-5 h-5 rounded-full object-cover" style="color:transparent" srcSet="/_next/image?url=%2Fandrea.jpeg&w=32&q=75 1x, /_next/image?url=%2Fandrea.jpeg&w=48&q=75 2x" src="/_next/image?url=%2Fandrea.jpeg&w=48&q=75"/>Andrea Corvi</span><span class="inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all">Read article<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></span></div></div></div></div></a></div></div></div></section>
1<section class="py-12 lg:py-24 bg-slate-100 dark:bg-slate-900/50"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="mb-10"><h2 class="text-h2 text-slate-900 dark:text-slate-100 mb-2">From the Community</h2><p class="text-body text-slate-600 dark:text-slate-400">Deep dives into specific topics and methodologies from industry experts</p></div></div><div class="grid grid-cols-1 md:grid-cols-2 lg:grid-cols-3 gap-5"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://www.awa-digital.com/blog/balancing-experimentation-portfolios/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 2 #8b5cf6, 3 #ec4899, 4 transparent 100% 5 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">awa-digital.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
5k:group-hover:text-rose-400 transition-colors line-clamp-2">Explore vs Exploit: Finding the Balance in CRO</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Applies the explore/exploit tradeoff from probability theory to CRO portfolios. Proposes frameworks like the 70-20-10 rule for balancing incremental optimization with bold hypothesis testing, with ratios shifting based on organizational maturity.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->David Sanchez</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://amplitude.com/blog/experiment-brief" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 6 #8b5cf6, 7 #ec4899, 8 transparent 100% 9 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">amplitude.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dar
9k:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Use Experiment Briefs to Design Better Experiments</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Introduces experiment briefs as structured templates covering four phases: Plan, Configure, Monitor, and Analyze. Forces teams to document hypotheses, predetermined actions for each outcome, and sample size requirements before running any test.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Bhavik Patel</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 10 #8b5cf6, 11 #ec4899, 12 transparent 100% 13 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">ncbi.nlm.nih.gov</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-rose-100 dar
13k:bg-rose-900/30 text-rose-700 dark:text-rose-300 border-rose-200 dark:border-rose-800">Multiple comparisons</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Facts and Fictions About Multiple Comparisons</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Examines how running multiple statistical tests inflates false positive rates. With just 13 independent comparisons at alpha 0.05, the probability of at least one spurious significant result reaches 50%. Covers correction methods from conservative (Bonferroni) to more nuanced (Benjamini-Hochberg).</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Gail M. Sullivan</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://positivejohn.substack.com/p/experimentation-itech-media-from" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 14 #8b5cf6, 15 #ec4899, 16 transparent 100% 17 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">substack.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dar
17k:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Experimentation: From startup to multiple agile teams</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">A case study tracing how an organization scaled its experimentation practice from ad-hoc testing in a startup environment to systematic experimentation across multiple agile teams. Covers the organizational and cultural shifts required at each growth stage.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Positive John</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 18 #8b5cf6, 19 #ec4899, 20 transparent 100% 21 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">analytics-toolkit.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-teal-100 dar
21k:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800">Test type</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">One-tailed vs Two-tailed Tests of Significance in A/B Testing</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Argues that one-tailed tests are preferable for most A/B testing scenarios because practitioners act differently depending on whether a result is positive or negative. One-tailed tests require 20-60% smaller sample sizes for the same statistical power and eliminate directional sign errors.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Georgi Georgiev</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 22 #8b5cf6, 23 #ec4899, 24 transparent 100% 25 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">docs.google.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-teal-100 dar
25k:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800">Test type</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Kohavi argues that organizations sharing experiment results for learning or accountability should use two-sided tests or the TOST equivalence testing procedure. TOST provides a rigorous framework for declaring that a treatment has no meaningful effect, which standard null hypothesis testing cannot do.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Ron Kohavi</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 26 #8b5cf6, 27 #ec4899, 28 transparent 100% 29 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">analytics-toolkit.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-blue-100 dar
29k:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800">Sample Size & Power</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Underpowered A/B Tests: Confusions, Myths, and Reality</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Debunks three common myths about underpowered tests. Distinguishes between hypothetical effect sizes (used in planning), true effect sizes (unknown), and observed effect sizes (from data). Demonstrates that requiring post-hoc power verification of significant results leads to rejecting valid findings.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Georgi Georgiev</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 30 #8b5cf6, 31 #ec4899, 32 transparent 100% 33 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">analytics-toolkit.com</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-emerald-100 dark:bg-emerald-900/30 text-emerald-700 dark:text-emerald-300 border-emerald-200 dark:border-emerald-800">
33Non-Binomial</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Statistical Significance for Non-Binomial Metrics</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Explains how to test statistical significance for continuous metrics like revenue per user, average order value, and pages per session. The key insight is that the sample statistic distribution (not the raw data distribution) determines test validity, and the Central Limit Theorem makes standard t-tests appropriate even for highly skewed metrics.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Georgi Georgiev</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 34 #8b5cf6, 35 #ec4899, 36 transparent 100% 37 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">lukasvermeer.nl</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-pink-100 dark:bg-pink-900/30 text-pink-700 dark:text-pink-300 border-pink-200 dark:border-pink-800">Interaction Effects</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
37k:group-hover:text-rose-400 transition-colors line-clamp-2">Interaction effects in online experimentation</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Distinguishes two types of overlapping experiment interactions: traffic interactions (where one experiment alters user flow to another's pages, creating sampling bias) and metric interactions (where combined effects differ from the sum of isolated effects). Argues that interaction detection is more valuable than blanket avoidance of overlapping tests.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Lukas Vermeer</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 38 #8b5cf6, 39 #ec4899, 40 transparent 100% 41 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">rdatagen.net</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-amber-100 dar
41k:bg-amber-900/30 text-amber-700 dark:text-amber-300 border-amber-200 dark:border-amber-800">Non Inferiority</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Is non-inferiority on par with superiority?</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">Examines the statistical mechanics of non-inferiority testing compared to superiority testing. The core challenge is the non-inferiority margin (delta): unlike superiority tests that compare against zero, non-inferiority requires a subjective threshold that directly influences conclusions.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Keith Goldfeld</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><a href="https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html" target="_blank" rel="noopener noreferrer" class="group block h-full"><div class="group relative h-full rounded-xl"><div class="pointer-events-none absolute inset-0 rounded-[inherit] duration-300 group-hover:opacity-100" style="background:radial-gradient(250px circle at -250px -250px, 42 #8b5cf6, 43 #ec4899, 44 transparent 100% 45 )"></div><div class="absolute inset-px rounded-[inherit] bg-white dark:bg-slate-800"></div><div class="pointer-events-none absolute inset-px rounded-[inherit] opacity-0 transition-opacity duration-300 group-hover:opacity-100" style="opacity:0.4;background:radial-gradient(250px circle at -250px -250px, #8b5cf620, transparent 100%)"></div><div class="relative h-full"><div class="p-5 flex flex-col h-full"><div class="flex items-center justify-between gap-2 mb-3"><div class="flex items-center gap-2 min-w-0"><img alt="" loading="lazy" width="16" height="16" decoding="async" data-nimg="1" class="w-4 h-4 rounded-sm shrink-0" style="color:transparent" sizes="16px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D32&w=3840&q=75"/><span class="text-xs text-slate-400 dark:text-slate-500 truncate">bu.edu</span></div><span class="inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-blue-100 dar
45k:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800">Sample Size & Power</span></div><h3 class="font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2">Power and Sample Size Determination</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed">A comprehensive academic module covering the factors that determine required sample sizes for hypothesis testing. Walks through formulas for comparing means, proportions, and testing associations, emphasizing the interplay between significance level, power, effect size, and variability.</p><div class="flex items-center justify-between mt-auto pt-2"><span class="text-body-sm text-slate-500 dark:text-slate-400">by <!-- -->Lisa Sullivan, PhD</span><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></div></div></div></div></a></div></div></div></section><section class="py-12 lg:py-24 bg-slate-50 dark:bg-slate-950"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="mb-12"><h2 class="text-h2 text-slate-900 dark:text-slate-100 mb-4">What You Will Learn From These Articles</h2><p class="text-body-lg text-slate-600 dark:text-slate-400 leading-relaxed max-w-3xl">This collection covers the core topics that experimentation practitioners encounter regularly. Each article addresses a specific problem with concrete guidance rather than general advice. Below you will find an overview by topic, followed by individual summaries and key takeaways for every article.</p></div></div><div class="grid grid-cols-1 md:grid-cols-2 gap-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="space-y-3"><div class="flex items-center gap-2.5"><div class="w-9 h-9 rounded-lg bg-violet-100 dark:bg-violet-900/30 flex items-center justify-center shrink-0"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-beaker w-4.5 h-4.5 text-violet-600 dark:text-violet-400" aria-hidden="true"><path d="M4.5 3h15"></path><path d="M6 3v16a2 2 0 0 0 2 2h8a2 2 0 0 0 2-2V3"></path><path d="M6 14h12"></path></svg></div><h3 class="text-lg font-bold text-slate-900 dark:text-slate-100">Experiment Design & Frameworks</h3></div><p class="text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed">How to decide what to test, how to document experiments so the reasoning survives team changes, and how to balance safe incremental tests with higher-risk exploratory ones. The articles on <a href="#use-experiment-briefs-to-design-better-experiments" class="text-rose-600 dar
45k:text-rose-400 hover:underline">experiment briefs</a> and <a href="#explore-vs-exploit-finding-the-balance-in-cro" class="text-rose-600 dark:text-rose-400 hover:underline">explore vs exploit</a> provide structured frameworks for portfolio-level test planning, while the <a href="#experimentation-from-startup-to-multiple-agile-teams" class="text-rose-600 dark:text-rose-400 hover:underline">scaling case study</a> shows how these practices evolve as organizations grow.</p></div></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="space-y-3"><div class="flex items-center gap-2.5"><div class="w-9 h-9 rounded-lg bg-teal-100 dark:bg-teal-900/30 flex items-center justify-center shrink-0"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-flask-conical w-4.5 h-4.5 text-teal-600 dark:text-teal-400" aria-hidden="true"><path d="M14 2v6a2 2 0 0 0 .245.96l5.51 10.08A2 2 0 0 1 18 22H6a2 2 0 0 1-1.755-2.96l5.51-10.08A2 2 0 0 0 10 8V2"></path><path d="M6.453 15h11.094"></path><path d="M8.5 2h7"></path></svg></div><h3 class="text-lg font-bold text-slate-900 dark:text-slate-100">Statistical Testing Methods</h3></div><p class="text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed">The choice of test type has direct consequences for required <a class="text-rose-600 dar
45k:text-rose-400 hover:underline" href="/sample-size-calculator">sample size</a>, error rates, and what conclusions you can draw. These articles cover the <a href="#one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing" class="text-rose-600 dark:text-rose-400 hover:underline">one-tailed vs two-tailed debate</a> with quantified tradeoffs, Kohavi's case for <a href="#use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing" class="text-rose-600 dark:text-rose-400 hover:underline">TOST equivalence testing</a>, and <a class="text-rose-600 dark:text-rose-400 hover:underline" href="/articles/non-inferiority">non-inferiority testing</a> for situations where ânot worseâ is the goal.</p></div></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="space-y-3"><div class="flex items-center gap-2.5"><div class="w-9 h-9 rounded-lg bg-blue-100 dark:bg-blue-900/30 flex items-center justify-center shrink-0"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-chart-column w-4.5 h-4.5 text-blue-600 dark:text-blue-400" aria-hidden="true"><path d="M3 3v16a2 2 0 0 0 2 2h16"></path><path d="M18 17V9"></path><path d="M13 17V5"></path><path d="M8 17v-3"></path></svg></div><h3 class="text-lg font-bold text-slate-900 dark:text-slate-100">Sample Size & Statistical Power</h3></div><p class="text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed">Running a test without adequate power is the most common and most expensive mistake in experimentation. These articles cover the <a href="#power-and-sample-size-determination" class="text-rose-600 dar
45k:text-rose-400 hover:underline">four factors that determine sample size</a>, debunk persistent <a href="#underpowered-a-b-tests-confusions-myths-and-reality" class="text-rose-600 dark:text-rose-400 hover:underline">myths about post-hoc power analysis</a> that lead teams to reject valid results, and provide formulas for computing required samples. Use our <a class="text-rose-600 dark:text-rose-400 hover:underline" href="/sample-size-calculator">sample size calculator</a> to apply these concepts.</p></div></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="space-y-3"><div class="flex items-center gap-2.5"><div class="w-9 h-9 rounded-lg bg-pink-100 dark:bg-pink-900/30 flex items-center justify-center shrink-0"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-layers w-4.5 h-4.5 text-pink-600 dark:text-pink-400" aria-hidden="true"><path d="M12.83 2.18a2 2 0 0 0-1.66 0L2.6 6.08a1 1 0 0 0 0 1.83l8.58 3.91a2 2 0 0 0 1.66 0l8.58-3.9a1 1 0 0 0 0-1.83z"></path><path d="M2 12a1 1 0 0 0 .58.91l8.6 3.91a2 2 0 0 0 1.65 0l8.58-3.9A1 1 0 0 0 22 12"></path><path d="M2 17a1 1 0 0 0 .58.91l8.6 3.91a2 2 0 0 0 1.65 0l8.58-3.9A1 1 0 0 0 22 17"></path></svg></div><h3 class="text-lg font-bold text-slate-900 dark:text-slate-100">Advanced Topics</h3></div><p class="text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed">Topics that matter once you move beyond basic conversion rate testing. <a href="#facts-and-fictions-about-multiple-comparisons" class="text-rose-600 dar
45k:text-rose-400 hover:underline">Multiple comparisons</a> explains why testing many metrics inflates false positives and how corrections like Bonferroni and Benjamini-Hochberg work. The <a href="#statistical-significance-for-non-binomial-metrics" class="text-rose-600 dark:text-rose-400 hover:underline">non-binomial metrics article</a> shows how to apply t-tests to revenue and other continuous metrics. <a href="#interaction-effects-in-online-experimentation" class="text-rose-600 dark:text-rose-400 hover:underline">Interaction effects</a> covers what happens when overlapping experiments influence each other.</p></div></div></div></div></section><section class="py-12 lg:py-24 bg-slate-100 dark:bg-slate-900/50"><div class="max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="mb-12"><h2 class="text-h2 text-slate-900 dark:text-slate-100 mb-4">Article Summaries & Key Takeaways</h2><p class="text-body-lg text-slate-600 dark:text-slate-400">What each article covers and the most important points to take away from it. For additional context on the statistical concepts discussed here, see our <a class="text-rose-600 dar
45k:text-rose-400 hover:underline" href="/statistical-significance-calculator">significance calculator</a> and <a class="text-rose-600 dark:text-rose-400 hover:underline" href="/glossary">A/B testing glossary</a>.</p></div></div><div class="max-w-4xl mx-auto space-y-12"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="explore-vs-exploit-finding-the-balance-in-cro" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-explore-vs-exploit-finding-the-balance-in-cro"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dawa-digital.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span><span class="text-xs text-slate-400 dark:text-slate-500">awa-digital.com</span></div><h3 id="heading-explore-vs-exploit-finding-the-balance-in-cro" class="text-h3 text-slate-900 dark:text-slate-100">Explore vs Exploit: Finding the Balance in CRO</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->David Sanchez</p><a href="https://www.awa-digital.com/blog/balancing-experimentation-portfolios/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Applies the explore/exploit tradeoff from probability theory to CRO portfolios. Proposes frameworks like the 70-20-10 rule for balancing incremental optimization with bold hypothesis testing, with ratios shifting based on organizational maturity.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Exploitation keeps revenue flowing but risks competitive obsolescence; exploration creates future growth but has higher failure rates. Neither alone is a viable strategy.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The 70-20-10 model (70% core optimization, 20% adjacent innovation, 10% transformational bets) provides a practical starting ratio, adapted from Google's resource allocation approach.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The right balance depends on company maturity: pre-product-market-fit companies should explore almost exclusively, while mature organizations shift toward exploitation with structured exploration.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="use-experiment-briefs-to-design-better-experiments" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-use-experiment-briefs-to-design-better-experiments"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Damplitude.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span><span class="text-xs text-slate-400 dark:text-slate-500">amplitude.com</span></div><h3 id="heading-use-experiment-briefs-to-design-better-experiments" class="text-h3 text-slate-900 dark:text-slate-100">Use Experiment Briefs to Design Better Experiments</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Bhavik Patel</p><a href="https://amplitude.com/blog/experiment-brief" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Introduces experiment briefs as structured templates covering four phases: Plan, Configure, Monitor, and Analyze. Forces teams to document hypotheses, predetermined actions for each outcome, and sample size requirements before running any test.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">A "good experiment" is a well-designed experiment, not one that produces a winning result. Briefs enforce this distinction by separating design quality from outcome.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Predetermined actions prevent post-hoc rationalization. Teams decide what they will do with a win, loss, or flat result before seeing data.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Experiment briefs create institutional knowledge that survives team turnover, making the reasoning behind past decisions accessible to future team members.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="facts-and-fictions-about-multiple-comparisons" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-facts-and-fictions-about-multiple-comparisons"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dncbi.nlm.nih.gov%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-rose-100 dark:bg-rose-900/30 text-rose-700 dark:text-rose-300 border-rose-200 dark:border-rose-800">Multiple comparisons</span><span class="text-xs text-slate-400 dark:text-slate-500">ncbi.nlm.nih.gov</span></div><h3 id="heading-facts-and-fictions-about-multiple-comparisons" class="text-h3 text-slate-900 dark:text-slate-100">Facts and Fictions About Multiple Comparisons</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Gail M. Sullivan</p><a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Examines how running multiple statistical tests inflates false positive rates. With just 13 independent comparisons at alpha 0.05, the probability of at least one spurious significant result reaches 50%. Covers correction methods from conservative (Bonferroni) to more nuanced (Benjamini-Hochberg).</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The probability of at least one false positive grows rapidly with each additional test: 10 comparisons at alpha 0.05 produce a 40% chance of a spurious significant result.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Bonferroni correction (dividing alpha by number of comparisons) is simple but conservative. Benjamini-Hochberg controls the false discovery rate and is often more practical for experimentation.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Prespecifying which comparisons you plan to run, and how many, is the single most effective defense against multiple comparison problems.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="experimentation-from-startup-to-multiple-agile-teams" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-experimentation-from-startup-to-multiple-agile-teams"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dsubstack.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800">Framework</span><span class="text-xs text-slate-400 dark:text-slate-500">substack.com</span></div><h3 id="heading-experimentation-from-startup-to-multiple-agile-teams" class="text-h3 text-slate-900 dark:text-slate-100">Experimentation: From startup to multiple agile teams</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Positive John</p><a href="https://positivejohn.substack.com/p/experimentation-itech-media-from" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">A case study tracing how an organization scaled its experimentation practice from ad-hoc testing in a startup environment to systematic experimentation across multiple agile teams. Covers the organizational and cultural shifts required at each growth stage.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Early-stage experimentation is about building the habit: any test is better than no test, even if the methodology is imperfect.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Scaling experimentation requires dedicated ownership. Without someone responsible for test quality and prioritization, experimentation degrades as teams grow.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Cross-team experimentation needs shared infrastructure and standards to prevent conflicting tests and ensure consistent statistical rigor.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800">Test type</span><span class="text-xs text-slate-400 dark:text-slate-500">analytics-toolkit.com</span></div><h3 id="heading-one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing" class="text-h3 text-slate-900 dark:text-slate-100">One-tailed vs Two-tailed Tests of Significance in A/B Testing</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Georgi Georgiev</p><a href="https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Argues that one-tailed tests are preferable for most A/B testing scenarios because practitioners act differently depending on whether a result is positive or negative. One-tailed tests require 20-60% smaller sample sizes for the same statistical power and eliminate directional sign errors.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The choice between one-tailed and two-tailed tests depends on your decision framework, not on statistical accuracy. Both are equally valid; they answer different questions.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">One-tailed tests require substantially smaller samples (20-60% less traffic) to achieve the same power, directly reducing test duration.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Two-tailed tests introduce the possibility of Type III errors (getting the direction of the effect wrong), which one-tailed tests avoid by design.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Ddocs.google.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800">Test type</span><span class="text-xs text-slate-400 dark:text-slate-500">docs.google.com</span></div><h3 id="heading-use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing" class="text-h3 text-slate-900 dark:text-slate-100">Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Ron Kohavi</p><a href="https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Kohavi argues that organizations sharing experiment results for learning or accountability should use two-sided tests or the TOST equivalence testing procedure. TOST provides a rigorous framework for declaring that a treatment has no meaningful effect, which standard null hypothesis testing cannot do.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Two-sided tests protect against confirmation bias by treating both directions equally, making them appropriate when results are shared publicly or used for organizational learning.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">TOST (Two One-Sided Tests) can rigorously declare "no meaningful effect," filling a gap that standard null hypothesis testing leaves open.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The choice between one-sided and two-sided/TOST depends on whether you need to convince others (use TOST/two-sided) or make internal go/no-go decisions (one-sided is acceptable).</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="underpowered-a-b-tests-confusions-myths-and-reality" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-underpowered-a-b-tests-confusions-myths-and-reality"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-blue-100 dar
45k:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800">Sample Size & Power</span><span class="text-xs text-slate-400 dark:text-slate-500">analytics-toolkit.com</span></div><h3 id="heading-underpowered-a-b-tests-confusions-myths-and-reality" class="text-h3 text-slate-900 dark:text-slate-100">Underpowered A/B Tests: Confusions, Myths, and Reality</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Georgi Georgiev</p><a href="https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dark:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Debunks three common myths about underpowered tests. Distinguishes between hypothetical effect sizes (used in planning), true effect sizes (unknown), and observed effect sizes (from data). Demonstrates that requiring post-hoc power verification of significant results leads to rejecting valid findings.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">A statistically significant result does not need retroactive power verification. If the null hypothesis is rejected at the planned alpha level, the result stands regardless of post-hoc power calculations.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Conflating observed lift with the minimum detectable effect leads to unnecessarily conservative decisions, sometimes making error control 50x more stringent than intended.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Proper power analysis belongs in the planning phase. Using it to evaluate completed tests is a category error that confuses planning parameters with inferential outcomes.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="statistical-significance-for-non-binomial-metrics" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-statistical-significance-for-non-binomial-metrics"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Danalytics-toolkit.com%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-emerald-100 dark:bg-emerald-900/30 text-emerald-700 dark:text-emerald-300 border-emerald-200 dark:border-emerald-800">
45Non-Binomial</span><span class="text-xs text-slate-400 dark:text-slate-500">analytics-toolkit.com</span></div><h3 id="heading-statistical-significance-for-non-binomial-metrics" class="text-h3 text-slate-900 dark:text-slate-100">Statistical Significance for Non-Binomial Metrics</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Georgi Georgiev</p><a href="https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dark:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Explains how to test statistical significance for continuous metrics like revenue per user, average order value, and pages per session. The key insight is that the sample statistic distribution (not the raw data distribution) determines test validity, and the Central Limit Theorem makes standard t-tests appropriate even for highly skewed metrics.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Non-normal data distributions do not invalidate t-tests. The Central Limit Theorem ensures the sampling distribution of means is approximately normal regardless of the underlying data shape.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Testing non-binomial metrics requires extracting user-level or session-level data to estimate variance, then applying standard t-test methodology with the pooled standard error of the mean.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">For multiple metric comparisons, Dunnett's correction provides tighter confidence intervals than Bonferroni while still controlling family-wise error rate.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="interaction-effects-in-online-experimentation" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-interaction-effects-in-online-experimentation"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dlukasvermeer.nl%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-pink-100 dark:bg-pink-900/30 text-pink-700 dark:text-pink-300 border-pink-200 dark:border-pink-800">Interaction Effects</span><span class="text-xs text-slate-400 dark:text-slate-500">lukasvermeer.nl</span></div><h3 id="heading-interaction-effects-in-online-experimentation" class="text-h3 text-slate-900 dark:text-slate-100">Interaction effects in online experimentation</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Lukas Vermeer</p><a href="https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Distinguishes two types of overlapping experiment interactions: traffic interactions (where one experiment alters user flow to another's pages, creating sampling bias) and metric interactions (where combined effects differ from the sum of isolated effects). Argues that interaction detection is more valuable than blanket avoidance of overlapping tests.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Not all overlapping experiments interact. Traffic interactions create sampling bias, while metric interactions produce genuinely different combined effects. The distinction matters for diagnosis and resolution.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Detected interactions often reveal functional conflicts degrading user experience, making them diagnostic signals rather than merely statistical nuisances.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Organizations should focus on detecting interactions rather than preventing all experiment overlap, because detection leads to new insights while avoidance limits experimentation velocity.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="is-non-inferiority-on-par-with-superiority" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-is-non-inferiority-on-par-with-superiority"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Drdatagen.net%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-amber-100 dark:bg-amber-900/30 text-amber-700 dark:text-amber-300 border-amber-200 dark:border-amber-800">Non Inferiority</span><span class="text-xs text-slate-400 dark:text-slate-500">rdatagen.net</span></div><h3 id="heading-is-non-inferiority-on-par-with-superiority" class="text-h3 text-slate-900 dark:text-slate-100">Is non-inferiority on par with superiority?</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Keith Goldfeld</p><a href="https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Examines the statistical mechanics of non-inferiority testing compared to superiority testing. The core challenge is the non-inferiority margin (delta): unlike superiority tests that compare against zero, non-inferiority requires a subjective threshold that directly influences conclusions.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Non-inferiority testing shifts the null hypothesis from "no difference" to "the new treatment is worse by at least delta," making the choice of delta the most consequential design decision.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">The same data can yield different non-inferiority conclusions depending on the chosen margin, while superiority conclusions remain stable. This makes margin selection a point of vulnerability.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Principled delta selection based on clinical or business relevance matters more than simply increasing sample size for making compelling non-inferiority claims.</p></li></ol></div></div></section></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><section id="power-and-sample-size-determination" class="scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950" aria-labelledby="heading-power-and-sample-size-determination"><div class="relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50"><div class="flex items-start gap-4"><div class="shrink-0 mt-1"><img alt="" loading="lazy" width="28" height="28" decoding="async" data-nimg="1" class="w-7 h-7 rounded-md" style="color:transparent" sizes="28px" srcSet="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=32&q=75 32w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=48&q=75 48w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=64&q=75 64w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=96&q=75 96w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=128&q=75 128w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=256&q=75 256w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=384&q=75 384w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=640&q=75 640w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=750&q=75 750w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=828&q=75 828w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=1080&q=75 1080w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=1200&q=75 1200w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=1920&q=75 1920w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=2048&q=75 2048w, /_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=3840&q=75 3840w" src="/_next/image?url=https%3A%2F%2Fwww.google.com%2Fs2%2Ffavicons%3Fdomain%3Dbu.edu%26sz%3D64&w=3840&q=75"/></div><div class="flex-1 min-w-0"><div class="flex items-center gap-2 mb-1.5 flex-wrap"><span class="inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-blue-100 dark:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800">Sample Size & Power</span><span class="text-xs text-slate-400 dark:text-slate-500">bu.edu</span></div><h3 id="heading-power-and-sample-size-determination" class="text-h3 text-slate-900 dark:text-slate-100">Power and Sample Size Determination</h3><p class="text-body-sm text-slate-500 dark:text-slate-400 mt-1.5">by <!-- -->Lisa Sullivan, PhD</p><a href="https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html" target="_blank" rel="noopener noreferrer" class="mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
45k:text-rose-400 hover:opacity-80 transition-opacity">Read the full article <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-external-link w-3.5 h-3.5" aria-hidden="true"><path d="M15 3h6v6"></path><path d="M10 14 21 3"></path><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path></svg></a></div></div></div><div class="p-6 sm:p-8 lg:p-10 space-y-8"><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M12 7v14"></path><path d="M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">What this article covers</h4></div><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">A comprehensive academic module covering the factors that determine required sample sizes for hypothesis testing. Walks through formulas for comparing means, proportions, and testing associations, emphasizing the interplay between significance level, power, effect size, and variability.</p></div><div><div class="flex items-center gap-2 mb-3"><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500" aria-hidden="true"><path d="M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5"></path><path d="M9 18h6"></path><path d="M10 22h4"></path></svg><h4 class="text-overline text-slate-500 dark:text-slate-400">Key takeaways</h4></div><ol class="space-y-4"><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">1</span>
45<p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Four factors determine sample size: significance level (alpha), desired power (1 minus beta), the minimum effect size of interest, and the variability of the outcome. Changing any one directly affects the required sample.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">2</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Power and sample size have a nonlinear relationship. Increasing power from 80% to 90% requires substantially more than a 12.5% increase in sample size.</p></li><li class="flex gap-3.5"><span class="shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500">3</span><p class="text-body text-slate-700 dark:text-slate-300 leading-relaxed">Effect size estimation is the most difficult and most important input. Overly optimistic effect size assumptions lead to underpowered tests, while conservative estimates lead to unnecessarily long tests.</p></li></ol></div></div></section></div></div></div></section><section class="relative py-16 overflow-hidden" style="background:linear-gradient(135deg, #1A1837 0%, #24214D 50%, #3B367E 100%)"><div class="absolute inset-0 flex h-full w-full items-center justify-center [mask-repeat:no-repeat] [mask-size:40px]"><svg class="pointer-events-none absolute z-0 h-full w-full" width="100%" height="100%" viewBox="0 0 696 316" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M-380 -189C-380 -189 -312 216 152 343C616 470 684 875 684 875M-352 -221C-352 -221 -284 184 180 311C644 438 712 843 712 843M-324 -253C-324 -253 -256 152 208 279C672 406 740 811 740 811M-296 -285C-296 -285 -228 120 236 247C700 374 768 779 768 779M-268 -317C-268 -317 -200 88 264 215C728 342 796 747 796 747M-240 -349C-240 -349 -172 56 292 183C756 310 824 715 824 715M-212 -381C-212 -381 -144 24 320 151C784 278 852 683 852 683M-184 -413C-184 -413 -116 -8 348 119C812 246 880 651 880 651M-156 -445C-156 -445 -88 -40 376 87C840 214 908 619 908 619M-128 -477C-128 -477 -60 -72 404 55C868 182 936 587 936 587M-100 -509C-100 -509 -32 -104 432 23C896 150 964 555 964 555M-72 -541C-72 -541 -4 -136 460 -9C924 118 992 523 992 523M-44 -573C-44 -573 24 -168 488 -41C952 86 1020 491 1020 491M-16 -605C-16 -605 52 -200 516 -73C980 54 1048 459 1048 459M12 -637C12 -637 80 -232 544 -105C1008 22 1076 427 1076 427" stroke="url(#paint0_radial_beams)" stroke-opacity="0.05" stroke-width="0.5"></path><path d="M-324 -253C-324 -253 -256 152 208 279C672 406 740 811 740 811" stroke="url(#beamGradient-0)" stroke-opacity="0.4" stroke-width="0.5"></path><path d="M-240 -349C-240 -349 -172 56 292 183C756 310 824 715 824 715" stroke="url(#beamGradient-1)" stroke-opacity="0.4" stroke-width="0.5"></path><path d="M-184 -413C-184 -413 -116 -8 348 119C812 246 880 651 880 651" stroke="url(#beamGradient-2)" stroke-opacity="0.4" stroke-width="0.5"></path><path d="M-128 -477C-128 -477 -60 -72 404 55C868 182 936 587 936 587" stroke="url(#beamGradient-3)" stroke-opacity="0.4" stroke-width="0.5"></path><path d="M-72 -541C-72 -541 -4 -136 460 -9C924 118 992 523 992 523" stroke="url(#beamGradient-4)" stroke-opacity="0.4" stroke-width="0.5"></path><path d="M-16 -605C-16 -605 52 -200 516 -73C980 54 1048 459 1048 459" stroke="url(#beamGradient-5)" stroke-opacity="0.4" stroke-width="0.5"></path><defs><linearGradient id="beamGradient-0" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><linearGradient id="beamGradient-1" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><linearGradient id="beamGradient-2" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><linearGradient id="beamGradient-3" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><linearGradient id="beamGradient-4" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><linearGradient id="beamGradient-5" x1="0%" x2="0%" y1="0%" y2="0%"><stop stop-color="#18CCFC" stop-opacity="0"></stop><stop stop-color="#18CCFC"></stop><stop offset="32.5%" stop-color="#6344F5"></stop><stop offset="100%" stop-color="#AE48FF" stop-opacity="0"></stop></linearGradient><radialGradient id="paint0_radial_beams" cx="0" cy="0" r="1" gradientUnits="userSpaceOnUse" gradientTransform="translate(352 34) rotate(90) scale(555 1560.62)"><stop offset="0.0666667" stop-color="var(--beam-color, #d4d4d4)"></stop><stop offset="0.243243" stop-color="var(--beam-color, #d4d4d4)"></stop><stop offset="0.43594" stop-color="white" stop-opacity="0"></stop></radialGradient></defs></svg></div><div class="absolute inset-0 overflow-hidden pointer-events-none"><div class="absolute top-1/4 left-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-rose-600/20 rounded-full blur-3xl"></div><div class="absolute bottom-1/4 right-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-pink-500/20 rounded-full blur-3xl"></div></div><div class="absolute top-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent"></div><div class="relative z-10 max-w-7xl mx-auto px-4 sm:px-6 lg:px-8"><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="text-center mb-10"><h2 class="text-2xl sm:text-3xl font-bold tracking-tight mb-4"><span class="text-white/90">Put these ideas into practice</span></h2><p class="text-lg text-slate-300 max-w-xl mx-auto">Use these free tools and guides alongside your reading to apply statistical concepts and run better experiments.</p></div></div><div class="" style="opacity:0;filter:blur(6px);transform:translateY(6px)"><div class="grid sm:grid-cols-2 lg:grid-cols-3 gap-3"><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/statistical-significance-calculator"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">A/B Test Significance Calculator</p><p class="text-xs text-slate-400 mt-0.5">Analyze your experiment results</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/sample-size-calculator"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">Sample Size Calculator</p><p class="text-xs text-slate-400 mt-0.5">Plan experiments with proper power analysis</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/books"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">A/B Testing Books</p><p class="text-xs text-slate-400 mt-0.5">Essential reading on experimentation</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/glossary"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">A/B Testing Glossary</p><p class="text-xs text-slate-400 mt-0.5">100+ experimentation terms explained</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/courses"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">A/B Testing Courses</p><p class="text-xs text-slate-400 mt-0.5">Structured learning paths for experimentation</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a><a class="group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors" href="/ab-testing-tools"><div><p class="text-sm font-semibold text-white group-hover:text-rose-300 transition-colors">A/B Testing Tools</p><p class="text-xs text-slate-400 mt-0.5">Compare experimentation platforms</p></div><svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors" aria-hidden="true"><path d="M5 12h14"></path><path d="m12 5 7 7-7 7"></path></svg></a></div></div></div><div class="absolute bottom-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent"></div></section></article><!--$--><!--/$--></div>
45<script>$RB=[];$RV=function(a){$RT=performance.now();for(var b=0;b<a.length;b+=2){var c=a[b],e=a[b+1];null!==e.parentNode&&e.parentNode.removeChild(e);var f=c.parentNode;if(f){var g=c.previousSibling,h=0;do{if(c&&8===c.nodeType){var d=c.data;if("/$"===d||"/&"===d)if(0===h)break;else h--;else"$"!==d&&"$?"!==d&&"$~"!==d&&"$!"!==d&&"&"!==d||h++}d=c.nextSibling;f.removeChild(c);c=d}while(c);for(;e.firstChild;)f.insertBefore(e.firstChild,c);g.data="$";g._reactRetry&&requestAnimationFrame(g._reactRetry)}}a.length=0}; 46$RC=function(a,b){if(b=document.getElementById(b))(a=document.getElementById(a))?(a.previousSibling.data="$~",$RB.push(a,b),2===$RB.length&&("number"!==typeof $RT?requestAnimationFrame($RV.bind(null,$RB)):(a=performance.now(),setTimeout($RV.bind(null,$RB),2300>a&&2E3<a?2300-a:$RT+300-a)))):b.parentNode.removeChild(b)};$RC("B:0","S:0")</script>
46<script>(self.__next_f=self.__next_f||[]).push([0])</script>
46<script>self.__next_f.push([1,"1:\"$Sreact.fragment\"\n2:I[65150,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\"],\"ThemeProvider\"]\n3:I[46798,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\"],\"TooltipProvider\"]\n4:I[83165,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\"],\"ScrollToTop\"]\n5:I[3265,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\"],\"Navbar\"]\n6:I[39756,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"default\"]\n7:I[58298,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/b0e08fbc9c09ad34.js\"],\"default\"]\n8:I[37457,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"default\"]\n9:I[22016,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"\"]\n15:I[68027,[],\"default\"]\n:HL[\"/_next/static/chunks/c15cd36f61e26982.css\",\"style\"]\n:HL[\"/_next/static/chunks/17c5e71924241240.css\",\"style\"]\n:HL[\"/_next/static/media/03fc1b4a8d284b5e-s.p.af4fcd24.woff2\",\"font\",{\"crossOrigin\":\"\",\"type\":\"font/woff2\"}]\n:HL[\"/_next/static/media/70bc3e132a0a741e-s.p.15008bfb.woff2\",\"font\",{\"crossOrigin\":\"\",\"type\":\"font/woff2\"}]\n"])</script>
46<script>self.__next_f.push([1,"0:{\"P\":null,\"b\":\"z3OchgUaaRsS7fyZXdwiX\",\"c\":[\"\",\"articles\"],\"q\":\"\",\"i\":false,\"f\":[[[\"\",{\"children\":[\"articles\",{\"children\":[\"__PAGE__\",{}]}]},\"$undefined\",\"$undefined\",true],[[\"$\",\"$1\",\"c\",{\"children\":[[[\"$\",\"link\",\"0\",{\"rel\":\"stylesheet\",\"href\":\"/_next/static/chunks/c15cd36f61e26982.css\",\"precedence\":\"next\",\"crossOrigin\":\"$undefined\",\"nonce\":\"$undefined\"}],[\"$\",\"link\",\"1\",{\"rel\":\"stylesheet\",\"href\":\"/_next/static/chunks/17c5e71924241240.css\",\"precedence\":\"next\",\"crossOrigin\":\"$undefined\",\"nonce\":\"$undefined\"}],[\"$\",\"script\",\"script-0\",{\"src\":\"/_next/static/chunks/4f01e4ae416e0626.js\",\"async\":true,\"nonce\":\"$undefined\"}],[\"$\",\"script\",\"script-1\",{\"src\":\"/_next/static/chunks/85a6122b0d628955.js\",\"async\":true,\"nonce\":\"$undefined\"}],[\"$\",\"script\",\"script-2\",{\"src\":\"/_next/static/chunks/5f0524cd67aada7c.js\",\"async\":true,\"nonce\":\"$undefined\"}],[\"$\",\"script\",\"script-3\",{\"src\":\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"async\":true,\"nonce\":\"$undefined\"}]],[\"$\",\"html\",null,{\"lang\":\"en\",\"className\":\"scroll-smooth\",\"suppressHydrationWarning\":true,\"children\":[[\"$\",\"head\",null,{\"children\":[[\"$\",\"meta\",null,{\"name\":\"apple-mobile-web-app-capable\",\"content\":\"yes\"}],[\"$\",\"meta\",null,{\"name\":\"apple-mobile-web-app-status-bar-style\",\"content\":\"black-translucent\"}],[\"$\",\"meta\",null,{\"name\":\"msapplication-TileColor\",\"content\":\"#1A1837\"}],[\"$\",\"meta\",null,{\"name\":\"msapplication-navbutton-color\",\"content\":\"#1A1837\"}],[\"$\",\"link\",null,{\"rel\":\"preconnect\",\"href\":\"https://eu.i.posthog.com\"}],[\"$\",\"link\",null,{\"rel\":\"preconnect\",\"href\":\"https://cdn.brandfetch.io\"}],[\"$\",\"link\",null,{\"rel\":\"dns-prefetch\",\"href\":\"https://eu.i.posthog.com\"}],[\"$\",\"link\",null,{\"rel\":\"dns-prefetch\",\"href\":\"https://cdn.brandfetch.io\"}],[\"$\",\"script\",null,{\"type\":\"application/ld+json\",\"dangerouslySetInnerHTML\":{\"__html\":\"{\\\"@context\\\":\\\"https://schema.org\\\",\\\"@graph\\\":[{\\\"@type\\\":\\\"WebSite\\\",\\\"@id\\\":\\\"https://abtestresult.com/#website\\\",\\\"url\\\":\\\"https://abtestresult.com\\\",\\\"name\\\":\\\"ABTestResult.com\\\",\\\"description\\\":\\\"Free statistical calculators for A/B testing and experimentation\\\",\\\"potentialAction\\\":{\\\"@type\\\":\\\"SearchAction\\\",\\\"target\\\":\\\"https://abtestresult.com/glossary?q={search_term_string}\\\",\\\"query-input\\\":\\\"required name=search_term_string\\\"}},{\\\"@type\\\":\\\"Organization\\\",\\\"@id\\\":\\\"https://abtestresult.com/#organization\\\",\\\"name\\\":\\\"ABTestResult.com\\\",\\\"url\\\":\\\"https://abtestresult.com\\\",\\\"logo\\\":{\\\"@type\\\":\\\"ImageObject\\\",\\\"url\\\":\\\"https://abtestresult.com/icon.png\\\"}}]}\"}}]]}],[\"$\",\"body\",null,{\"className\":\"ibm_plex_sans_19dceeb6-module__3R2tZq__variable jetbrains_mono_9a2f2d6c-module__wsyXyG__variable font-sans antialiased min-h-screen flex flex-col\",\"children\":[\"$\",\"$L2\",null,{\"children\":[\"$\",\"$L3\",null,{\"children\":[[\"$\",\"$L4\",null,{}],[\"$\",\"$L5\",null,{}],[\"$\",\"main\",null,{\"className\":\"flex-1\",\"children\":[\"$\",\"$L6\",null,{\"parallelRouterKey\":\"children\",\"error\":\"$7\",\"errorStyles\":[],\"errorScripts\":[[\"$\",\"script\",\"script-0\",{\"src\":\"/_next/static/chunks/b0e08fbc9c09ad34.js\",\"async\":true}]],\"template\":[\"$\",\"$L8\",null,{}],\"templateStyles\":\"$undefined\",\"templateScripts\":\"$undefined\",\"notFound\":[[\"$\",\"div\",null,{\"className\":\"flex-1 flex items-center justify-center py-16 px-4\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-4xl w-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-center mb-12\",\"children\":[[\"$\",\"div\",null,{\"className\":\"inline-flex items-center justify-center w-20 h-20 rounded-2xl bg-violet-100 dark:bg-violet-900/30 mb-6\",\"children\":[\"$\",\"span\",null,{\"className\":\"text-4xl font-bold text-violet-600 dar
46k:text-violet-400 font-mono\",\"children\":\"404\"}]}],[\"$\",\"h1\",null,{\"className\":\"text-3xl sm:text-4xl font-bold text-slate-900 dark:text-slate-100 mb-3\",\"children\":\"Page not found\"}],[\"$\",\"p\",null,{\"className\":\"text-lg text-slate-600 dark:text-slate-400 max-w-md mx-auto\",\"children\":\"The page you're looking for doesn't exist or has been moved.\"}]]}],[\"$\",\"div\",null,{\"className\":\"space-y-8\",\"children\":[[\"$\",\"section\",null,{\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-sm font-semibold text-slate-500 dark:text-slate-400 uppercase tracking-wider mb-4 px-1\",\"children\":\"Essential Tools\"}],[\"$\",\"div\",null,{\"className\":\"grid gap-3 sm:grid-cols-2\",\"children\":[[\"$\",\"$L9\",\"/statistical-significance-calculator\",{\"href\":\"/statistical-significance-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-violet-300 dark:hover:border-violet-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[\"$La\",\"$Lb\"]}],\"$Lc\"]}]]}],\"$Ld\",\"$Le\"]}],\"$Lf\"]}]}],[]],\"forbidden\":\"$undefined\",\"unauthorized\":\"$undefined\"}]}],\"$L10\"]}]}]}]]}]]}],{\"children\":[\"$L11\",{\"children\":[\"$L12\",{},null,false,false]},null,false,false]},[\"$L13\",[],[]],false,false],\"$L14\",false]],\"m\":\"$undefined\",\"G\":[\"$15\",[]],\"S\":true}\n"])</script>
46<script>self.__next_f.push([1,"1d:I[58234,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\"],\"Footer\"]\n1e:I[20021,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"BreadcrumbJsonLd\"]\n21:I[3881,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"Particles\"]\n22:I[17195,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"BlurFade\"]\n23:I[20021,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"Breadcrumbs\"]\n39:I[97367,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"ViewportBoundary\"]\n3b:I[97367,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"MetadataBoundary\"]\n3c:\"$Sreact.suspense\"\na:[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-violet-100 dark:bg-violet-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-chart-column w-5 h-5 text-violet-600 dark:text-violet-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"c24i48\",{\"d\":\"M3 3v16a2 2 0 0 0 2 2h16\"}],[\"$\",\"path\",\"2bz60n\",{\"d\":\"M18 17V9\"}],[\"$\",\"path\",\"1frdt8\",{\"d\":\"M13 17V5\"}],[\"$\",\"path\",\"17ska0\",{\"d\":\"M8 17v-3\"}],\"$undefined\"]}]}]\nb:[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Significance Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Analyze results with statistical tests\"}]]}]\n"])</script>
46<script>self.__next_f.push([1,"c:[\"$\",\"$L9\",\"/sample-size-calculator\",{\"href\":\"/sample-size-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-emerald-300 dark:hover:border-emerald-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-emerald-100 dark:bg-emerald-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-users w-5 h-5 text-emerald-600 dark:text-emerald-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1yyitq\",{\"d\":\"M16 21v-2a4 4 0 0 0-4-4H6a4 4 0 0 0-4 4v2\"}],[\"$\",\"path\",\"16gr8j\",{\"d\":\"M16 3.128a4 4 0 0 1 0 7.744\"}],[\"$\",\"path\",\"kshegd\",{\"d\":\"M22 21v-2a4 4 0 0 0-3-3.87\"}],[\"$\",\"circle\",\"nufk8\",{\"cx\":\"9\",\"cy\":\"7\",\"r\":\"4\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Sample Size Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Determine required sample size\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"d:[\"$\",\"section\",null,{\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-sm font-semibold text-slate-500 dark:text-slate-400 uppercase tracking-wider mb-4 px-1\",\"children\":\"Statistical Calculators\"}],[\"$\",\"div\",null,{\"className\":\"grid gap-3 sm:grid-cols-2 lg:grid-cols-3\",\"children\":[[\"$\",\"$L9\",\"/standard-deviation-calculator\",{\"href\":\"/standard-deviation-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-purple-300 dark:hover:border-purple-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-purple-100 dark:bg-purple-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-sigma w-5 h-5 text-purple-600 dark:text-purple-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"wuwx1p\",{\"d\":\"M18 7V5a1 1 0 0 0-1-1H6.5a.5.5 0 0 0-.4.8l4.5 6a2 2 0 0 1 0 2.4l-4.5 6a.5.5 0 0 0 .4.8H17a1 1 0 0 0 1-1v-2\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Standard Deviation\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Calculate variance \u0026 CV\"}]]}]]}],[\"$\",\"$L9\",\"/sample-ratio-mismatch\",{\"href\":\"/sample-ratio-mismatch\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-blue-300 dark:hover:border-blue-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-blue-100 dark:bg-blue-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-scale w-5 h-5 text-blue-600 dark:text-blue-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"108xh3\",{\"d\":\"M12 3v18\"}],[\"$\",\"path\",\"zcdpyk\",{\"d\":\"m19 8 3 8a5 5 0 0 1-6 0zV7\"}],[\"$\",\"path\",\"1yorad\",{\"d\":\"M3 7h1a17 17 0 0 0 8-2 17 17 0 0 0 8 2h1\"}],[\"$\",\"path\",\"eua70x\",{\"d\":\"m5 8 3 8a5 5 0 0 1-6 0zV7\"}],[\"$\",\"path\",\"1b0cd5\",{\"d\":\"M7 21h10\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"SRM Checker\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Detect traffic split issues\"}]]}]]}],[\"$\",\"$L9\",\"/mde-calculator\",{\"href\":\"/mde-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-amber-300 dark:hover:border-amber-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-amber-100 dark:bg-amber-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\"
46:24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-target w-5 h-5 text-amber-600 dark:text-amber-400\",\"aria-hidden\":\"true\",\"children\":[\"$L16\",\"$L17\",\"$L18\",\"$undefined\"]}]}],\"$L19\"]}],\"$L1a\",\"$L1b\",\"$L1c\"]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"e:[\"$\",\"section\",null,{\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-sm font-semibold text-slate-500 dark:text-slate-400 uppercase tracking-wider mb-4 px-1\",\"children\":\"Resources\"}],[\"$\",\"div\",null,{\"className\":\"grid gap-3 sm:grid-cols-2\",\"children\":[[\"$\",\"$L9\",\"/statistical-calculators\",{\"href\":\"/statistical-calculators\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-orange-300 dark:hover:border-orange-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-orange-100 dark:bg-orange-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-wrench w-5 h-5 text-orange-600 dark:text-orange-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ngwbx\",{\"d\":\"M14.7 6.3a1 1 0 0 0 0 1.4l1.6 1.6a1 1 0 0 0 1.4 0l3.106-3.105c.32-.322.863-.22.983.218a6 6 0 0 1-8.259 7.057l-7.91 7.91a1 1 0 0 1-2.999-3l7.91-7.91a6 6 0 0 1 7.057-8.259c.438.12.54.662.219.984z\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"All Calculators\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Browse all statistical tools\"}]]}]]}],[\"$\",\"$L9\",\"/glossary\",{\"href\":\"/glossary\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-teal-300 dark:hover:border-teal-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-teal-100 dark:bg-teal-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-5 h-5 text-teal-600 dark:text-teal-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Glossary\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"A/B testing terminology\"}]]}]]}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"f:[\"$\",\"div\",null,{\"className\":\"mt-12 text-center\",\"children\":[\"$\",\"$L9\",null,{\"href\":\"/\",\"className\":\"inline-flex items-center gap-2 text-sm font-medium text-violet-600 dark:text-violet-400 hover:text-violet-700 dark:hover:text-violet-300 transition-colors\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-house w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"5wwlr5\",{\"d\":\"M15 21v-8a1 1 0 0 0-1-1h-4a1 1 0 0 0-1 1v8\"}],[\"$\",\"path\",\"r6nss1\",{\"d\":\"M3 10a2 2 0 0 1 .709-1.528l7-6a2 2 0 0 1 2.582 0l7 6A2 2 0 0 1 21 10v9a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2z\"}],\"$undefined\"]}],\"Back to Homepage\"]}]}]\n10:[\"$\",\"$L1d\",null,{}]\n1f:T1128,"])</script>
46<script>self.__next_f.push([1,"{\"@context\":\"https://schema.org\",\"@type\":\"CollectionPage\",\"name\":\"A/B Testing Articles \u0026 Expert Guides\",\"description\":\"Curated articles on A/B testing covering statistical testing, sample sizing, and experimentation frameworks from industry experts.\",\"mainEntity\":{\"@type\":\"ItemList\",\"numberOfItems\":23,\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"url\":\"https://www.awa-digital.com/blog/balancing-experimentation-portfolios/\",\"name\":\"Explore vs Exploit: Finding the Balance in CRO\"},{\"@type\":\"ListItem\",\"position\":2,\"url\":\"https://amplitude.com/blog/experiment-brief\",\"name\":\"Use Experiment Briefs to Design Better Experiments\"},{\"@type\":\"ListItem\",\"position\":3,\"url\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/\",\"name\":\"Facts and Fictions About Multiple Comparisons\"},{\"@type\":\"ListItem\",\"position\":4,\"url\":\"https://abtestresult.com/articles/continuous-metrics\",\"name\":\"Continuous Metrics in A/B Testing: Revenue, AOV, and Session Duration\"},{\"@type\":\"ListItem\",\"position\":5,\"url\":\"https://abtestresult.com/articles/guardrail-metrics\",\"name\":\"Guardrail Metrics in A/B Testing: How to Protect Experiments from Hidden Harm\"},{\"@type\":\"ListItem\",\"position\":6,\"url\":\"https://abtestresult.com/articles/winners-curse\",\"name\":\"The Winner's Curse in A/B Testing: Why Wins Overestimate Impact\"},{\"@type\":\"ListItem\",\"position\":7,\"url\":\"https://abtestresult.com/articles/experiment-velocity\",\"name\":\"Experimentation Velocity for Small Teams: Ship More A/B Tests Without Breaking Everything\"},{\"@type\":\"ListItem\",\"position\":8,\"url\":\"https://abtestresult.com/articles/ab-testing-interview-questions\",\"name\":\"Top 20 A/B Testing Interview Questions (with Answers)\"},{\"@type\":\"ListItem\",\"position\":9,\"url\":\"https://abtestresult.com/articles/ab-testing-mistakes\",\"name\":\"The 10 Most Common A/B Testing Mistakes (And How to Avoid Them)\"},{\"@type\":\"ListItem\",\"position\":10,\"url\":\"https://abtestresult.com/articles/journey-testing\",\"name\":\"From Page Tests to Journey Tests: Designing Experiments That Match How Users Actually Convert\"},{\"@type\":\"ListItem\",\"position\":11,\"url\":\"https://abtestresult.com/articles/ab-test-design-template\",\"name\":\"A/B Test Design Template: How to Prevent Bad Decisions\"},{\"@type\":\"ListItem\",\"position\":12,\"url\":\"https://abtestresult.com/articles/experimentation-team-models\",\"name\":\"Experimentation Team Models: How to Structure Your A/B Testing Team\"},{\"@type\":\"ListItem\",\"position\":13,\"url\":\"https://abtestresult.com/articles/practical-significance\",\"name\":\"Understanding Practical Significance in A/B Testing\"},{\"@type\":\"ListItem\",\"position\":14,\"url\":\"https://abtestresult.com/articles/region-beta-paradox\",\"name\":\"The Region-Beta Paradox: Why Small Losses Outlast Big Ones\"},{\"@type\":\"ListItem\",\"position\":15,\"url\":\"https://abtestresult.com/articles/non-inferiority\",\"name\":\"Maximising Insights with Non-Inferiority Tests\"},{\"@type\":\"ListItem\",\"position\":16,\"url\":\"https://positivejohn.substack.com/p/experimentation-itech-media-from\",\"name\":\"Experimentation: From startup to multiple agile teams\"},{\"@type\":\"ListItem\",\"position\":17,\"url\":\"https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/\",\"name\":\"One-tailed vs Two-tailed Tests of Significance in A/B Testing\"},{\"@type\":\"ListItem\",\"position\":18,\"url\":\"https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit\",\"name\":\"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing\"},{\"@type\":\"ListItem\",\"position\":19,\"url\":\"https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/\",\"name\":\"Underpowered A/B Tests: Confusions, Myths, and Reality\"},{\"@type\":\"ListItem\",\"position\":20,\"url\":\"https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/\",\"name\":\"Statistical Significance for Non-Binomial Metrics\"},{\"@type\":\"ListItem\",\"position\":21,\"url\":\"https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html\",\"name\":\"Interaction effects in online experimentation\"},{\"@type\":\"ListItem\",\"position\":22,\"url\":\"https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/\",\"name\":\"Is non-inferiority on par with superiority?\"},{\"@type\":\"ListItem\",\"position\":23,\"url\":\"https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html\",\"name\":\"Power and Sample Size Determination\"}]}}"])</script>
46<script>self.__next_f.push([1,"11:[\"$\",\"$1\",\"c\",{\"children\":[[[\"$\",\"script\",\"script-0\",{\"src\":\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"async\":true,\"nonce\":\"$undefined\"}]],[[\"$\",\"$L1e\",null,{\"items\":[{\"name\":\"Articles\",\"href\":\"/articles\"}]}],[\"$\",\"script\",null,{\"type\":\"application/ld+json\",\"dangerouslySetInnerHTML\":{\"__html\":\"$1f\"}}],\"$L20\"]]}]\n"])</script>
46<script>self.__next_f.push([1,"12:[\"$\",\"$1\",\"c\",{\"children\":[[\"$\",\"article\",null,{\"className\":\"flex flex-col\",\"children\":[[\"$\",\"section\",null,{\"className\":\"relative overflow-clip py-16 sm:py-20 lg:py-12 lg:py-24\",\"style\":{\"background\":\"linear-gradient(135deg, #1A1837 0%, #24214D 50%, #3B367E 100%)\"},\"children\":[[\"$\",\"$L21\",null,{\"className\":\"absolute inset-0 z-0\",\"quantity\":50,\"color\":\"#fb7185\",\"size\":0.4,\"staticity\":40,\"ease\":80}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 overflow-hidden pointer-events-none\",\"children\":[[\"$\",\"div\",null,{\"className\":\"absolute top-0 left-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-rose-500/15 rounded-full blur-3xl\"}],[\"$\",\"div\",null,{\"className\":\"absolute bottom-0 right-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-pink-500/15 rounded-full blur-3xl\"}]]}],[\"$\",\"div\",null,{\"className\":\"relative z-10 max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[\"$\",\"div\",null,{\"className\":\"text-center\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.2,\"children\":[\"$\",\"div\",null,{\"className\":\"inline-flex items-center gap-2 px-4 py-2 rounded-full bg-white/10 backdrop-blur-sm border border-white/10 mb-6\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-4 h-4 text-rose-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],[\"$\",\"span\",null,{\"className\":\"text-sm text-white/80\",\"children\":\"Curated Articles\"}]]}]}],[\"$\",\"$L22\",null,{\"delay\":0.3,\"children\":[\"$\",\"h1\",null,{\"className\":\"text-4xl sm:text-5xl lg:text-6xl font-bold tracking-tight mb-6\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-white/90\",\"children\":\"Expert \"}],[\"$\",\"span\",null,{\"className\":\"bg-gradient-to-r from-rose-400 via-pink-400 to-rose-300 bg-clip-text text-transparent pb-2\",\"children\":\"Articles\"}]]}]}],[\"$\",\"$L22\",null,{\"delay\":0.4,\"children\":[\"$\",\"p\",null,{\"className\":\"text-lg sm:text-xl max-w-2xl mx-auto text-slate-300 leading-relaxed\",\"children\":\"Our own guides and curated articles from industry experts on A/B testing methodology, statistical testing, sample sizing, and experimentation frameworks.\"}]}]]}]}],[\"$\",\"div\",null,{\"className\":\"absolute bottom-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent\"}]]}],[\"$\",\"$L23\",null,{\"items\":[{\"name\":\"Articles\",\"href\":\"/articles\"}]}],[\"$\",\"section\",null,{\"className\":\"pt-12 pb-0 bg-slate-50 dark:bg-slate-950\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"p\",null,{\"className\":\"text-body-lg text-slate-600 dark:text-slate-400\",\"children\":\"A curated collection of articles on A/B testing, statistical analysis, and experimentation strategy. These resources cover everything from sample size calculations and test design to advanced topics like multiple comparisons and interaction effects. Each article includes a summary and key takeaways to help you apply these concepts to your own experiments.\"}]}]}]}],[\"$\",\"section\",null,{\"className\":\"py-12 lg:py-24 bg-slate-50 dark:bg-slate-950\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"div\",null,{\"className\":\"mb-10\",\"children\":[[\"$\",\"div\",null,{\"className\":\"mb-2\",\"children\":[\"$\",\"h2\",null,{\"className\":\"text-h2 text-slate-900 dark:text-slate-100\",\"children\":\"Our Articles\"}]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-600 dar
46k:text-slate-400\",\"children\":\"In-depth articles written by our team on experimentation methodology and decision making.\"}]]}]}],[\"$\",\"div\",null,{\"className\":\"grid grid-cols-1 sm:grid-cols-2 lg:grid-cols-3 gap-6\",\"children\":[[\"$\",\"$L22\",\"The Winner's Curse in A/B Testing: Why Wins Overestimate Impact\",{\"delay\":0.15,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/winners-curse\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #b91c1c, #f43f5e)\"},\"children\":[\"$L24\",\"$L25\",\"$L26\"]}]}]}],\"$L27\",\"$L28\",\"$L29\",\"$L2a\",\"$L2b\",\"$L2c\",\"$L2d\",\"$L2e\",\"$L2f\",\"$L30\",\"$L31\"]}]]}]}],\"$L32\",\"$L33\",\"$L34\",\"$L35\"]}],[\"$L36\",\"$L37\"],\"$L38\"]}]\n"])</script>
46<script>self.__next_f.push([1,"13:[\"$\",\"div\",\"l\",{\"className\":\"flex flex-col items-center justify-center min-h-[60vh] gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative\",\"children\":[\"$\",\"div\",null,{\"className\":\"w-12 h-12 rounded-full border-4 border-slate-200 dark:border-slate-700 border-t-violet-500 animate-spin\"}]}],[\"$\",\"p\",null,{\"className\":\"text-sm text-slate-500 dark:text-slate-400 animate-pulse\",\"children\":\"Loading...\"}]]}]\n14:[\"$\",\"$1\",\"h\",{\"children\":[null,[\"$\",\"$L39\",null,{\"children\":\"$L3a\"}],[\"$\",\"div\",null,{\"hidden\":true,\"children\":[\"$\",\"$L3b\",null,{\"children\":[\"$\",\"$3c\",null,{\"name\":\"Next.Metadata\",\"children\":\"$L3d\"}]}]}],[\"$\",\"meta\",null,{\"name\":\"next-size-adjust\",\"content\":\"\"}]]}]\n"])</script>
46<script>self.__next_f.push([1,"3e:I[33963,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"DotPattern\"]\n3f:I[85437,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"Image\"]\n40:I[15844,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"MagicCard\"]\n61:I[24281,[\"/_next/static/chunks/4f01e4ae416e0626.js\",\"/_next/static/chunks/85a6122b0d628955.js\",\"/_next/static/chunks/5f0524cd67aada7c.js\",\"/_next/static/chunks/3cb18c5b18e98c2d.js\",\"/_next/static/chunks/85b6dce4c24fc9bd.js\",\"/_next/static/chunks/24fd35f1c412cc11.js\",\"/_next/static/chunks/60cd64dfb12f5951.js\"],\"BackgroundBeams\"]\n68:I[97367,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"OutletBoundary\"]\n16:[\"$\",\"circle\",\"1mglay\",{\"cx\":\"12\",\"cy\":\"12\",\"r\":\"10\"}]\n17:[\"$\",\"circle\",\"1vlfrh\",{\"cx\":\"12\",\"cy\":\"12\",\"r\":\"6\"}]\n18:[\"$\",\"circle\",\"1c9p78\",{\"cx\":\"12\",\"cy\":\"12\",\"r\":\"2\"}]\n19:[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"MDE Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Estimate detectable effects\"}]]}]\n1a:[\"$\",\"$L9\",\"/duration-calculator\",{\"href\":\"/duration-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-cyan-300 dark:hover:border-cyan-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-cyan-100 dark:bg-cyan-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-clock w-5 h-5 text-cyan-600 dark:text-cyan-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"mmk7yg\",{\"d\":\"M12 6v6l4 2\"}],[\"$\",\"circle\",\"1mglay\",{\"cx\":\"12\",\"cy\":\"12\",\"r\":\"10\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Duration Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Plan experiment timeline\"}]]}]]}]\n1b:[\"$\",\"$L9\",\"/roi-calculator\",{\"href\":\"/roi-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-rose-300 dark:hover:border-rose-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-rose-100 dark:bg-rose-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\"
46:24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-trending-up w-5 h-5 te"])</script>
46<script>self.__next_f.push([1,"xt-rose-600 dark:text-rose-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"box55l\",{\"d\":\"M16 7h6v6\"}],[\"$\",\"path\",\"1t1m79\",{\"d\":\"m22 7-8.5 8.5-5-5L2 17\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"ROI Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Calculate experiment ROI\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"1c:[\"$\",\"$L9\",\"/bayesian-calculator\",{\"href\":\"/bayesian-calculator\",\"className\":\"group flex items-start gap-3 rounded-xl border border-slate-200 dark:border-slate-800 bg-white dark:bg-slate-900 px-4 py-3.5 transition-all hover:border-indigo-300 dark:hover:border-indigo-700 hover:shadow-md dark:hover:shadow-slate-800/50\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 w-10 h-10 rounded-lg bg-indigo-100 dark:bg-indigo-900/50 flex items-center justify-center transition-transform group-hover:scale-110\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-brain-circuit w-5 h-5 text-indigo-600 dark:text-indigo-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"l5xja\",{\"d\":\"M12 5a3 3 0 1 0-5.997.125 4 4 0 0 0-2.526 5.77 4 4 0 0 0 .556 6.588A4 4 0 1 0 12 18Z\"}],[\"$\",\"path\",\"10igwf\",{\"d\":\"M9 13a4.5 4.5 0 0 0 3-4\"}],[\"$\",\"path\",\"105sqy\",{\"d\":\"M6.003 5.125A3 3 0 0 0 6.401 6.5\"}],[\"$\",\"path\",\"ql3yin\",{\"d\":\"M3.477 10.896a4 4 0 0 1 .585-.396\"}],[\"$\",\"path\",\"2e4loj\",{\"d\":\"M6 18a4 4 0 0 1-1.967-.516\"}],[\"$\",\"path\",\"1ku699\",{\"d\":\"M12 13h4\"}],[\"$\",\"path\",\"105ag5\",{\"d\":\"M12 18h6a2 2 0 0 1 2 2v1\"}],[\"$\",\"path\",\"1lhi5i\",{\"d\":\"M12 8h8\"}],[\"$\",\"path\",\"u6izg6\",{\"d\":\"M16 8V5a2 2 0 0 1 2-2\"}],[\"$\",\"circle\",\"ry7gng\",{\"cx\":\"16\",\"cy\":\"13\",\"r\":\".5\"}],[\"$\",\"circle\",\"1aiba7\",{\"cx\":\"18\",\"cy\":\"3\",\"r\":\".5\"}],[\"$\",\"circle\",\"yhc1fs\",{\"cx\":\"20\",\"cy\":\"21\",\"r\":\".5\"}],[\"$\",\"circle\",\"1e43v0\",{\"cx\":\"20\",\"cy\":\"8\",\"r\":\".5\"}],\"$undefined\"]}]}],[\"$\",\"div\",null,{\"className\":\"min-w-0 flex-1\",\"children\":[[\"$\",\"div\",null,{\"className\":\"text-sm font-semibold text-slate-900 dark:text-slate-100 group-hover:text-violet-600 dark:group-hover:text-violet-400 transition-colors\",\"children\":\"Bayesian Calculator\"}],[\"$\",\"div\",null,{\"className\":\"text-xs text-slate-500 dark:text-slate-400 mt-0.5\",\"children\":\"Bayesian A/B test analysis\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"20:[\"$\",\"$L6\",null,{\"parallelRouterKey\":\"children\",\"error\":\"$undefined\",\"errorStyles\":\"$undefined\",\"errorScripts\":\"$undefined\",\"template\":[\"$\",\"$L8\",null,{}],\"templateStyles\":\"$undefined\",\"templateScripts\":\"$undefined\",\"notFound\":\"$undefined\",\"forbidden\":\"$undefined\",\"unauthorized\":\"$undefined\"}]\n24:[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}]\n25:[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}]\n"])</script>
46<script>self.__next_f.push([1,"26:[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Sample Size \u0026 Power\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"5 February 2026\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"The Winner's Curse in A/B Testing: Why Wins Overestimate Impact\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Significant A/B test wins overstate lift. Learn why selection bias inflates results, how power affects exaggeration, and how to report impact honestly.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"27:[\"$\",\"$L22\",\"Guardrail Metrics in A/B Testing: How to Protect Experiments from Hidden Harm\",{\"delay\":0.2,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/guardrail-metrics\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #22c55e, #0ea5e9)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Guardrail Metrics\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"2 February 2026\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Guardrail Metrics in A/B Testing: How to Protect Experiments from Hidden Harm\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Guardrail metrics protect your experiments from unintended damage. Learn how to choose, test, and implement guardrails with non-inferiority testing, including Spotify's decision framework.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"28:[\"$\",\"$L22\",\"Experimentation Team Models: How to Structure Your A/B Testing Team\",{\"delay\":0.25,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/experimentation-team-models\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #38bdf8, #818cf8)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Framework\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"31 January 2026\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Experimentation Team Models: How to Structure Your A/B Testing Team\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Compare centralized, decentralized, and Center of Excellence experimentation team models. Find the right structure for your organisation.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"29:[\"$\",\"$L22\",\"Top 20 A/B Testing Interview Questions (with Answers)\",{\"delay\":0.30000000000000004,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/ab-testing-interview-questions\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #8b5cf6, #d946ef)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Interview Prep\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"02 January 2026\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Top 20 A/B Testing Interview Questions (with Answers)\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Master the essential A/B testing interview questions covering p-values, statistical power, sample sizes, and one/two-tailed tests. Practice with real calculations.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2a:[\"$\",\"$L22\",\"The 10 Most Common A/B Testing Mistakes (And How to Avoid Them)\",{\"delay\":0.35,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/ab-testing-mistakes\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #dc2626, #fb923c)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Best Practices\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"15 November 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"The 10 Most Common A/B Testing Mistakes (And How to Avoid Them)\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Learn the most common A/B testing mistakes beginners make, from peeking too early to choosing wrong metrics. Includes statistical impact charts and a pre-test checklist.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2b:[\"$\",\"$L22\",\"From Page Tests to Journey Tests: Designing Experiments That Match How Users Actually Convert\",{\"delay\":0.4,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/journey-testing\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #06b6d4, #f59e0b)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Framework\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"18 October 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"From Page Tests to Journey Tests: Designing Experiments That Match How Users Actually Convert\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Move beyond page-level CRO. Learn how to define journeys, pick the right unit and metrics, plan sample size, and avoid attribution traps.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2c:[\"$\",\"$L22\",\"Continuous Metrics in A/B Testing: Revenue, AOV, and Session Duration\",{\"delay\":0.45000000000000007,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/continuous-metrics\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #0ea5e9, #475569)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Non-Binomial\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"15 September 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Continuous Metrics in A/B Testing: Revenue, AOV, and Session Duration\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"How to test revenue per user, AOV, and session duration with t-tests, proper sample sizes, and variance estimation for non-binomial metrics.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2d:[\"$\",\"$L22\",\"Experimentation Velocity for Small Teams: Ship More A/B Tests Without Breaking Everything\",{\"delay\":0.5,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/experiment-velocity\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #14b8a6, #a3e635)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Framework\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"15 June 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Experimentation Velocity for Small Teams: Ship More A/B Tests Without Breaking Everything\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"A practical playbook to increase experiment velocity on a small team with templates, guardrails, and a realistic monthly cadence.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2e:[\"$\",\"$L22\",\"A/B Test Design Template: How to Prevent Bad Decisions\",{\"delay\":0.55,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/ab-test-design-template\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #059669, #3b82f6)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Framework\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"15 April 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"A/B Test Design Template: How to Prevent Bad Decisions\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Turn experimentation tribal knowledge into a structured checklist that enforces trustworthy tests. Includes copy-ready template with hypothesis, metrics, pre-flight checks, and stop rules.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"2f:[\"$\",\"$L22\",\"Understanding Practical Significance in A/B Testing\",{\"delay\":0.6,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/practical-significance\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #3b82f6, #6366f1)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Practical Significance\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"29 January 2025\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Understanding Practical Significance in A/B Testing\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Statistical significance tells you if a result is real. Practical significance tells you if it matters.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"30:[\"$\",\"$L22\",\"The Region-Beta Paradox: Why Small Losses Outlast Big Ones\",{\"delay\":0.65,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/region-beta-paradox\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #f97316, #ef4444)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Decision Making\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"15 May 2024\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"The Region-Beta Paradox: Why Small Losses Outlast Big Ones\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Small negative A/B test results damage your program more than big failures. The psychology behind why, and what to do about it.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"31:[\"$\",\"$L22\",\"Maximising Insights with Non-Inferiority Tests\",{\"delay\":0.7000000000000001,\"children\":[\"$\",\"$L9\",null,{\"href\":\"/articles/non-inferiority\",\"className\":\"group block h-full\",\"children\":[\"$\",\"div\",null,{\"className\":\"h-full rounded-2xl overflow-hidden relative min-h-[280px] sm:min-h-[320px]\",\"style\":{\"background\":\"linear-gradient(135deg, #8b5cf6, #a855f7)\"},\"children\":[[\"$\",\"$L3e\",null,{\"className\":\"absolute inset-0 fill-white/15\",\"cr\":1,\"width\":20,\"height\":20}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 bg-gradient-to-b from-black/30 via-transparent to-black/50\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 p-6 sm:p-8 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mb-4\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2.5 py-1 rounded-md text-xs font-medium bg-white/20 backdrop-blur-sm text-white border border-white/20\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-bookmark w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"oz39mx\",{\"d\":\"M17 3a2 2 0 0 1 2 2v15a1 1 0 0 1-1.496.868l-4.512-2.578a2 2 0 0 0-1.984 0l-4.512 2.578A1 1 0 0 1 5 20V5a2 2 0 0 1 2-2z\"}],\"$undefined\"]}],\"Non Inferiority\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 text-xs text-white/70 bg-white/10 backdrop-blur-sm px-2 py-1 rounded-md border border-white/10\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-calendar-days w-3 h-3\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1cmpym\",{\"d\":\"M8 2v4\"}],[\"$\",\"path\",\"4m81vk\",{\"d\":\"M16 2v4\"}],[\"$\",\"rect\",\"1hopcy\",{\"width\":\"18\",\"height\":\"18\",\"x\":\"3\",\"y\":\"4\",\"rx\":\"2\"}],[\"$\",\"path\",\"8toen8\",{\"d\":\"M3 10h18\"}],[\"$\",\"path\",\"6423bh\",{\"d\":\"M8 14h.01\"}],[\"$\",\"path\",\"1etili\",{\"d\":\"M12 14h.01\"}],[\"$\",\"path\",\"1gbofw\",{\"d\":\"M16 14h.01\"}],[\"$\",\"path\",\"lrp35t\",{\"d\":\"M8 18h.01\"}],[\"$\",\"path\",\"mhygvu\",{\"d\":\"M12 18h.01\"}],[\"$\",\"path\",\"kzsmim\",{\"d\":\"M16 18h.01\"}],\"$undefined\"]}],\"28 February 2024\"]}]]}],[\"$\",\"div\",null,{\"className\":\"mt-auto\",\"children\":[[\"$\",\"h3\",null,{\"className\":\"text-xl sm:text-2xl font-bold text-white mb-2 [text-wrap:balance]\",\"children\":\"Maximising Insights with Non-Inferiority Tests\"}],[\"$\",\"p\",null,{\"className\":\"text-sm text-white/80 mb-4 line-clamp-3\",\"children\":\"Non-inferiority tests are often overlooked in A/B testing. Learn how to use them to your advantage.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between\",\"children\":[[\"$\",\"span\",null,{\"className\":\"flex items-center gap-2 text-sm text-white/70\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"/andrea.jpeg\",\"alt\":\"Andrea Corvi\",\"width\":20,\"height\":20,\"className\":\"w-5 h-5 rounded-full object-cover\"}],\"Andrea Corvi\"]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1.5 text-sm font-medium text-white group-hover:gap-2.5 transition-all\",\"children\":[\"Read article\",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]]}]]}]]}]]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"32:[\"$\",\"section\",null,{\"className\":\"py-12 lg:py-24 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"div\",null,{\"className\":\"mb-10\",\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-h2 text-slate-900 dark:text-slate-100 mb-2\",\"children\":\"From the Community\"}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-600 dark:text-slate-400\",\"children\":\"Deep dives into specific topics and methodologies from industry experts\"}]]}]}],[\"$\",\"div\",null,{\"className\":\"grid grid-cols-1 md:grid-cols-2 lg:grid-cols-3 gap-5\",\"children\":[[\"$\",\"$L22\",\"Explore vs Exploit: Finding the Balance in CRO\",{\"delay\":0.15,\"children\":[\"$\",\"a\",null,{\"href\":\"https://www.awa-digital.com/blog/balancing-experimentation-portfolios/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=awa-digital.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"awa-digital.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Explore vs Exploit: Finding the Balance in CRO\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Applies the explore/exploit tradeoff from probability theory to CRO portfolios. Proposes frameworks like the 70-20-10 rule for balancing incremental optimization with bold hypothesis testing, with ratios shifting based on organizational maturity.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"David Sanchez\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}],[\"$\",\"$L22\",\"Use Experiment Briefs to Design Better Experiments\",{\"delay\":0.2,\"children\":[\"$\",\"a\",null,{\"href\":\"https://amplitude.com/blog/experiment-brief\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=amplitude.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],\"$L41\"]}],\"$L42\"]}],\"$L43\",\"$L44\",\"$L45\"]}]}]}]}],\"$L46\",\"$L47\",\"$L48\",\"$L49\",\"$L4a\",\"$L4b\",\"$L4c\",\"$L4d\",\"$L4e\"]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"33:[\"$\",\"section\",null,{\"className\":\"py-12 lg:py-24 bg-slate-50 dark:bg-slate-950\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"div\",null,{\"className\":\"mb-12\",\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-h2 text-slate-900 dark:text-slate-100 mb-4\",\"children\":\"What You Will Learn From These Articles\"}],[\"$\",\"p\",null,{\"className\":\"text-body-lg text-slate-600 dark:text-slate-400 leading-relaxed max-w-3xl\",\"children\":\"This collection covers the core topics that experimentation practitioners encounter regularly. Each article addresses a specific problem with concrete guidance rather than general advice. Below you will find an overview by topic, followed by individual summaries and key takeaways for every article.\"}]]}]}],[\"$\",\"div\",null,{\"className\":\"grid grid-cols-1 md:grid-cols-2 gap-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.15,\"children\":[\"$\",\"div\",null,{\"className\":\"space-y-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2.5\",\"children\":[[\"$\",\"div\",null,{\"className\":\"w-9 h-9 rounded-lg bg-violet-100 dark:bg-violet-900/30 flex items-center justify-center shrink-0\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-beaker w-4.5 h-4.5 text-violet-600 dark:text-violet-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"c7n0jr\",{\"d\":\"M4.5 3h15\"}],[\"$\",\"path\",\"m1uhx7\",{\"d\":\"M6 3v16a2 2 0 0 0 2 2h8a2 2 0 0 0 2-2V3\"}],[\"$\",\"path\",\"4cwo0f\",{\"d\":\"M6 14h12\"}],\"$undefined\"]}]}],[\"$\",\"h3\",null,{\"className\":\"text-lg font-bold text-slate-900 dark:text-slate-100\",\"children\":\"Experiment Design \u0026 Frameworks\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed\",\"children\":[\"How to decide what to test, how to document experiments so the reasoning survives team changes, and how to balance safe incremental tests with higher-risk exploratory ones. The articles on \",[\"$\",\"a\",null,{\"href\":\"#use-experiment-briefs-to-design-better-experiments\",\"className\":\"text-rose-600 dar
46k:text-rose-400 hover:underline\",\"children\":\"experiment briefs\"}],\" and \",[\"$\",\"a\",null,{\"href\":\"#explore-vs-exploit-finding-the-balance-in-cro\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"explore vs exploit\"}],\" provide structured frameworks for portfolio-level test planning, while the \",[\"$\",\"a\",null,{\"href\":\"#experimentation-from-startup-to-multiple-agile-teams\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"scaling case study\"}],\" shows how these practices evolve as organizations grow.\"]}]]}]}],[\"$\",\"$L22\",null,{\"delay\":0.2,\"children\":[\"$\",\"div\",null,{\"className\":\"space-y-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2.5\",\"children\":[[\"$\",\"div\",null,{\"className\":\"w-9 h-9 rounded-lg bg-teal-100 dark:bg-teal-900/30 flex items-center justify-center shrink-0\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-flask-conical w-4.5 h-4.5 text-teal-600 dark:text-teal-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"18mbvz\",{\"d\":\"M14 2v6a2 2 0 0 0 .245.96l5.51 10.08A2 2 0 0 1 18 22H6a2 2 0 0 1-1.755-2.96l5.51-10.08A2 2 0 0 0 10 8V2\"}],[\"$\",\"path\",\"3shlmq\",{\"d\":\"M6.453 15h11.094\"}],[\"$\",\"path\",\"csnxdl\",{\"d\":\"M8.5 2h7\"}],\"$undefined\"]}]}],[\"$\",\"h3\",null,{\"className\":\"text-lg font-bold text-slate-900 dark:text-slate-100\",\"children\":\"Statistical Testing Methods\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed\",\"children\":[\"The choice of test type has direct consequences for required \",[\"$\",\"$L9\",null,{\"href\":\"/sample-size-calculator\",\"className\":\"text-rose-600 dar
46k:text-rose-400 hover:underline\",\"children\":\"sample size\"}],\", error rates, and what conclusions you can draw. These articles cover the \",\"$L4f\",\" with quantified tradeoffs, Kohavi's case for \",\"$L50\",\", and \",\"$L51\",\" for situations where ânot worseâ is the goal.\"]}]]}]}],\"$L52\",\"$L53\"]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"34:[\"$\",\"section\",null,{\"className\":\"py-12 lg:py-24 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"div\",null,{\"className\":\"mb-12\",\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-h2 text-slate-900 dark:text-slate-100 mb-4\",\"children\":\"Article Summaries \u0026 Key Takeaways\"}],[\"$\",\"p\",null,{\"className\":\"text-body-lg text-slate-600 dark:text-slate-400\",\"children\":[\"What each article covers and the most important points to take away from it. For additional context on the statistical concepts discussed here, see our \",[\"$\",\"$L9\",null,{\"href\":\"/statistical-significance-calculator\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"significance calculator\"}],\" and \",[\"$\",\"$L9\",null,{\"href\":\"/glossary\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"A/B testing glossary\"}],\".\"]}]]}]}],[\"$\",\"div\",null,{\"className\":\"max-w-4xl mx-auto space-y-12\",\"children\":[[\"$\",\"$L22\",\"Explore vs Exploit: Finding the Balance in CRO\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"explore-vs-exploit-finding-the-balance-in-cro\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-explore-vs-exploit-finding-the-balance-in-cro\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=awa-digital.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"awa-digital.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-explore-vs-exploit-finding-the-balance-in-cro\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Explore vs Exploit: Finding the Balance in CRO\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"David Sanchez\"]}],[\"$\",\"a\",null,{\"href\":\"https://www.awa-digital.com/blog/balancing-experimentation-portfolios/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],\"$L54\"]}],\"$L55\"]}],\"$L56\"]}]]}]}],\"$L57\",\"$L58\",\"$L59\",\"$L5a\",\"$L5b\",\"$L5c\",\"$L5d\",\"$L5e\",\"$L5f\",\"$L60\"]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"35:[\"$\",\"section\",null,{\"className\":\"relative py-16 overflow-hidden\",\"style\":{\"background\":\"linear-gradient(135deg, #1A1837 0%, #24214D 50%, #3B367E 100%)\"},\"children\":[[\"$\",\"$L61\",null,{}],[\"$\",\"div\",null,{\"className\":\"absolute inset-0 overflow-hidden pointer-events-none\",\"children\":[[\"$\",\"div\",null,{\"className\":\"absolute top-1/4 left-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-rose-600/20 rounded-full blur-3xl\"}],[\"$\",\"div\",null,{\"className\":\"absolute bottom-1/4 right-1/4 w-64 h-64 sm:w-96 sm:h-96 bg-pink-500/20 rounded-full blur-3xl\"}]]}],[\"$\",\"div\",null,{\"className\":\"absolute top-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent\"}],[\"$\",\"div\",null,{\"className\":\"relative z-10 max-w-7xl mx-auto px-4 sm:px-6 lg:px-8\",\"children\":[[\"$\",\"$L22\",null,{\"delay\":0.1,\"children\":[\"$\",\"div\",null,{\"className\":\"text-center mb-10\",\"children\":[[\"$\",\"h2\",null,{\"className\":\"text-2xl sm:text-3xl font-bold tracking-tight mb-4\",\"children\":[\"$\",\"span\",null,{\"className\":\"text-white/90\",\"children\":\"Put these ideas into practice\"}]}],[\"$\",\"p\",null,{\"className\":\"text-lg text-slate-300 max-w-xl mx-auto\",\"children\":\"Use these free tools and guides alongside your reading to apply statistical concepts and run better experiments.\"}]]}]}],[\"$\",\"$L22\",null,{\"delay\":0.2,\"children\":[\"$\",\"div\",null,{\"className\":\"grid sm:grid-cols-2 lg:grid-cols-3 gap-3\",\"children\":[[\"$\",\"$L9\",\"/statistical-significance-calculator\",{\"href\":\"/statistical-significance-calculator\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"A/B Test Significance Calculator\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"Analyze your experiment results\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}],[\"$\",\"$L9\",\"/sample-size-calculator\",{\"href\":\"/sample-size-calculator\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"Sample Size Calculator\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"Plan experiments with proper power analysis\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}],[\"$\",\"$L9\",\"/books\",{\"href\":\"/books\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"A/B Testing Books\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"Essential reading on experimentation\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\"
46:24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[\"$L62\",\"$L63\",\"$undefined\"]}]]}],\"$L64\",\"$L65\",\"$L66\"]}]}]]}],\"$L67\"]}]\n"])</script>
46<script>self.__next_f.push([1,"36:[\"$\",\"script\",\"script-0\",{\"src\":\"/_next/static/chunks/24fd35f1c412cc11.js\",\"async\":true,\"nonce\":\"$undefined\"}]\n37:[\"$\",\"script\",\"script-1\",{\"src\":\"/_next/static/chunks/60cd64dfb12f5951.js\",\"async\":true,\"nonce\":\"$undefined\"}]\n38:[\"$\",\"$L68\",null,{\"children\":[\"$\",\"$3c\",null,{\"name\":\"Next.MetadataOutlet\",\"children\":\"$@69\"}]}]\n"])</script>
46<script>self.__next_f.push([1,"41:[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"amplitude.com\"}]\n42:[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}]\n43:[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dark:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Use Experiment Briefs to Design Better Experiments\"}]\n44:[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Introduces experiment briefs as structured templates covering four phases: Plan, Configure, Monitor, and Analyze. Forces teams to document hypotheses, predetermined actions for each outcome, and sample size requirements before running any test.\"}]\n45:[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Bhavik Patel\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"46:[\"$\",\"$L22\",\"Facts and Fictions About Multiple Comparisons\",{\"delay\":0.25,\"children\":[\"$\",\"a\",null,{\"href\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=ncbi.nlm.nih.gov\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"ncbi.nlm.nih.gov\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-rose-100 dark:bg-rose-900/30 text-rose-700 dark:text-rose-300 border-rose-200 dark:border-rose-800\",\"children\":\"Multiple comparisons\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Facts and Fictions About Multiple Comparisons\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Examines how running multiple statistical tests inflates false positive rates. With just 13 independent comparisons at alpha 0.05, the probability of at least one spurious significant result reaches 50%. Covers correction methods from conservative (Bonferroni) to more nuanced (Benjamini-Hochberg).\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Gail M. Sullivan\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"47:[\"$\",\"$L22\",\"Experimentation: From startup to multiple agile teams\",{\"delay\":0.30000000000000004,\"children\":[\"$\",\"a\",null,{\"href\":\"https://positivejohn.substack.com/p/experimentation-itech-media-from\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=substack.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"substack.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Experimentation: From startup to multiple agile teams\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"A case study tracing how an organization scaled its experimentation practice from ad-hoc testing in a startup environment to systematic experimentation across multiple agile teams. Covers the organizational and cultural shifts required at each growth stage.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Positive John\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"48:[\"$\",\"$L22\",\"One-tailed vs Two-tailed Tests of Significance in A/B Testing\",{\"delay\":0.35,\"children\":[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800\",\"children\":\"Test type\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"One-tailed vs Two-tailed Tests of Significance in A/B Testing\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Argues that one-tailed tests are preferable for most A/B testing scenarios because practitioners act differently depending on whether a result is positive or negative. One-tailed tests require 20-60% smaller sample sizes for the same statistical power and eliminate directional sign errors.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"49:[\"$\",\"$L22\",\"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing\",{\"delay\":0.4,\"children\":[\"$\",\"a\",null,{\"href\":\"https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=docs.google.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"docs.google.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800\",\"children\":\"Test type\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Kohavi argues that organizations sharing experiment results for learning or accountability should use two-sided tests or the TOST equivalence testing procedure. TOST provides a rigorous framework for declaring that a treatment has no meaningful effect, which standard null hypothesis testing cannot do.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Ron Kohavi\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4a:[\"$\",\"$L22\",\"Underpowered A/B Tests: Confusions, Myths, and Reality\",{\"delay\":0.45000000000000007,\"children\":[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-blue-100 dark:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800\",\"children\":\"Sample Size \u0026 Power\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Underpowered A/B Tests: Confusions, Myths, and Reality\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Debunks three common myths about underpowered tests. Distinguishes between hypothetical effect sizes (used in planning), true effect sizes (unknown), and observed effect sizes (from data). Demonstrates that requiring post-hoc power verification of significant results leads to rejecting valid findings.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4b:[\"$\",\"$L22\",\"Statistical Significance for Non-Binomial Metrics\",{\"delay\":0.5,\"children\":[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-emerald-100 dark:bg-emerald-900/30 text-emerald-700 dark:text-emerald-300 border-emerald-200 dark:border-emerald-800\",\"children\":\"Non-Binomial\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Statistical Significance for Non-Binomial Metrics\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Explains how to test statistical significance for continuous metrics like revenue per user, average order value, and pages per session. The key insight is that the sample statistic distribution (not the raw data distribution) determines test validity, and the Central Limit Theorem makes standard t-tests appropriate even for highly skewed metrics.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4c:[\"$\",\"$L22\",\"Interaction effects in online experimentation\",{\"delay\":0.55,\"children\":[\"$\",\"a\",null,{\"href\":\"https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=lukasvermeer.nl\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"lukasvermeer.nl\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-pink-100 dark:bg-pink-900/30 text-pink-700 dark:text-pink-300 border-pink-200 dark:border-pink-800\",\"children\":\"Interaction Effects\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Interaction effects in online experimentation\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Distinguishes two types of overlapping experiment interactions: traffic interactions (where one experiment alters user flow to another's pages, creating sampling bias) and metric interactions (where combined effects differ from the sum of isolated effects). Argues that interaction detection is more valuable than blanket avoidance of overlapping tests.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Lukas Vermeer\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4d:[\"$\",\"$L22\",\"Is non-inferiority on par with superiority?\",{\"delay\":0.6,\"children\":[\"$\",\"a\",null,{\"href\":\"https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=rdatagen.net\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"rdatagen.net\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-amber-100 dark:bg-amber-900/30 text-amber-700 dark:text-amber-300 border-amber-200 dark:border-amber-800\",\"children\":\"Non Inferiority\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Is non-inferiority on par with superiority?\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"Examines the statistical mechanics of non-inferiority testing compared to superiority testing. The core challenge is the non-inferiority margin (delta): unlike superiority tests that compare against zero, non-inferiority requires a subjective threshold that directly influences conclusions.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Keith Goldfeld\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4e:[\"$\",\"$L22\",\"Power and Sample Size Determination\",{\"delay\":0.65,\"children\":[\"$\",\"a\",null,{\"href\":\"https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"group block h-full\",\"children\":[\"$\",\"$L40\",null,{\"className\":\"h-full rounded-xl\",\"gradientFrom\":\"#8b5cf6\",\"gradientTo\":\"#ec4899\",\"gradientColor\":\"#8b5cf620\",\"gradientSize\":250,\"gradientOpacity\":0.4,\"children\":[\"$\",\"div\",null,{\"className\":\"p-5 flex flex-col h-full\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between gap-2 mb-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 min-w-0\",\"children\":[[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=bu.edu\u0026sz=32\",\"alt\":\"\",\"width\":16,\"height\":16,\"sizes\":\"16px\",\"className\":\"w-4 h-4 rounded-sm shrink-0\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500 truncate\",\"children\":\"bu.edu\"}]]}],[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-1 rounded-md text-xs font-medium border shrink-0 bg-blue-100 dark:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800\",\"children\":\"Sample Size \u0026 Power\"}]]}],[\"$\",\"h3\",null,{\"className\":\"font-bold text-base text-slate-900 dark:text-slate-100 mb-2 group-hover:text-rose-600 dar
46k:group-hover:text-rose-400 transition-colors line-clamp-2\",\"children\":\"Power and Sample Size Determination\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mb-3 line-clamp-2 leading-relaxed\",\"children\":\"A comprehensive academic module covering the factors that determine required sample sizes for hypothesis testing. Walks through formulas for comparing means, proportions, and testing associations, emphasizing the interplay between significance level, power, effect size, and variability.\"}],[\"$\",\"div\",null,{\"className\":\"flex items-center justify-between mt-auto pt-2\",\"children\":[[\"$\",\"span\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400\",\"children\":[\"by \",\"Lisa Sullivan, PhD\"]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-4 h-4 text-slate-400 group-hover:text-rose-500 transition-colors shrink-0\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]}]}]}]\n"])</script>
46<script>self.__next_f.push([1,"4f:[\"$\",\"a\",null,{\"href\":\"#one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"one-tailed vs two-tailed debate\"}]\n50:[\"$\",\"a\",null,{\"href\":\"#use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"TOST equivalence testing\"}]\n51:[\"$\",\"$L9\",null,{\"href\":\"/articles/non-inferiority\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"non-inferiority testing\"}]\n"])</script>
46<script>self.__next_f.push([1,"52:[\"$\",\"$L22\",null,{\"delay\":0.25,\"children\":[\"$\",\"div\",null,{\"className\":\"space-y-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2.5\",\"children\":[[\"$\",\"div\",null,{\"className\":\"w-9 h-9 rounded-lg bg-blue-100 dark:bg-blue-900/30 flex items-center justify-center shrink-0\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-chart-column w-4.5 h-4.5 text-blue-600 dark:text-blue-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"c24i48\",{\"d\":\"M3 3v16a2 2 0 0 0 2 2h16\"}],[\"$\",\"path\",\"2bz60n\",{\"d\":\"M18 17V9\"}],[\"$\",\"path\",\"1frdt8\",{\"d\":\"M13 17V5\"}],[\"$\",\"path\",\"17ska0\",{\"d\":\"M8 17v-3\"}],\"$undefined\"]}]}],[\"$\",\"h3\",null,{\"className\":\"text-lg font-bold text-slate-900 dark:text-slate-100\",\"children\":\"Sample Size \u0026 Statistical Power\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed\",\"children\":[\"Running a test without adequate power is the most common and most expensive mistake in experimentation. These articles cover the \",[\"$\",\"a\",null,{\"href\":\"#power-and-sample-size-determination\",\"className\":\"text-rose-600 dar
46k:text-rose-400 hover:underline\",\"children\":\"four factors that determine sample size\"}],\", debunk persistent \",[\"$\",\"a\",null,{\"href\":\"#underpowered-a-b-tests-confusions-myths-and-reality\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"myths about post-hoc power analysis\"}],\" that lead teams to reject valid results, and provide formulas for computing required samples. Use our \",[\"$\",\"$L9\",null,{\"href\":\"/sample-size-calculator\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"sample size calculator\"}],\" to apply these concepts.\"]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"53:[\"$\",\"$L22\",null,{\"delay\":0.3,\"children\":[\"$\",\"div\",null,{\"className\":\"space-y-3\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2.5\",\"children\":[[\"$\",\"div\",null,{\"className\":\"w-9 h-9 rounded-lg bg-pink-100 dark:bg-pink-900/30 flex items-center justify-center shrink-0\",\"children\":[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-layers w-4.5 h-4.5 text-pink-600 dark:text-pink-400\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"zw3jo\",{\"d\":\"M12.83 2.18a2 2 0 0 0-1.66 0L2.6 6.08a1 1 0 0 0 0 1.83l8.58 3.91a2 2 0 0 0 1.66 0l8.58-3.9a1 1 0 0 0 0-1.83z\"}],[\"$\",\"path\",\"1wduqc\",{\"d\":\"M2 12a1 1 0 0 0 .58.91l8.6 3.91a2 2 0 0 0 1.65 0l8.58-3.9A1 1 0 0 0 22 12\"}],[\"$\",\"path\",\"kqbvx6\",{\"d\":\"M2 17a1 1 0 0 0 .58.91l8.6 3.91a2 2 0 0 0 1.65 0l8.58-3.9A1 1 0 0 0 22 17\"}],\"$undefined\"]}]}],[\"$\",\"h3\",null,{\"className\":\"text-lg font-bold text-slate-900 dark:text-slate-100\",\"children\":\"Advanced Topics\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-600 dark:text-slate-400 leading-relaxed\",\"children\":[\"Topics that matter once you move beyond basic conversion rate testing. \",[\"$\",\"a\",null,{\"href\":\"#facts-and-fictions-about-multiple-comparisons\",\"className\":\"text-rose-600 dar
46k:text-rose-400 hover:underline\",\"children\":\"Multiple comparisons\"}],\" explains why testing many metrics inflates false positives and how corrections like Bonferroni and Benjamini-Hochberg work. The \",[\"$\",\"a\",null,{\"href\":\"#statistical-significance-for-non-binomial-metrics\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"non-binomial metrics article\"}],\" shows how to apply t-tests to revenue and other continuous metrics. \",[\"$\",\"a\",null,{\"href\":\"#interaction-effects-in-online-experimentation\",\"className\":\"text-rose-600 dark:text-rose-400 hover:underline\",\"children\":\"Interaction effects\"}],\" covers what happens when overlapping experiments influence each other.\"]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"54:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]\n55:[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Applies the explore/exploit tradeoff from probability theory to CRO portfolios. Proposes frameworks like the 70-20-10 rule for balancing incremental optimization with bold hypothesis testing, with ratios shifting based on organizational maturity.\"}]\n"])</script>
46<script>self.__next_f.push([1,"56:[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}],[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}],[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]]}],[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Exploitation keeps revenue flowing but risks competitive obsolescence; exploration creates future growth but has higher failure rates. Neither alone is a viable strategy.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The 70-20-10 model (70% core optimization, 20% adjacent innovation, 10% transformational bets) provides a practical starting ratio, adapted from Google's resource allocation approach.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The right balance depends on company maturity: pre-product-market-fit companies should explore almost exclusively, while mature organizations shift toward exploitation with structured exploration.\"}]]}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"57:[\"$\",\"$L22\",\"Use Experiment Briefs to Design Better Experiments\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"use-experiment-briefs-to-design-better-experiments\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-use-experiment-briefs-to-design-better-experiments\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=amplitude.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"amplitude.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-use-experiment-briefs-to-design-better-experiments\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Use Experiment Briefs to Design Better Experiments\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Bhavik Patel\"]}],[\"$\",\"a\",null,{\"href\":\"https://amplitude.com/blog/experiment-brief\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Introduces experiment briefs as structured templates covering four phases: Plan, Configure, Monitor, and Analyze. Forces teams to document hypotheses, predetermined actions for each outcome, and sample size requirements before running any test.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}],\"$L6a\",\"$L6b\",\"$undefined\"]}],\"$L6c\"]}],\"$L6d\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"58:[\"$\",\"$L22\",\"Facts and Fictions About Multiple Comparisons\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"facts-and-fictions-about-multiple-comparisons\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-facts-and-fictions-about-multiple-comparisons\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=ncbi.nlm.nih.gov\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-rose-100 dark:bg-rose-900/30 text-rose-700 dark:text-rose-300 border-rose-200 dark:border-rose-800\",\"children\":\"Multiple comparisons\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"ncbi.nlm.nih.gov\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-facts-and-fictions-about-multiple-comparisons\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Facts and Fictions About Multiple Comparisons\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Gail M. Sullivan\"]}],[\"$\",\"a\",null,{\"href\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8370375/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Examines how running multiple statistical tests inflates false positive rates. With just 13 independent comparisons at alpha 0.05, the probability of at least one spurious significant result reaches 50%. Covers correction methods from conservative (Bonferroni) to more nuanced (Benjamini-Hochberg).\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L6e\",\"$L6f\",\"$L70\",\"$undefined\"]}],\"$L71\"]}],\"$L72\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"59:[\"$\",\"$L22\",\"Experimentation: From startup to multiple agile teams\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"experimentation-from-startup-to-multiple-agile-teams\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-experimentation-from-startup-to-multiple-agile-teams\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=substack.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-violet-100 dark:bg-violet-900/30 text-violet-700 dark:text-violet-300 border-violet-200 dark:border-violet-800\",\"children\":\"Framework\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"substack.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-experimentation-from-startup-to-multiple-agile-teams\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Experimentation: From startup to multiple agile teams\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Positive John\"]}],[\"$\",\"a\",null,{\"href\":\"https://positivejohn.substack.com/p/experimentation-itech-media-from\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"A case study tracing how an organization scaled its experimentation practice from ad-hoc testing in a startup environment to systematic experimentation across multiple agile teams. Covers the organizational and cultural shifts required at each growth stage.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L73\",\"$L74\",\"$L75\",\"$undefined\"]}],\"$L76\"]}],\"$L77\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5a:[\"$\",\"$L22\",\"One-tailed vs Two-tailed Tests of Significance in A/B Testing\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800\",\"children\":\"Test type\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-one-tailed-vs-two-tailed-tests-of-significance-in-a-b-testing\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"One-tailed vs Two-tailed Tests of Significance in A/B Testing\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2017/one-tailed-two-tailed-tests-significance-ab-testing/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Argues that one-tailed tests are preferable for most A/B testing scenarios because practitioners act differently depending on whether a result is positive or negative. One-tailed tests require 20-60% smaller sample sizes for the same statistical power and eliminate directional sign errors.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L78\",\"$L79\",\"$L7a\",\"$undefined\"]}],\"$L7b\"]}],\"$L7c\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5b:[\"$\",\"$L22\",\"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=docs.google.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-teal-100 dark:bg-teal-900/30 text-teal-700 dark:text-teal-300 border-teal-200 dark:border-teal-800\",\"children\":\"Test type\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"docs.google.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-use-two-sided-tests-or-two-one-sided-tests-tost-in-a-b-testing\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Use Two-Sided Tests or Two One-Sided Tests (TOST) in A/B Testing\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Ron Kohavi\"]}],[\"$\",\"a\",null,{\"href\":\"https://docs.google.com/document/d/1yLbhC1cEbOzkY4yHsBveirBZFv598E1s/edit\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Kohavi argues that organizations sharing experiment results for learning or accountability should use two-sided tests or the TOST equivalence testing procedure. TOST provides a rigorous framework for declaring that a treatment has no meaningful effect, which standard null hypothesis testing cannot do.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L7d\",\"$L7e\",\"$L7f\",\"$undefined\"]}],\"$L80\"]}],\"$L81\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5c:[\"$\",\"$L22\",\"Underpowered A/B Tests: Confusions, Myths, and Reality\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"underpowered-a-b-tests-confusions-myths-and-reality\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-underpowered-a-b-tests-confusions-myths-and-reality\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-blue-100 dark:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800\",\"children\":\"Sample Size \u0026 Power\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-underpowered-a-b-tests-confusions-myths-and-reality\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Underpowered A/B Tests: Confusions, Myths, and Reality\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2020/underpowered-a-b-tests-confusions-myths-reality/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Debunks three common myths about underpowered tests. Distinguishes between hypothetical effect sizes (used in planning), true effect sizes (unknown), and observed effect sizes (from data). Demonstrates that requiring post-hoc power verification of significant results leads to rejecting valid findings.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L82\",\"$L83\",\"$L84\",\"$undefined\"]}],\"$L85\"]}],\"$L86\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5d:[\"$\",\"$L22\",\"Statistical Significance for Non-Binomial Metrics\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"statistical-significance-for-non-binomial-metrics\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-statistical-significance-for-non-binomial-metrics\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=analytics-toolkit.com\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-emerald-100 dark:bg-emerald-900/30 text-emerald-700 dark:text-emerald-300 border-emerald-200 dark:border-emerald-800\",\"children\":\"Non-Binomial\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"analytics-toolkit.com\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-statistical-significance-for-non-binomial-metrics\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Statistical Significance for Non-Binomial Metrics\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Georgi Georgiev\"]}],[\"$\",\"a\",null,{\"href\":\"https://blog.analytics-toolkit.com/2017/statistical-significance-non-binomial-metrics-revenue-time-site-pages-session-aov-rpu/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Explains how to test statistical significance for continuous metrics like revenue per user, average order value, and pages per session. The key insight is that the sample statistic distribution (not the raw data distribution) determines test validity, and the Central Limit Theorem makes standard t-tests appropriate even for highly skewed metrics.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L87\",\"$L88\",\"$L89\",\"$undefined\"]}],\"$L8a\"]}],\"$L8b\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5e:[\"$\",\"$L22\",\"Interaction effects in online experimentation\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"interaction-effects-in-online-experimentation\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-interaction-effects-in-online-experimentation\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=lukasvermeer.nl\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-pink-100 dark:bg-pink-900/30 text-pink-700 dark:text-pink-300 border-pink-200 dark:border-pink-800\",\"children\":\"Interaction Effects\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"lukasvermeer.nl\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-interaction-effects-in-online-experimentation\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Interaction effects in online experimentation\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Lukas Vermeer\"]}],[\"$\",\"a\",null,{\"href\":\"https://www.lukasvermeer.nl/publications/2023/02/27/interaction-effects-in-online-experimentation.html\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Distinguishes two types of overlapping experiment interactions: traffic interactions (where one experiment alters user flow to another's pages, creating sampling bias) and metric interactions (where combined effects differ from the sum of isolated effects). Argues that interaction detection is more valuable than blanket avoidance of overlapping tests.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L8c\",\"$L8d\",\"$L8e\",\"$undefined\"]}],\"$L8f\"]}],\"$L90\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"5f:[\"$\",\"$L22\",\"Is non-inferiority on par with superiority?\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"is-non-inferiority-on-par-with-superiority\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-is-non-inferiority-on-par-with-superiority\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=rdatagen.net\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-amber-100 dark:bg-amber-900/30 text-amber-700 dark:text-amber-300 border-amber-200 dark:border-amber-800\",\"children\":\"Non Inferiority\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"rdatagen.net\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-is-non-inferiority-on-par-with-superiority\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Is non-inferiority on par with superiority?\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Keith Goldfeld\"]}],[\"$\",\"a\",null,{\"href\":\"https://www.rdatagen.net/post/are-non-inferiority-trials-inferior/\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Examines the statistical mechanics of non-inferiority testing compared to superiority testing. The core challenge is the non-inferiority margin (delta): unlike superiority tests that compare against zero, non-inferiority requires a subjective threshold that directly influences conclusions.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[\"$L91\",\"$L92\",\"$L93\",\"$undefined\"]}],\"$L94\"]}],\"$L95\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"60:[\"$\",\"$L22\",\"Power and Sample Size Determination\",{\"delay\":0.1,\"children\":[\"$\",\"section\",null,{\"id\":\"power-and-sample-size-determination\",\"className\":\"scroll-mt-24 rounded-2xl overflow-hidden border border-slate-200 dark:border-slate-800 bg-slate-50 dark:bg-slate-950\",\"aria-labelledby\":\"heading-power-and-sample-size-determination\",\"children\":[[\"$\",\"div\",null,{\"className\":\"relative p-6 sm:p-8 lg:p-10 border-b border-slate-200 dark:border-slate-800 bg-slate-100 dark:bg-slate-900/50\",\"children\":[\"$\",\"div\",null,{\"className\":\"flex items-start gap-4\",\"children\":[[\"$\",\"div\",null,{\"className\":\"shrink-0 mt-1\",\"children\":[\"$\",\"$L3f\",null,{\"src\":\"https://www.google.com/s2/favicons?domain=bu.edu\u0026sz=64\",\"alt\":\"\",\"width\":28,\"height\":28,\"sizes\":\"28px\",\"className\":\"w-7 h-7 rounded-md\"}]}],[\"$\",\"div\",null,{\"className\":\"flex-1 min-w-0\",\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-1.5 flex-wrap\",\"children\":[[\"$\",\"span\",null,{\"className\":\"inline-flex items-center gap-1 px-2 py-0.5 rounded-md text-xs font-medium border bg-blue-100 dark:bg-blue-900/30 text-blue-700 dark:text-blue-300 border-blue-200 dark:border-blue-800\",\"children\":\"Sample Size \u0026 Power\"}],[\"$\",\"span\",null,{\"className\":\"text-xs text-slate-400 dark:text-slate-500\",\"children\":\"bu.edu\"}]]}],[\"$\",\"h3\",null,{\"id\":\"heading-power-and-sample-size-determination\",\"className\":\"text-h3 text-slate-900 dark:text-slate-100\",\"children\":\"Power and Sample Size Determination\"}],[\"$\",\"p\",null,{\"className\":\"text-body-sm text-slate-500 dark:text-slate-400 mt-1.5\",\"children\":[\"by \",\"Lisa Sullivan, PhD\"]}],[\"$\",\"a\",null,{\"href\":\"https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_power/bs704_power_print.html\",\"target\":\"_blank\",\"rel\":\"noopener noreferrer\",\"className\":\"mt-3 inline-flex items-center gap-1.5 text-body-sm font-semibold text-rose-600 dar
46k:text-rose-400 hover:opacity-80 transition-opacity\",\"children\":[\"Read the full article \",[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-external-link w-3.5 h-3.5\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1q9fwt\",{\"d\":\"M15 3h6v6\"}],[\"$\",\"path\",\"gplh6r\",{\"d\":\"M10 14 21 3\"}],[\"$\",\"path\",\"a6xqqp\",{\"d\":\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"}],\"$undefined\"]}]]}]]}]]}]}],[\"$\",\"div\",null,{\"className\":\"p-6 sm:p-8 lg:p-10 space-y-8\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-book-open w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1akyts\",{\"d\":\"M12 7v14\"}],[\"$\",\"path\",\"ruj8y\",{\"d\":\"M3 18a1 1 0 0 1-1-1V4a1 1 0 0 1 1-1h5a4 4 0 0 1 4 4 4 4 0 0 1 4-4h5a1 1 0 0 1 1 1v13a1 1 0 0 1-1 1h-6a3 3 0 0 0-3 3 3 3 0 0 0-3-3z\"}],\"$undefined\"]}],[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"What this article covers\"}]]}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"A comprehensive academic module covering the factors that determine required sample sizes for hypothesis testing. Walks through formulas for comparing means, proportions, and testing associations, emphasizing the interplay between significance level, power, effect size, and variability.\"}]]}],[\"$\",\"div\",null,{\"children\":[[\"$\",\"div\",null,{\"className\":\"flex items-center gap-2 mb-3\",\"children\":[[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-lightbulb w-4 h-4 shrink-0 text-rose-500\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}],\"$L96\",\"$L97\",\"$undefined\"]}],\"$L98\"]}],\"$L99\"]}]]}]]}]}]\n"])</script>
46<script>self.__next_f.push([1,"62:[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}]\n63:[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}]\n64:[\"$\",\"$L9\",\"/glossary\",{\"href\":\"/glossary\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"A/B Testing Glossary\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"100+ experimentation terms explained\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]\n65:[\"$\",\"$L9\",\"/courses\",{\"href\":\"/courses\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"A/B Testing Courses\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"Structured learning paths for experimentation\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]\n66:[\"$\",\"$L9\",\"/ab-testing-tools\",{\"href\":\"/ab-testing-tools\",\"className\":\"group flex items-center justify-between gap-3 rounded-xl border border-white/10 bg-white/5 backdrop-blur-sm p-4 hover:bg-white/10 hover:border-rose-400/30 transition-colors\",\"children\":[[\"$\",\"div\",null,{\"children\":[[\"$\",\"p\",null,{\"className\":\"text-sm font-semibold text-white group-hover:text-rose-300 transition-colors\",\"children\":\"A/B Testing Tools\"}],[\"$\",\"p\",null,{\"className\":\"text-xs text-slate-400 mt-0.5\",\"children\":\"Compare experimentation platforms\"}]]}],[\"$\",\"svg\",null,{\"ref\":\"$undefined\",\"xmlns\":\"http://www.w3.org/2000/svg\",\"width\":24,\"height\":24,\"viewBox\":\"0 0 24 24\",\"fill\":\"none\",\"stroke\":\"currentColor\",\"strokeWidth\":2,\"strokeLinecap\":\"round\",\"strokeLinejoin\":\"round\",\"className\":\"lucide lucide-arrow-right w-4 h-4 shrink-0 text-slate-500 group-hover:text-rose-400 transition-colors\",\"aria-hidden\":\"true\",\"children\":[[\"$\",\"path\",\"1ays0h\",{\"d\":\"M5 12h14\"}],[\"$\",\"path\",\"xquz4c\",{\"d\":\"m12 5 7 7-7 7\"}],\"$undefined\"]}]]}]\n67:[\"$\",\"div\",null,{\"className\":\"absolute bottom-0 left-0 right-0 h-px bg-gradient-to-r from-transparent via-rose-500/30 to-transparent\"}]\n"])</script>
46<script>self.__next_f.push([1,"6a:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n6b:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n6c:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"6d:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"A \\\"good experiment\\\" is a well-designed experiment, not one that produces a winning result. Briefs enforce this distinction by separating design quality from outcome.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Predetermined actions prevent post-hoc rationalization. Teams decide what they will do with a win, loss, or flat result before seeing data.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Experiment briefs create institutional knowledge that survives team turnover, making the reasoning behind past decisions accessible to future team members.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"6e:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n6f:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n70:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n71:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"72:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The probability of at least one false positive grows rapidly with each additional test: 10 comparisons at alpha 0.05 produce a 40% chance of a spurious significant result.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Bonferroni correction (dividing alpha by number of comparisons) is simple but conservative. Benjamini-Hochberg controls the false discovery rate and is often more practical for experimentation.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Prespecifying which comparisons you plan to run, and how many, is the single most effective defense against multiple comparison problems.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"73:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n74:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n75:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n76:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"77:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Early-stage experimentation is about building the habit: any test is better than no test, even if the methodology is imperfect.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Scaling experimentation requires dedicated ownership. Without someone responsible for test quality and prioritization, experimentation degrades as teams grow.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Cross-team experimentation needs shared infrastructure and standards to prevent conflicting tests and ensure consistent statistical rigor.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"78:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n79:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n7a:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n7b:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"7c:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The choice between one-tailed and two-tailed tests depends on your decision framework, not on statistical accuracy. Both are equally valid; they answer different questions.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"One-tailed tests require substantially smaller samples (20-60% less traffic) to achieve the same power, directly reducing test duration.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Two-tailed tests introduce the possibility of Type III errors (getting the direction of the effect wrong), which one-tailed tests avoid by design.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"7d:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n7e:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n7f:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n80:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"81:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Two-sided tests protect against confirmation bias by treating both directions equally, making them appropriate when results are shared publicly or used for organizational learning.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"TOST (Two One-Sided Tests) can rigorously declare \\\"no meaningful effect,\\\" filling a gap that standard null hypothesis testing leaves open.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The choice between one-sided and two-sided/TOST depends on whether you need to convince others (use TOST/two-sided) or make internal go/no-go decisions (one-sided is acceptable).\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"82:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n83:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n84:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n85:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"86:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"A statistically significant result does not need retroactive power verification. If the null hypothesis is rejected at the planned alpha level, the result stands regardless of post-hoc power calculations.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Conflating observed lift with the minimum detectable effect leads to unnecessarily conservative decisions, sometimes making error control 50x more stringent than intended.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Proper power analysis belongs in the planning phase. Using it to evaluate completed tests is a category error that confuses planning parameters with inferential outcomes.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"87:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n88:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n89:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n8a:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"8b:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Non-normal data distributions do not invalidate t-tests. The Central Limit Theorem ensures the sampling distribution of means is approximately normal regardless of the underlying data shape.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Testing non-binomial metrics requires extracting user-level or session-level data to estimate variance, then applying standard t-test methodology with the pooled standard error of the mean.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"For multiple metric comparisons, Dunnett's correction provides tighter confidence intervals than Bonferroni while still controlling family-wise error rate.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"8c:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n8d:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n8e:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n8f:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"90:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Not all overlapping experiments interact. Traffic interactions create sampling bias, while metric interactions produce genuinely different combined effects. The distinction matters for diagnosis and resolution.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Detected interactions often reveal functional conflicts degrading user experience, making them diagnostic signals rather than merely statistical nuisances.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Organizations should focus on detecting interactions rather than preventing all experiment overlap, because detection leads to new insights while avoidance limits experimentation velocity.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"91:[\"$\",\"path\",\"1gvzjb\",{\"d\":\"M15 14c.2-1 .7-1.7 1.5-2.5 1-.9 1.5-2.2 1.5-3.5A6 6 0 0 0 6 8c0 1 .2 2.2 1.5 3.5.7.7 1.3 1.5 1.5 2.5\"}]\n92:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n93:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n94:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"95:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Non-inferiority testing shifts the null hypothesis from \\\"no difference\\\" to \\\"the new treatment is worse by at least delta,\\\" making the choice of delta the most consequential design decision.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"The same data can yield different non-inferiority conclusions depending on the chosen margin, while superiority conclusions remain stable. This makes margin selection a point of vulnerability.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Principled delta selection based on clinical or business relevance matters more than simply increasing sample size for making compelling non-inferiority claims.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"96:[\"$\",\"path\",\"x1upvd\",{\"d\":\"M9 18h6\"}]\n97:[\"$\",\"path\",\"ceow96\",{\"d\":\"M10 22h4\"}]\n98:[\"$\",\"h4\",null,{\"className\":\"text-overline text-slate-500 dark:text-slate-400\",\"children\":\"Key takeaways\"}]\n"])</script>
46<script>self.__next_f.push([1,"99:[\"$\",\"ol\",null,{\"className\":\"space-y-4\",\"children\":[[\"$\",\"li\",\"0\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":1}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Four factors determine sample size: significance level (alpha), desired power (1 minus beta), the minimum effect size of interest, and the variability of the outcome. Changing any one directly affects the required sample.\"}]]}],[\"$\",\"li\",\"1\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":2}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Power and sample size have a nonlinear relationship. Increasing power from 80% to 90% requires substantially more than a 12.5% increase in sample size.\"}]]}],[\"$\",\"li\",\"2\",{\"className\":\"flex gap-3.5\",\"children\":[[\"$\",\"span\",null,{\"className\":\"shrink-0 w-6 h-6 rounded-full flex items-center justify-center text-xs font-bold text-white mt-0.5 bg-gradient-to-br from-rose-500 to-pink-500\",\"children\":3}],[\"$\",\"p\",null,{\"className\":\"text-body text-slate-700 dark:text-slate-300 leading-relaxed\",\"children\":\"Effect size estimation is the most difficult and most important input. Overly optimistic effect size assumptions lead to underpowered tests, while conservative estimates lead to unnecessarily long tests.\"}]]}]]}]\n"])</script>
46<script>self.__next_f.push([1,"3a:[[\"$\",\"meta\",\"0\",{\"charSet\":\"utf-8\"}],[\"$\",\"meta\",\"1\",{\"name\":\"viewport\",\"content\":\"width=device-width, initial-scale=1\"}],[\"$\",\"meta\",\"2\",{\"name\":\"theme-color\",\"content\":\"#1e1b4b\"}]]\n"])</script>
46<script>self.__next_f.push([1,"9a:I[27201,[\"/_next/static/chunks/ff1a16fafef87110.js\",\"/_next/static/chunks/a2dfb6fc5208ab9b.js\"],\"IconMark\"]\n"])</script>
46<script>self.__next_f.push([1,"3d:[[\"$\",\"title\",\"0\",{\"children\":\"A/B Testing Articles \u0026 Expert Guides | ABTestResult.com\"}],[\"$\",\"meta\",\"1\",{\"name\":\"description\",\"content\":\"Curated articles on A/B testing covering statistical methods, sample sizing, experimentation frameworks, and non-inferiority testing from industry experts.\"}],[\"$\",\"meta\",\"2\",{\"name\":\"application-name\",\"content\":\"ABTestResult\"}],[\"$\",\"meta\",\"3\",{\"name\":\"author\",\"content\":\"ABTestResult.com\"}],[\"$\",\"link\",\"4\",{\"rel\":\"manifest\",\"href\":\"/manifest.webmanifest\",\"crossOrigin\":\"$undefined\"}],[\"$\",\"meta\",\"5\",{\"name\":\"keywords\",\"content\":\"ab testing articles,experimentation guides,one-tailed vs two-tailed test,TOST equivalence testing,sample size determination,statistical power ab testing,multiple comparisons correction,non-inferiority testing,guardrail metrics ab testing,non-binomial metrics ab testing,interaction effects experimentation,experiment brief template,explore exploit cro,underpowered ab tests,ab testing methodology,statistical significance articles\"}],[\"$\",\"meta\",\"6\",{\"name\":\"robots\",\"content\":\"index, follow\"}],[\"$\",\"meta\",\"7\",{\"name\":\"googlebot\",\"content\":\"index, follow, max-video-preview:-1, max-image-preview:large, max-snippet:-1\"}],[\"$\",\"link\",\"8\",{\"rel\":\"canonical\",\"href\":\"https://abtestresult.com/articles\"}],[\"$\",\"meta\",\"9\",{\"name\":\"format-detection\",\"content\":\"telephone=no, address=no, email=no\"}],[\"$\",\"meta\",\"10\",{\"name\":\"msvalidate.01\",\"content\":\"8A0AD1084F0F69CEB6EC8B546244828E\"}],[\"$\",\"meta\",\"11\",{\"name\":\"mobile-web-app-capable\",\"content\":\"yes\"}],[\"$\",\"meta\",\"12\",{\"name\":\"apple-mobile-web-app-title\",\"content\":\"ABTestResult\"}],[\"$\",\"meta\",\"13\",{\"name\":\"apple-mobile-web-app-status-bar-style\",\"content\":\"black-translucent\"}],[\"$\",\"meta\",\"14\",{\"property\":\"og:title\",\"content\":\"A/B Testing Articles \u0026 Expert Guides\"}],[\"$\",\"meta\",\"15\",{\"property\":\"og:description\",\"content\":\"Curated articles on statistical testing methods, sample sizing, and experimentation frameworks from industry experts.\"}],[\"$\",\"meta\",\"16\",{\"property\":\"og:url\",\"content\":\"https://abtestresult.com/articles\"}],[\"$\",\"meta\",\"17\",{\"property\":\"og:image:alt\",\"content\":\"A/B Testing Articles - Expert Guides on Experimentation\"}],[\"$\",\"meta\",\"18\",{\"property\":\"og:image:type\",\"content\":\"image/png\"}],[\"$\",\"meta\",\"19\",{\"property\":\"og:image\",\"content\":\"https://abtestresult.com/articles/opengraph-image?16c36f98f3f853ba\"}],[\"$\",\"meta\",\"20\",{\"property\":\"og:image:width\",\"content\":\"1200\"}],[\"$\",\"meta\",\"21\",{\"property\":\"og:image:height\",\"content\":\"630\"}],[\"$\",\"meta\",\"22\",{\"property\":\"og:type\",\"content\":\"website\"}],[\"$\",\"meta\",\"23\",{\"name\":\"twitter:card\",\"content\":\"summary_large_image\"}],[\"$\",\"meta\",\"24\",{\"name\":\"twitter:title\",\"content\":\"A/B Testing Articles\"}],[\"$\",\"meta\",\"25\",{\"name\":\"twitter:description\",\"content\":\"Curated articles on statistical testing methods, sample sizing, and experimentation frameworks.\"}],[\"$\",\"meta\",\"26\",{\"name\":\"twitter:image:alt\",\"content\":\"A/B Testing Articles - Expert Guides on Experimentation\"}],[\"$\",\"meta\",\"27\",{\"name\":\"twitter:image:type\",\"content\":\"image/png\"}],[\"$\",\"meta\",\"28\",{\"name\":\"twitter:image\",\"content\":\"https://abtestresult.com/articles/opengraph-image?16c36f98f3f853ba\"}],[\"$\",\"meta\",\"29\",{\"name\":\"twitter:image:width\",\"content\":\"1200\"}],[\"$\",\"meta\",\"30\",{\"name\":\"twitter:image:height\",\"content\":\"630\"}],[\"$\",\"link\",\"31\",{\"rel\":\"icon\",\"href\":\"/favicon.ico\",\"sizes\":\"48x48\"}],[\"$\",\"link\",\"32\",{\"rel\":\"icon\",\"href\":\"/icon.png\",\"type\":\"image/png\",\"sizes\":\"512x512\"}],[\"$\",\"link\",\"33\",{\"rel\":\"apple-touch-icon\",\"href\":\"/icon.png\"}],[\"$\",\"$L9a\",\"34\",{}]]\n"])</script>
46<script>self.__next_f.push([1,"69:null\n"])</script>
46</body></html>
Line numbers count LF bytes from the start of the resource, as the search results do. Vendor segments are library code the classifier recognised; they are stored but not indexed. Bytes are shown as Latin1 characters, one per byte.