News - BlastOptimize

False positives in A/B testing: sample imbalance between groups

Tom BlastOptimize
September 25, 2026

False positives in A/B testing: the causes we don't see

Updated September 25, 2026 — Understanding false positives in A/B testing before they skew your decisions. Contents: A false positive, beyond the purely statistical definition; Sample Ratio Mismatch: the false positive that doesn't speak its name; Contamination by bots…

Black and white photo of a shopping cart illustrating e-commerce A/B testing

Tom BlastOptimize
September 23, 2026

A/B testing e-commerce: 7 high-impact ideas (2026)

Updated September 23, 2026 Contents Before the 7 ideas: why not copy a recipe 1. The free delivery threshold 2. Urgency and stock alerts 3. The number of checkout steps 4. Social proof near the buy button 5. The exit-intent pop-up,…

A/B testing KPI hierarchy: primary metric, guardrails, and diagnostics

Tom BlastOptimize
September 21, 2026

A/B testing KPIs: which ones to track and in what order (2026)

Updated September 21, 2026 Contents A/B Test KPIs: A Three-Level Hierarchy Choosing Your Primary Metric Guardrail Metrics: What Protects Your Business While You Optimize The 10 Most Used KPIs in A/B Testing The Novelty Effect:…

Abstract black and white curve evoking a statistical distribution of the A/B test

Tom BlastOptimize
September 18, 2026

Statistical Significance of an A/B Test: The Complete Guide

Updated September 18, 2026 Contents Statistical significance in a nutshell Type I and Type II errors: the two ways to go wrong P-value and confidence interval: what they really say The "peeking" trap: why look too closely at your results…

Grid of geometric squares illustrating the combinations of a multivariate test

Tom BlastOptimize
September 16, 2026

A/B testing vs multivariate testing (MVT): what's the difference?

Updated September 16, 2026 Contents The difference in one sentence How a classic A/B test works How a multivariate test works Why MVT requires so much more traffic: the real statistical reason When to choose A/B testing When to choose multivariate testing 5 reasons to…

1
2
3
4
5