A/B Test Lab: a free game about reading experiments

What is A/B Test Lab?

Two versions of a post, a stream of views. Version B looks ahead after 40 views: call it, or wait for more data? Results reveal how many early winners were just luck.

A/B Test Lab is a free game about experiments. Two versions of a post, views coming in, and one question: call a winner now, or wait?

Each test hides a true click rate for each version. Call too early and luck may fool you; wait too long and you lose points. The end screen shows how many early leaders were real.

At a glance

Category

Social Media

Difficulty

Hard

Play time

4–6 min

Price

Free, in your browser, sign-up optional

How to play

Watch

Views come in; each version's click rate updates.

Call it

Call A, call B, or wait for more views. Calling right early scores more; calling wrong costs points.

Three levels

Beginner, Intermediate or Expert, picked before you play: the content and the clock change, and each level keeps its own best score.

Scoring

A right call scores 100 plus up to 50 for calling early; a wrong call costs 50. Waiting until the test ends scores 60 if you then pick right.

Win with at least 60% right calls.

What it trains

Reading experiments

Sample size and noise.

Decision making

Stopping rules.

Strategy and tips

Small samples lie

A lead after 40 views is often noise.

Look at the gap and the views

A big gap with many views is a real winner; a small gap needs a lot more data.

Decide before you look

Pick your stopping rule first, or you'll stop when you like the result.

Why play A/B Test Lab?

Calling experiments too early is one of the most common mistakes in marketing. Feeling the noise once makes you patient.

Frequently asked questions