Skip to content
All games
SkillXGamesReady
LevelHardTime3–5 minZoneSkillx Valley

Skillx Valley · Experiments

A/B Test Oracle

Read A/B test results from made-up startups: sample size, significance, novelty effects, peeking and guardrails. Ship B, kill it, or keep it running.

Trains
Work skills
Difficulty
Hard
Length
3–5 min

Skillx Valley · Hard

Tutorial

How to play A/B Test Oracle

Steps

  1. Call: 1 Ship B · 2 Kill it · 3 Keep running.

  2. Win: Make the right call on 70% of the experiments.

  3. Made up: Every startup, fund, product and person in the game is made up. Coins are fictional: not financial advice.

Scoring

  • +100 if right, +10 per test.

  • Why: On Expert, name the reason too: +50.

  • Three levels: Beginner, Intermediate or Expert, picked before you play: the cases and the clock change, and each level keeps its own best score.

Controls

  • Tap or click: Every choice is a button: tap it on a phone, click it on a computer.

  • Keyboard: Tab moves between buttons; Enter or Space picks.

  • Full screen & Record: Above the game: play full screen, or record a clip to share.

Tips

  • Four checks: A big enough sample, B clearly ahead, the planned end reached, and a steady lift with guardrails fine.

  • Too early is not a loss: A small sample or a test cut short means keep running, not kill.

  • Read the note: Refunds doubling or a lift shrinking each week can overturn a great-looking average.

Sponsored · doesn't affect scores

Advertise here (opens in a new tab)

Your logo here, on this game and 2 more you pick · $350/mo for 3 games · Book a cell (opens in a new tab)