Probability Basics

The Science of Gaming: Probability and Strategic Decision-Making

How decision science frames choices under uncertainty in games, from building simple models and simulating them to testing results and updating beliefs.

On this page
  1. Treating a game choice as a question you can test
  2. Step 1: State the choice and the outcomes
  3. Step 2: Build a simple model
  4. Step 3: Check the assumptions
  5. Step 4: Simulate and test
  6. Step 5: Update when evidence arrives
  7. Why this framing helps
  8. Limits of the method

Treating a game choice as a question you can test

Decision science is the study of how to choose well when the outcome is uncertain. Applied to games, it means treating a strategic question the way a scientist would treat any other: state it clearly, build a simple model, test the model against evidence, and revise it when it fails.

This is different from gut feeling and different from pure calculation. It combines both, and it is honest about what is unknown.

Step 1: State the choice and the outcomes

Start by naming the options and the outcomes you care about. “Should I take the safer route?” is vague. “Which of these two options gives the better chance of reaching the final round?” is a question with a measurable answer.

You also need a measure of value. Often it is a win or a loss, but sometimes it is points, resources or progress. Different goals can favour different choices, which is why a decision rarely has a single correct answer independent of context.

Step 2: Build a simple model

A model is a simplified description of how the situation works. A good model includes what drives the outcome and leaves out the rest.

Suppose you can choose between two actions. Action A succeeds 70 percent of the time and is worth 2 points. Action B succeeds 40 percent of the time and is worth 4 points, and failure scores nothing in both cases.

  • Action A: 0.7 × 2 = 1.4 points on average
  • Action B: 0.4 × 4 = 1.6 points on average

On average B is slightly better, though A fails less often. Which you prefer depends on whether averages are what you care about. If you need at least 2 points to survive a round, A is much more likely to get you there. The model does not choose for you; it makes the trade-off visible.

Step 3: Check the assumptions

Every model rests on assumptions, and they are where it most often fails. The success rates above might be estimates from a handful of attempts, in which case 70 and 40 are uncertain. A simple sensitivity check asks how the answer changes if the inputs are a little off. If B’s success rate were really 35 percent, its average would be 0.35 × 4 = 1.4, level with A. Since a modest error flips the ranking, the honest conclusion is that the options are close, not that B is better.

The same applies to the game state itself. A model that ignores something important, such as what your opponent can see or what resources remain, will give clean-looking but unreliable answers.

Step 4: Simulate and test

When the maths gets complicated, you can estimate the answer by simulation. Repeat the situation many times, with a program, dice or cards, and count what happens. Simulation is not magic, since it only reflects the rules and assumptions you put in, but it handles situations that are tedious to work out by hand, such as multi-step sequences with several random events.

Testing against real results is the other half. If a model predicts a 60 percent success rate and your actual record over a large number of attempts is nearer 45 percent, either the model or the sample is off. A small number of attempts proves little, and even a correct model will show some wobble from one sample to the next.

Step 5: Update when evidence arrives

Beliefs about the world should change with evidence, and the standard tool is Bayes’ rule, which works out how much to move.

Imagine you are unsure whether a coin is fair. You treat the two cases as equally likely: a fair coin (50 percent heads) or a biased one that gives heads 75 percent of the time. You flip once and see heads.

  • Fair and heads: 0.5 × 0.5 = 0.25
  • Biased and heads: 0.5 × 0.75 = 0.375
  • Total chance of heads: 0.625

The updated probability that the coin is biased is 0.375 ÷ 0.625 = 0.6. One flip moved you from 50 percent to 60 percent, which is a sensible, modest shift. Further flips would move it more, and a quick run of tails would pull it back. Reading an opponent’s habits works the same way: each observation nudges your estimate rather than settling it.

Why this framing helps

The scientific approach guards against some common mistakes. It reminds you to judge choices by their reasoning rather than their results, to distrust conclusions drawn from tiny samples, and to keep track of how sure you really are. It also works as an ongoing habit. Informed decisions improve over time because each attempt gives you data on whether your model was any good, which is part of the path to mastery.

Game designers use the same toolkit from the other side. They model how players will behave, simulate large numbers of plays, and adjust rules until outcomes look the way they intended. That is the basis of probabilistic design, and it explains why well-balanced games tend to survive close analysis.

Limits of the method

Models simplify, and simplification can mislead. Real opponents adapt, so a strategy that is strong against average play may be exploitable once others learn it. Some quantities, such as how much you value a risky outcome, cannot be measured and must be judged. And no model removes uncertainty from a single game; it only helps you choose more consistently. In any setting involving real money, treat model outputs as a way to understand risk, not as a forecast of what will happen.

The complete guide to probability basics

The Math Behind Gaming: Understanding Probability and Strategy
Read the guide

Keep exploring

Guides from other topics

All topics →