Who would’ve thought that an old TV game show could inspire a statistical problem that has tripped up mathematicians and statisticians with Ph.Ds? The Monty Hall problem has confused people for decades. In the game show, Let’s Make a Deal, Monty Hall asks you to guess which closed door a prize is behind. The answer is so puzzling that people often refuse to accept it! The problem occurs because our statistical assumptions are incorrect.
The Monty Hall problem’s baffling solution reminds me of optical illusions where you find it hard to disbelieve your eyes. For the Monty Hall problem, it’s hard to disbelieve your common sense solution even though it is incorrect!
The comparison to optical illusions is apt. Even though I accept that square A and square B are the same color, it just doesn’t seem to be true. Optical illusions remain deceiving even after you understand the truth because your brain’s assessment of the visual data is operating under a false assumption about the image.
I consider the Monty Hall problem to be a statistical illusion. This statistical illusion occurs because your brain’s process for evaluating probabilities in the Monty Hall problem is based on a false assumption. Similar to optical illusions, the illusion can seem more real than the actual answer.
To see through this statistical illusion, we need to carefully break down the Monty Hall problem and identify where we’re making incorrect assumptions. This process emphasizes how crucial it is to check that you’re satisfying the assumptions of a statistical analysis before trusting the results.
What is the Monty Hall Problem?
Monty Hall asks you to choose one of three doors. One of the doors hides a prize and the other two doors have no prize. You state out loud which door you pick, but you don’t open it right away.
Monty opens one of the other two doors, and there is no prize behind it.
At this moment, there are two closed doors, one of which you picked.
The prize is behind one of the closed doors, but you don’t know which one.
Monty asks you, “Do you want to switch doors?”
The majority of people assume that both doors are equally like to have the prize. It appears like the door you chose has a 50/50 chance. Because there is no perceived reason to change, most stick with their initial choice.
Time to shatter this illusion with the truth! If you switch doors, you double your probability of winning!
How to Solve the Monty Hall problem
When Marilyn vos Savant was asked this question in her Parade magazine column, she gave the correct answer that you should switch doors to have a 66% chance of winning. Her answer was so unbelievable that she received thousands of incredulous letters from readers, many with Ph.D.s! Paul Erdős, a noted mathematician, was swayed only after observing a computer simulation.
It’ll probably be hard for me to illustrate the truth of this solution, right? That turns out to be the easy part. I can show you in the short table below. You just need to be able to count to 6!
It turns out that there are not too many different combinations of choices and outcomes. Therefore, I can just show them all to you and we calculate the percentage for each outcome.
|You Pick||Prize Door||Monty Opens||Don’t Switch||Switch|
|1||1||2 or 3||Win||Lose|
|2||2||1 or 3||Win||Lose|
|3||3||1 or 2||Win||Lose|
|3 Wins (33%)||6 Wins (66%)|
Here’s how you read the table of outcomes for the Monty Hall problem. Each row shows a different combination of initial door choice, where the prize is located, the door Monty Hall opens, and the outcomes for when you “Don’t Switch” and “Switch.”
The first row shows the scenario where you pick door 1 initially and the prize is behind door 1. Because neither closed door has the prize, Monty is free to open either and the result is the same. For this scenario, if you switch you lose; or, if you stick with your original choice, you win.
For the second row, you pick door 1 and the prize is behind door 2. Monty can only open door 3 because otherwise he reveals the prize behind door 2.
The table shows all of the potential situations. We just need to count up the number of wins for each door strategy. The final row shows the total wins and it confirms that you win twice as often when you take up Monty on his offer to switch doors.
Why the Monty Hall Solution Hurts Your Brain
I hope this empirical illustration convinces you that the probability of winning doubles when you switch doors. The tough part is to understand why this happens!
To understand the solution, you first need to understand why your brain is screaming the incorrect solution that it is 50/50. Our brains are using incorrect statistical assumptions for this problem and that’s why we can’t trust our answer.
Typically, we think of probabilities for independent, random events. Flipping a coin is a good example. The probability of a heads is 0.5 and we obtain that simply by dividing the specific outcome by the total number of outcomes. That’s why it feels so right that the final two doors each have a probability of 0.5.
However, for this method to produce the correct answer, the process you are studying must be random and have probabilities that do not change. Unfortunately, the Monty Hall problem does not satisfy either requirement.
How the Monty Hall Problem Violates the Randomness Assumption
The only random portion of the process is your first choice. When you pick one of the three doors, you truly have a 0.33 probability of picking the correct door. The “Don’t Switch” column in the table verifies this by showing you’ll win 33% of the time if you stick with your initial random choice.
The process stops being random when Monty Hall uses his insider knowledge about the prize’s location. It’s easiest to understand if you think about it from Monty’s point-of-view. When it’s time for him to open a door, there are two doors he can open. If he chose the door using a random process, he’d do something like flip a coin.
However, Monty is constrained because he doesn’t want to reveal the prize. Monty very carefully opens only a door that does not contain the prize. The end result is that the door he doesn’t show you, and lets you switch to, has a higher probability of containing the prize. That’s how the process is neither random nor has constant probabilities.
Here’s how it works.
The probability that your initial door choice is wrong is 0.66. The following sequence is totally deterministic when you choose the wrong door. Therefore, it happens 66% of the time:
- You pick the incorrect door by random chance. The prize is behind one of the other two doors.
- Monty knows the prize location. He opens the only door available to him that does not have the prize.
- By the process of elimination, the prize must be behind the door that he does not open.
Because this process occurs 66% of the time and because it always ends with the prize behind the door that Monty allows you to switch to, the “Switch To” door must have the prize 66% of the time. That matches the table!
Related post: Luck and Statistics: Do You Feel Lucky, Punk?
If Your Assumptions Aren’t Correct, You Can’t Trust the Results
The solution to Monty Hall problem seems weird because our mental assumptions for solving the problem do not match the actual process. Our mental assumptions were based on independent, random events. However, Monty knows the prize location and uses this knowledge to affect the outcomes in a non-random fashion. Once you understand how Monty uses his knowledge to pick a door, the results make sense.
Ensuring that your assumptions are correct is a common task in statistical analyses. If you don’t meet the required assumptions, you can’t trust the results. This includes things like checking the residual plots in regression analysis, assessing the distribution of your data, and even how you collected your data.
As for the Monty Hall problem, don’t fret, even expert mathematicians fell victim to this statistical illusion!