What is Cohens d?
Cohens d is a standardized effect size for measuring the difference between two group means. Frequently, you’ll use it when you’re comparing a treatment to a control group. It can be a suitable effect size to include with t-test and ANOVA results. The field of psychology frequently uses Cohens d.
Calculate Cohen’s d by taking the difference between two means and dividing by the data’s standard deviation. This measure reports the size of the mean difference by comparing it to the data’s variability.
Typically, you use the pooled standard deviation in the denominator, essentially the average standard deviation across both groups.
How to Interpret Cohen’s d
Cohen’s d characterizes the effect size by relating the mean difference to variability, similar to a signal-to-noise ratio. A large Cohen’s d indicates the mean difference (effect size = signal) is large compared to the variability (noise).
For example, if Group A’s Mean = 12 and Group B’s Mean = 8, and the pooled standard deviation is 2, Cohen’s d equals the following:
The mean difference is twice the variability.
However, if you have the same group means but the pooled standard deviation is 4, Cohen’s d is 1. The effect is equivalent to the variability in the data.
|Cohen’s d||Indicates Mean Difference is|
|0.5||Half the standard deviation.|
|1||Equal to the standard deviation.|
|2||Twice the standard deviation.|
Cohen himself suggested the following interpretations for different values.
|Cohen’s d||Effect Size|
What do these effect sizes look like graphically? The graph below displays a Cohen’s d = 0.8, which these criteria define as being large.
However, he also cautioned that these interpretations might not apply to all study areas.
Instead of using the generic interpretations, I recommend building a familiarity with Cohen’s d values in your subject area. As you acquire experience in your field of study, you’ll learn which effect sizes are considered small, medium, and large.
When Should You Use Cohens d?
Because the Cohen’s d formula contains the natural data units in both the numerator (in the form of the mean difference) and denominator (in the standard deviation), the division process cancels out the units, producing a unitless result.
Let’s explore the advantages and disadvantages of these two effects sizes to see when you should use each one!
Learn more about standardized and unstandardized effect sizes.
Disadvantages of a Unitless Measure
The primary disadvantage of using Cohen’s d is that it’s harder to interpret because it has no units. It’s harder to understand the results. What does it mean if the mean difference is 0.8 the size of the standard deviation? That’s considered large, but can you picture it?
In comparison, the mean difference is often more intuitive. For example, if Group A has a mean weight of 10kg and Group B is 5kg, the mean difference is 5kg (11lbs). You can understand that difference. The natural data units are much easier to interpret.
In general, you should use the mean difference as the simple effect size whenever possible rather than Cohen’s d.1 The units of measurement are generally meaningful, and it makes sense to use them. Evaluating practical significance is easier with the natural units. Is the mean difference large enough to be meaningful in the real world?
As Tukey2 states: “being so disinterested in our variables that we do not care about their units can hardly be desirable.”
Advantages of a Unitless Measure
However, there are situations where using Cohen’s d can be beneficial. Here’s when you should consider including it in your results.
Because Cohen’s d is unitless, it can help portray the effect size when the data units are not intrinsically meaningful or potentially confusing to your readers.
For example, many psychology studies use inventories to assess personality characteristics. Those inventory units are not inherently meaningful because they don’t relate to a tangible phenomenon. For instance, it might not be self-evident whether a 10-point difference on a specific inventory represents a small or large effect. Even if you know the answer because it’s your specialty, your readers might not!
However, Cohen’s d does not use the data units, which can help make the effect’s magnitude apparent when the natural units are not meaningful. Thanks to its unitless nature, you don’t need to be familiar with the original units to understand the results.
Additionally, its unitless nature allows you to compare your study’s findings to other studies that use a different variable with differing units.
For example, suppose two psychology experiments assess the same treatment but use two different personality indices for the outcome. Calculating the Cohen’s d for each experiment allows you to compare the results. This measure takes both studies’ findings with differing units and places them on the same standardized scale, which facilitates comparisons.
In summary, consider using Cohen’s d when the original units are not intuitively meaningful and for comparisons between studies with different variables. Meta-analyses often use it to summarize a set of findings from many studies.
1) Baguley T., Standardized or simple effect size: what should be reported? Br J Psychol. 2009 Aug;100(Pt 3):603-17. doi: 10.1348/000712608X377117. Epub 2008 Nov 17. PMID: 19017432.
2) Tukey, J. W. (1969). Analyzing data: Sanctification or detective work? American Psychologist, 24, 83-91.