• Skip to secondary menu
  • Skip to main content
  • Skip to primary sidebar
  • Home
  • About Me
  • Contact Me

Statistics By Jim

Making statistics intuitive

  • Basics
  • Hypothesis Testing
  • Regression
  • ANOVA
  • Probability
  • Time Series
  • Fun
  • Glossary
  • My Store

conceptual

How to Interpret the Constant (Y Intercept) in Regression Analysis

By Jim Frost 72 Comments


The constant term in regression analysis is the value at which the regression line crosses the y-axis. The constant is also known as the y-intercept. That sounds simple enough, right? Mathematically, the regression constant really is that simple. However, the difficulties begin when you try to interpret the meaning of the y-intercept in your regression output. [Read more…] about How to Interpret the Constant (Y Intercept) in Regression Analysis

Filed Under: Regression Tagged With: conceptual, graphs, interpreting results

How F-tests work in Analysis of Variance (ANOVA)

By Jim Frost 46 Comments

Analysis of variance (ANOVA) uses F-tests to statistically assess the equality of means when you have three or more groups. In this post, I’ll answer several common questions about the F-test.

  • How do F-tests work?
  • Why do we analyze variances to test means?

I’ll use concepts and graphs to answer these questions about F-tests in the context of a one-way ANOVA example. I’ll use the same approach that I use to explain how t-tests work. If you need a primer on the basics, read my hypothesis testing overview.

[Read more…] about How F-tests work in Analysis of Variance (ANOVA)

Filed Under: ANOVA Tagged With: conceptual, graphs, probability

Check Your Residual Plots to Ensure Trustworthy Regression Results!

By Jim Frost 56 Comments

Use residual plots to check the assumptions of an OLS linear regression model. If you violate the assumptions, you risk producing results that you can’t trust. Residual plots display the residual values on the y-axis and fitted values, or another variable, on the x-axis. After you fit a regression model, it is crucial to check the residual plots. If your plots display unwanted patterns, you can’t trust the regression coefficients and other numeric results.

In this post, I explain the conceptual reasons why residual plots help ensure that your regression model is valid. I’ll also show you what to look for and how to fix the problems. [Read more…] about Check Your Residual Plots to Ensure Trustworthy Regression Results!

Filed Under: Regression Tagged With: assumptions, conceptual, graphs

How to Interpret the F-test of Overall Significance in Regression Analysis

By Jim Frost 115 Comments


The F-test of overall significance indicates whether your linear regression model provides a better fit to the data than a model that contains no independent variables. In this post, I look at how the F-test of overall significance fits in with other regression statistics, such as R-squared. R-squared tells you how well your model fits the data, and the F-test is related to it. [Read more…] about How to Interpret the F-test of Overall Significance in Regression Analysis

Filed Under: Regression Tagged With: conceptual, interpreting results

Multicollinearity in Regression Analysis: Problems, Detection, and Solutions

By Jim Frost 158 Comments


Multicollinearity occurs when independent variables in a regression model are correlated. This correlation is a problem because independent variables should be independent. If the degree of correlation between variables is high enough, it can cause problems when you fit the model and interpret the results. [Read more…] about Multicollinearity in Regression Analysis: Problems, Detection, and Solutions

Filed Under: Regression Tagged With: analysis example, conceptual, interpreting results

Benefits of Welch’s ANOVA Compared to the Classic One-Way ANOVA

By Jim Frost 47 Comments

Welch’s ANOVA is an alternative to the traditional analysis of variance (ANOVA) and it offers some serious benefits. One-way analysis of variance determines whether differences between the means of at least three groups are statistically significant. For decades, introductory statistics classes have taught the classic Fishers one-way ANOVA that uses the F-test. It’s a standard statistical analysis, and you might think it’s pretty much set in stone by now. Surprise, there’s a significant change occurring in the world of one-way analysis of variance! [Read more…] about Benefits of Welch’s ANOVA Compared to the Classic One-Way ANOVA

Filed Under: ANOVA Tagged With: analysis example, assumptions, choosing analysis, conceptual, interpreting results

How to Analyze Likert Scale Data

By Jim Frost 107 Comments

How do you analyze Likert scale data? Likert scales are the most broadly used method for scaling responses in survey studies. Survey questions that ask you to indicate your level of agreement, from strongly agree to strongly disagree, use the Likert scale. The data in the worksheet are five-point Likert scale data for two groups. [Read more…] about How to Analyze Likert Scale Data

Filed Under: Hypothesis Testing Tagged With: assumptions, choosing analysis, conceptual

The Difference between Linear and Nonlinear Regression Models

By Jim Frost 40 Comments

The difference between linear and nonlinear regression models isn’t as straightforward as it sounds. You’d think that linear equations produce straight lines and nonlinear equations model curvature. Unfortunately, that’s not correct. Both types of models can fit curves to your data—so that’s not the defining characteristic. In this post, I’ll teach you how to identify linear and nonlinear regression models. [Read more…] about The Difference between Linear and Nonlinear Regression Models

Filed Under: Regression Tagged With: conceptual

Multivariate ANOVA (MANOVA) Benefits and When to Use It

By Jim Frost 121 Comments

Multivariate ANOVA (MANOVA) extends the capabilities of analysis of variance (ANOVA) by assessing multiple dependent variables simultaneously. ANOVA statistically tests the differences between three or more group means. For example, if you have three different teaching methods and you want to evaluate the average scores for these groups, you can use ANOVA. However, ANOVA does have a drawback. It can assess only one dependent variable at a time. This limitation can be an enormous problem in certain circumstances because it can prevent you from detecting effects that actually exist. [Read more…] about Multivariate ANOVA (MANOVA) Benefits and When to Use It

Filed Under: ANOVA Tagged With: analysis example, choosing analysis, conceptual, interpreting results

Repeated Measures Designs: Benefits and an ANOVA Example

By Jim Frost 14 Comments

Repeated measures designs, also known as a within-subjects designs, can seem like oddball experiments. When you think of a typical experiment, you probably picture an experimental design that uses mutually exclusive, independent groups. These experiments have a control group and treatment groups that have clear divisions between them. Each subject is in only one of these groups. [Read more…] about Repeated Measures Designs: Benefits and an ANOVA Example

Filed Under: ANOVA Tagged With: analysis example, conceptual, interpreting results

  • « Go to Previous Page
  • Go to page 1
  • Interim pages omitted …
  • Go to page 3
  • Go to page 4
  • Go to page 5

Primary Sidebar

Meet Jim

I’ll help you intuitively understand statistics by focusing on concepts and using plain English so you can concentrate on understanding your results.

Read More…

Buy My Introduction to Statistics eBook!

New! Buy My Hypothesis Testing eBook!

Buy My Regression eBook!

Subscribe by Email

Enter your email address to receive notifications of new posts by email.

    I won't send you spam. Unsubscribe at any time.

    Follow Me

    • FacebookFacebook
    • RSS FeedRSS Feed
    • TwitterTwitter
    • Popular
    • Latest
    Popular
    • How To Interpret R-squared in Regression Analysis
    • How to Interpret P-values and Coefficients in Regression Analysis
    • Measures of Central Tendency: Mean, Median, and Mode
    • Normal Distribution in Statistics
    • Multicollinearity in Regression Analysis: Problems, Detection, and Solutions
    • How to Interpret the F-test of Overall Significance in Regression Analysis
    • Understanding Interaction Effects in Statistics
    Latest
    • Chebyshev’s Theorem in Statistics
    • Using Permutations to Calculate Probabilities
    • Understanding Historians’ Rankings of U.S. Presidents using Regression Models
    • Spearman’s Correlation Explained
    • Effect Sizes in Statistics
    • Proxy Variables: The Good Twin of Confounding Variables
    • Multiplication Rule for Calculating Probabilities

    Recent Comments

    • Jim Frost on Understanding Historians’ Rankings of U.S. Presidents using Regression Models
    • Tony on Understanding Historians’ Rankings of U.S. Presidents using Regression Models
    • Jim Frost on Time Series Analysis Introduction
    • Jim Frost on Curve Fitting using Linear and Nonlinear Regression
    • Jim Frost on Using Post Hoc Tests with ANOVA

    Copyright © 2021 · Jim Frost · Privacy Policy