University of South Carolina, Arnold School of Public Health, Dept. of Health Services Policy and Management, Jan. 24, 2013

HSPM J716 Regression Demonstrations

  1. In a linear model, the effect of a change in the independent variable is the same at all levels of the independent variable.

  2. The true line and a regression line are compared. The idea is that the regression line that you draw is your attempt to guess what the true line is, based on the data. The distinction is made between errors and residuals.

  3. Least squares regression illustrated. You can move a line around and watch as squares get bigger or smaller. The squares are the squares of the residuals. The least squares method makes the total size of the squares the smallest possible. (Least squares regression with a true line with 0 slope.)

  4. Bias concept illustrated with a target shooting analogy.

  5. Normal distribution of the error illustrated, using discreet values of X.. For hypothesis testing, we assume that the errors are normally distributed. This shows how tight normally distributed errors are and how rare outliers are.

  6. Normal distribution of the error illustrated, using continuous values of X. A prettier version of the above demo.

  7. Efficiency comparison between connect-the-end-points and least squares regression. An inferior method of drawing a regression line is compared with least squares. You see why that method is inferior.

  8. Students' eyeball lines and least squares lines compared. As a group, which are more closely bunched around the true line, the eyeball lines or the least squares lines.

  9. Scatter of points from log(Y)=log(A)+b log(X)+normal error. This is for the week on non-linear regression.

The views and opinions expressed in this page are strictly those of the page author. The contents of this page have not been reviewed or approved by the University of South Carolina.