How To Analyze The Regression Analysis Output From Excel

How to Analyze the Regression Analysis Output from Excel

In a simple regression model, we are trying to determine if a variable Y is linearly dependent on variable X. That is, whenever X changes, Y also changes linearly. A linear relationship is a straight line relationship. In the form of an equation, this relationship can be expressed as

Y = О± + ОІX + e

In this equation, Y is the dependent variable, and X is the independent variable. О± is the intercept of the regression line, and ОІ is the slope of the regression line. e is the random disturbance term.

The way to interpret the above equation is as follows:

Y = О± + ОІX (ignoring the disturbance term “e”)

gives the average relationship between the values of Y and X.

For example, let Y be the cost of goods sold and X be the sales. If О± = 2 and ОІ = 0.75, and if the sales are 100, i.e., X = 100, the cost of goods sold would be, on average,

2 + 0.75(100) = 77. However, in any particular year when sales X = 100, the actual cost of goods sold can deviate randomly around 77. This deviation from the average is called the “disturbance” or the “error” and is represented by “e”.

Also, in the equation

Y = 2 + 0.75X + e

i.e.,

Cost of goods sold = 2 + 0.75 (sales) + e

the interpretation is that the cost of goods sold increase by 0.75 times the increase in sales. For example, if the sales increase by 20, the cost of goods sold increase, on average, by 0.75 (20) = 15. In general, we are much more interested in the value of the slope of the regression line, ОІ, than in the value of the intercept, О±.

Now, suppose we are trying to determine if there is a relationship between two variables which have apparently no relationship, say the sales of a firm, and the average height of employees of the firm. We would set up an equation like the following:

Y = О± + ОІX + e

where

Y = sales of firm, X = average height of employees, О± = intercept of the regression line,

ОІ = slope of the regression line, and e = disturbance term

Then, we would collect a sample of data from a number of firms regarding sales and average height of employees. The relationship between the two variables is estimated by a technique called the “ordinary least squares”. If indeed there is no relationship between the two variables, what do you expect the value of β, the slope of the regression line to be? We would expect this value to be zero, or some number close to it.

Though there may not be any real relationship between the two variables, the estimated value of ОІ may not be exactly (and most probably will not be) equal to zero. But, if we were to repeat this exercise of estimating the value of ОІ using many more samples, we would expect the value of ОІ to be zero on average. However, we have only one sample of a certain number of firms (say, 30 firms) and we have to make an inference from this one sample whether X influences Y (i.e. ОІ в‰