Fundamentals of Probability and Statistics for Engineers

(John Hannent) #1

If we let


and


Equation (11.47) can be represented by vector–matrix equation:


Comparing Equation (11.48) with Equation (11.12) in simple linear regression,
we see that the observed regression equations in both cases are identical except
that the C matrix is now an n (m 1) matrix and is an (m 1)-dimensional
vector. Keeping this dimension difference in mind, the results obtained in the
case of simple linear regression based on Equation (11.12) again hold in the
multiple linear regression case. Thus, without further derivation, we have for
the solution of least-square estimates of [see Equation (11.15)]


The existence of matrix inverse (CTC)^1 requires that there are at least (m 1)
distinct sets of values of (x 1 i,x 2 i,...,xmi) represented in the sample. It is noted
that CTC is a (m 1) (m 1) symmetric matrix.


Ex ample 11. 6. Problem: the average monthly electric power consumption (Y)
at a certain manufacturing plant is considered to be linearly dependent on the
average ambient temperature (x 1 ) and the number of working days in a month
(x 2 ). Consider the one-year monthly data given in Table 11.4. Determine the
least-square estimates of the associated linear regression coefficients.


Table 11. 4 Average monthly power consumption y (in thousands of kwh), with
number of working days in the month, x 2 , and average ambient temperature, x 1 ,(in F)
for Example 11.6


x 1 20 26 41 55 60 67 75 79 70 55 45 33
x 2 23 21 24 25 24 26 25 25 24 25 25 23
y 210 206 260 244 271 285 270 265 234 241 258 230


Linear Models and Linear Regression 355



1 x 11 x 21 xm 1
1 x 12 x 22 xm 2
... ... ... ... ...
1 x 1 n x 2 n xmn

2

6

6

6

4

3

7

7

7

5

; yˆ

y 1
y 2
...
yn

2

6

6

6

4

3

7

7

7

5

; eˆ

e 1
e 2
...
en

2

6

6

6

4

3

7

7

7

5

;


(^0)
(^1)
...
(^) m


2

6

6

6

4

3

7

7

7

5

;

yˆCq‡e: … 11 : 48 †

‡ q ‡

^qq

^qˆ…CTC†^1 CTy:… 11 :4 9†



‡ ‡



‡
Free download pdf