9 PARAMETER ESTIMATION
Suppose that a probabilistic model, represented by probability density function
(pdf) f(x), has been chosen for a physical or natural phenomenon for which
parameters 1 , 2 ,... are to be estimated from independently observed data
x 1 ,x 2 ,...,xn. Let us consider for a moment a single parameter for simplicity
and writef(x; ) to mean a specified probability distribution where is the unknown
parameter to be estimated. The parameter estimation problem is then one of
determining an appropriate function of x 1 ,x 2 ,...,xn,sayh(x 1 ,x 2 ,...,xn), which
gives the ‘best’ estimate of. In order to develop systematic estimation procedures,
we need to make more precise the terms that were defined rather loosely in the
preceding chapter and introduce some new concepts needed for this development.
9.1 Samples and Statistics
Given an independent data set x 1 ,x 2 ,...,xn,let
be an estimate of parameter. In order to ascertain its general properties, it is
recognized that, if the experiment that yielded the data set were to be repeated,
we would obtain different values for x 1 ,x 2 ,...,xn. The function h(x 1 ,x 2 ,...,xn)
when applied to the new data set would yield a different value for .Wethussee
that estimate is itself a random variable possessing a probability distribution,
which depends both on the functional form defined by h and on the distribution
of the underlying random variable X. The appropriate representation of is thus
where X 1 ,X 2 ,...,Xn are random variables, representing a sample from random
variable X, which is referred to in this context as the population. In practically
Fundamentals of Probability and Statistics for Engineers T.T. Soong 2004 John Wiley & Sons, Ltd
ISBN s: 0-470-86813-9 (H B) 0-470-86814-7 (PB)
^h
x 1 ;x 2 ;...;xn
9 : 1 ^
^
^
^h
X 1 ;X 2 ;...;Xn;
9 : 2