8.5.∗Minimax and Classification Procedures 509whereβ=1−γ(θ′′) is the probability of the type II error.
Let us now see if we can find a minimax solution to our problem. That is, we
want to find a critical regionCso that
max[R(θ′,C),R(θ′′,C)]is minimized. We shall show that the solution is the regionC={
(x 1 ,...,xn):L(θ′;x 1 ,...,xn)
L(θ′′;x 1 ,...,xn)≤k}
,provided the positive constantkis selected so thatR(θ′,C)=R(θ′′,C). That is, if
kis chosen so that
L(θ′,θ′′)∫CL(θ′)=L(θ′′,θ′)∫CcL(θ′′),then the critical regionCprovides a minimax solution. In the case of random vari-
ables of the continuous type,kcan always be selected so thatR(θ′,C)=R(θ′′,C).
However, with random variables of the discrete type, we may need to consider an
auxiliary random experiment whenL(θ′)/L(θ′′)=kin order to achieve the exact
equalityR(θ′,C)=R(θ′′,C).
To see thatCis the minimax solution, consider every other regionAfor which
R(θ′,C)≥R(θ′,A). A regionAfor whichR(θ′,C)<R(θ′,A) is not a candidate for
a minimax solution, for thenR(θ′,C)=R(θ′′,C)<max[R(θ′,A),R(θ′′,A)]. Since
R(θ′,C)≥R(θ′,A)meansthat
L(θ′,θ′′)∫CL(θ′)≥L(θ′,θ′′)∫AL(θ′),we have
α=∫CL(θ′)≥∫AL(θ′);that is, the significance level of the test associated with the critical regionAis less
than or equal toα.ButC, in accordance with the Neyman–Pearson theorem, is a
best critical region of sizeα.Thus
∫CL(θ′′)≥∫AL(θ′′)and
∫CcL(θ′′)≤∫AcL(θ′′).Accordingly,
L(θ′′,θ′)∫CcL(θ′′)≤L(θ′′,θ′)∫AcL(θ′′),