16.6. Independence 551
There are, of course, many examples of events where assuming independence is
notjustified, For example, letCbe the event that tomorrow is cloudy andRbe the
event that tomorrow is rainy. Perhaps PrŒCçD1=5and PrŒRçD1=10in Boston.
If these events were independent, then we could conclude that the probability of a
rainy, cloudy day was quite small:
PrŒR\CçDPrŒRçPrŒCçD
1
5
1
10
D
1
50
:
Unfortunately, these events are definitely not independent; in particular, every rainy
day is cloudy. Thus, the probability of a rainy, cloudy day is actually1=10.
Deciding when toassumethat events are independent is a tricky business. In
practice, there are strong motivations to assume independence since many useful
formulas (such as equation (16.8)) only hold if the events are independent. But you
need to be careful: we’ll describe several famous examples where (false) assump-
tions of independence led to trouble. This problem gets even trickier when there
are more than two events in play.
16.6.3 Mutual Independence
We have defined what it means for two events to be independent. What if there are
more than two events? For example, how can we say that the flips ofncoins are
all independent of one another? A set of events is said to bemutually independent
if, the probability of each event in the set is the same no matter which of the other
events has occurred. We could formalize this with conditional probabilities as in
Definition 16.6.1, but we’ll jump directly to the cleaner definition based on products
of probabilities as in Theorem 16.6.2:
Definition 16.6.4.A set of eventsE 1 ;E 2 ;:::;Enis mutually independent iff for
all subsetsSŒ1;nç,
Pr
2
4
\
j 2 S
Ej
3
(^5) D
Y
j 2 S
PrŒEjç:
Definition 16.6.4 says thatE 1 ;E 2 ;:::;Enare mutually independent if and only
if all of the following equations hold for all distincti,j,k, andl:
PrŒEi\EjçDPrŒEiçPrŒEjç
PrŒEi\Ej\EkçDPrŒEiçPrŒEjçPrŒEkç
PrŒEi\Ej\Ek\ElçDPrŒEiçPrŒEjçPrŒEkçPrŒElç
::
:
PrŒE 1 \\EnçDPrŒE 1 çPrŒEnç: