20.3 Solution of ordinary equations 565
Table 20.3 The square root of 5
nx
nf(x
n) 2 f′(x
n) x
n+ 10 3 0.66666 6666 2.33333 3333
1 2.33333 3333 0.09523 8095 2.23809 5238
2 2.23809 5238 0.00202 6343 2.23606 8896
3 2.23606 8896 0.00000 0918 2.23606 7978
4 2.23606 7978 0
The accuracy of the calculator is exhausted after 4 iterations, and the result is in error
by only 1 in the 10th significant figure.
0 Exercises 12–15
Newton–Raphson is derived formally from the Taylor series expansion of a
continuous function about a point. Let xbe the true value of a zero off(x), andx
nan
approximate value such thatx 1 = 1 x
n1 + 1 ε
n. Then
(20.12)
The terms inε
n2and higher can be neglected whenε
nis small enough. Then, since
f(x) 1 = 10 ,
(20.13)
and a new estimate isx
n+ 11 = 1 x
n1 + 1 ε
n, as in (20.11).
It can also be shown from the Taylor series that, when the errorsε
nofx
nandε
n+ 1ofx
n+ 1are small enough,
(20.14)
This explains the rapid convergence of Newton–Raphson. The error decreases
quadratically, and the number of significant figures approximately doublesat each
iteration. The method is called a second-order iteration process, in contrast to the
bisection method which, with , is a first-order process.
The Newton–Raphson method is not a bracketing method and, as shown by
equations (20.13) and (20.14), can fail, for example, when|f′(x
n)|is small (or zero).
Most problems are avoided either by a suitable choice of initial point x
0or by
combining Newton–Raphson with bisection. Thus, a bisection step is taken whenever
Newton–Raphson goes out of bounds or fails to converge.
εε
nn+≈
112εε
nnnnfx
fx
+=−
′′
′
122
()
()
ε
nnnfx
fx
=−
′
()
()
fx fx fx f x f x
nn n n nnn() ( ) () ()=+= +′+′′+εε ()
ε
22