InÖnite dynamic programming

Problem

The problem

∞

∑

t= 1

βt^1 r(st,at)!max

st+ 1 =f(st,at),t= 1 , 2 ,...

at 2 Φ(st),t= 1 , 2 ,...

is called stationary dynamic programming.