(^1) r(s,a)is bounded and continuous. (^2) f(s,a)is continuous. (^3) Φis continuous and compact valued.