ABSTRA CT W e consider the adaptiv econ trol of nitestate Mark o vc hains where the optimal p erformance is c ... en b y P g xy P a A p g j x xay The class of stationary deterministic p olicies U SD is a sub class of S and ev ery g isc haracterized b y a mapping X A so that p g j x g x is concen trated at the p oin t g x