Probabilistic programming has emerged as a powerful paradigm that integrates uncertainty directly into computational models. By embedding probabilistic constructs into conventional programming ...

In this paper we study a class of modified policy iteration algorithms for solving Markov decision problems. These correspond to performing policy evaluation by successive approximations. We discuss ...