Abstract: | We prove that the policy function, obtained by optimizing a discounted infinite sum of stationary return functions, is Lipschitz continuous when the instantaneous function is strongly concave. Moreover, by using the notion of α-concavity, we provide an estimate of the Lipschitz constant which turns out to be a decreasing function of the discount factor. |