Der diskontierte Einarmige Bandit

Summary A sequential stochastic process is observed in discrete time intervals; the process is generated by Bernoulli trials with unknown meanp. Given an a-priori distribution forp, regarded as a random variable, and discounting future payoffs with a factor , O<<1, optimal and suboptimal stopping rules (depending on ) are constructed. this leads to the connection of the process under consideration with another process of the same structure, but with known meanP_o for the Bernoulli trials, thus finally resulting in an One-Armed-Bandit problem.