A note on the strong formulation of stochastic control problems with model uncertainty

Mihai Sirbu (The University of Texas at Austin)

Abstract


We consider a  Markovian stochastic control problem with  model uncertainty. The controller (intelligent player) observes only the state, and, therefore, uses feedback (closed-loop) strategies.  The adverse player (nature) who does not have a direct interest in the payoff, chooses open-loop controls that parametrize Knightian uncertainty. This creates a two-step optimization  problem (like half of a game) over feedback strategies and open-loop controls. The main result is to show that, under some assumptions, this provides the  same value as the  (half of) the zero-sum symmetric game where the adverse player  also plays feedback strategies and actively tries to minimize the payoff. The value function is independent of the filtration accessible to the adverse player. Aside from the modeling issue, the present note is a technical companion to a previous work.

Full Text: Download PDF | View PDF online (requires PDF plugin)

Pages: 1-10

Publication Date: November 26, 2014

DOI: 10.1214/ECP.v19-3436

References

  • Bayraktar, Erhan; Sirbu, Mihai. Stochastic Perron's method and verification without smoothness using viscosity comparison: the linear case. Proc. Amer. Math. Soc. 140 (2012), no. 10, 3645--3654. MR2929032
  • Bayraktar, Erhan; Sirbu, Mihai. Stochastic Perron's method for Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 51 (2013), no. 6, 4274--4294. MR3124891
  • Bayraktar, Erhan; Sirbu, Mihai. Stochastic Perron's method and verification without smoothness using viscosity comparison: obstacle problems and Dynkin games. Proc. Amer. Math. Soc. 142 (2014), no. 4, 1399--1412. MR3162260
  • Elliott, Robert J.; Kalton, Nigel J. Values in differential games. Bull. Amer. Math. Soc. 78 (1972), 427--431. MR0295775
  • Fleming, W. H.; Souganidis, P. E. On the existence of value functions of two-player, zero-sum stochastic differential games. Indiana Univ. Math. J. 38 (1989), no. 2, 293--314. MR0997385
  • Krasovskiĭ, N. N.; Subbotin, A. I. Game-theoretical control problems. Translated from the Russian by Samuel Kotz. Springer Series in Soviet Mathematics. Springer-Verlag, New York, 1988. xii+517 pp. ISBN: 0-387-96389-8 MR0918771
  • Karatzas, Ioannis; Sudderth, William D. The controller-and-stopper game for a linear diffusion. Ann. Probab. 29 (2001), no. 3, 1111--1127. MR1872738
  • Sirbu, Mihai. On martingale problems with continuous-time mixing and values of zero-sum games without the Isaacs condition. SIAM J. Control Optim. 52 (2014), no. 5, 2877--2890. MR3261608
  • Sirbu, Mihai. Stochastic Perron's method and elementary strategies for zero-sum differential games. SIAM J. Control Optim. 52 (2014), no. 3, 1693--1711. MR3206980
  • Tevzadze, Revaz; Toronjadze, Teimuraz; Uzunashvili, Tamaz. Robust utility maximization for a diffusion market model with misspecified coefficients. Finance Stoch. 17 (2013), no. 3, 535--563. MR3066987


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.