Skip to main navigation Skip to search Skip to main content

Dynamic programming for optimal control of stochastic mckean-vlasov dynamics

  • Huyen Pham*
  • , Xiaoli Wei
  • *Corresponding author for this work
  • CREST-ENSAE
  • CNRS

Research output: Contribution to journalArticlepeer-review

Abstract

We study optimal control of the general stochastic McKean-Vlasov equation. Such a problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field interaction under common noise. Our first main result is to state a dynamic programming principle for the value function in the Wasserstein space of probability measures, which is proved from a flow property of the conditional law of the controlled state process. Next, by relying on the notion of differentiability with respect to probability measures due to [P. L. Lions, Cours au College de France: Thfieorie des jeuxa champ moyens, (2012), pp. 2006-2012] and Ito's formula along a flow of conditional measures, we derive the dynamic programming Hamilton-Jacobi-Bellman equation and prove the viscosity property together with a uniqueness result for the value function. Finally, we solve explicitly the linear-quadratic stochastic McKean-Vlasov control problem and give an application to an interbank systemic risk model with common noise.

Original languageEnglish
Pages (from-to)1069-1101
Number of pages33
JournalSIAM Journal on Control and Optimization
Volume55
Issue number2
DOIs
StatePublished - 2017
Externally publishedYes

Keywords

  • Bellman equation
  • Dynamic programming principle
  • Stochastic McKean-Vlasov SDEs
  • Viscosity solutions
  • Wasserstein space

Fingerprint

Dive into the research topics of 'Dynamic programming for optimal control of stochastic mckean-vlasov dynamics'. Together they form a unique fingerprint.

Cite this