Viscosity solutions of the bellman equation for exit time optimal control problems with non-lipschitz dynamics
We study the Bellman equation for undiscounted exit time optimal control problems with fully nonlinear Lagrangians and fully nonlinear dynamics using the dynamic programming approach. We allow problems whose non-Lipschitz dynamics admit more than one solution trajectory for some choices of open loop controls and initial positions. We prove a uniqueness theorem which characterizes the value functions of these problems as the unique viscosity solutions of the corresponding Bellman equations that satisfy appropriate boundary conditions. We deduce that the value function for Sussmann’s Reflected Brachystochrone Problem for an arbitrary singleton target is the unique viscosity solution of the corresponding Bellman equation in the class of functions which are continuous in the plane, null at the target, and bounded below. Our results also apply to degenerate eikonal equations, and to problems whose targets can be unbounded and whose Lagrangians vanish for some points in the state space which are outside the target, including Fuller’s Example. © 2001 EDP Sciences, SMAI.
Publication Source (Journal or Book title)
ESAIM - Control, Optimisation and Calculus of Variations
Malisoff, M. (2001). Viscosity solutions of the bellman equation for exit time optimal control problems with non-lipschitz dynamics. ESAIM - Control, Optimisation and Calculus of Variations, 6, 415-441. https://doi.org/10.1051/cocv:2001116