Solving higher-dimensional continuous time stochastic control problems by value function regression

Abstract

The paper develops a method to solve higher-dimensional stochastic control problems in continuous time. A finite difference type approximation scheme is used on a coarse grid of low discrepancy points, while the value function at intermediate points is obtained by regression. The stability properties of the method are discussed, and applications are given to test problems of up to 10 dimensions. Accurate solutions to these problems can be obtained on a personal computer.