The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. The book is the first on the subject and will be of great interest to all those who work with stochastic delay equations and whose main interest is either in the use of the algorithms or in the mathematics. An excellent resource for graduate students, researchers, and practitioners, the work may be used as a graduate-level textbook for a special topics course or seminar on numerical methods in stochastic control.
Reviews

From the reviews:

"Overall this is a book entirely devoted to numerics of controlled stochastic systems with delays. In addition to analysis, it contains many numerical and simulation results. The book should be beneficial to both people working in the numerical methods of stochastic controls and people working in various applications who need to use numerical algorithms. It is perhaps the only comprehensive numerical study of controlled diffusions with delays to date...[I]t is conceivable that this book will become a standard reference in the stochastic control literature." -Mathematical Reviews

"This book extends the Markov chain approximation methods from nonlinear stochastic control problems in continuous time to stochastic systems with delays which arise in the realistic modeling of many physical, mechanical, biological or medical systems. ... An Index, a Symbol Index and a 95 titles reference list are also provided. ... used as a graduate level textbook or as a reference for researchers or practitioners dealing with stochastic delay equations, and interested in either the use of algorithms or of the underlying mathematics." (Adriana-Ioana Lefter, Memoirs of the Scientific Sections, 2009)

"The book deals with numerical methods for nonlinear continuous time stochastic control systems with delays. ... The book appears of particular importance for the practical solution to stochastic control problems for systems with delays. ... it does not contain only results, but also ideas and suggestions so that it can be considered as an important source of inspiration for further work in this field." (Giovanni Di Masi, Zentralblatt MATH, Vol. 1219, 2011)

Book Information
ISBN 9780817645342
Author Harold Kushner
Format Hardback
Page Count 282
Imprint Birkhauser Boston Inc
Publisher Birkhauser Boston Inc