Home | Contents | Submissions, editors, etc. | Login | Search | ECP
 Electronic Journal of Probability > Vol. 8 (2003) > Paper 24 open journal systems 


Degenerate Variance Control in the One-dimensional Stationary Case

Daniel L Ocone, Rutgers University
Ananda Weerasinghe, Iowa State University


Abstract
We study the problem of stationary control by adaptive choice of the diffusion coefficient in the case that control degeneracy is allowed and the drift admits a unique, asymptotically stable equilibrium point. We characterize the optimal value and obtain it as an Abelian limit of optimal discounted values and as a limiting average of finite horizon optimal values, and we also characterize the optimal stationary strategy. In the case of linear drift, the optimal stationary value is expressed in terms of the solution of an optimal stopping problem. We generalize the above results to allow unbounded cost functions.


Full text: PDF

Pages: 27

Published on: January 8, 2004
Bibliography
  1. Assaf, D. (1997), Estimating the state of a noisy continuous time Markov chain when dynamic sampling is feasible, Ann. Appl. Probab.3, 822-836. MR 98b:62174
  2. Arisawa, M. and Lions, P-L. (1998), On ergodic stochastic control, Comm. Partial Differential Equations 23,2187-2217. MR 2000a:49052
  3. Basak, G.K. and Borkar, V.S. and Ghosh, M.K. (1997), Ergodic control of degenerate diffusions, Stochastic Anal. Appl. 15,1-17. MR 97j:93061
  4. Benes, V.E. and Karatzas, I. (1981), Optimal stationary linear control of the Wiener process, J. of Optimization Theory and Applications 35,611-633. MR 83m:93073
  5. Bensoussan, A. and Frehse, J. (1992), On Bellman equations of ergodic control in Rn J. Reine Angew. Math. 429,125-160. MR 93h:49046
  6. Bensoussan, A. and Lions, J.L. (1982) Applications of Variational Inequalities in Stochastic Control, North Holland, Amsterdam and New York.
  7. Borkar, V.S. (1995), On ergodic control of degenerate diffusions, J. Optim. Theory and Appl. 86,251-265. MR 96c:93155
  8. Borkar, V.S. and Ghosh, M.K. (1998) Ergodic control of multi-dimensional diffusions I. The existence results, SIAM J.Control Optimization 26,112-126. MR 89h:93045
  9. Cox, R.M. (1984) Stationary and Discounted Stochastic Control, Ph.D. thesis, Statistics Dept., Columbia University.
  10. Cox, R.M. and Karatzas, I. (1985) Stationary control of Brownian motion in several dimensions, Adv. Appl. Prob. 17,531-561. MR 86i:93054
  11. Krylov, N.V. (1973), Control of a solution of a stochastic integral equation with degeneration, Theory of Probability and Its Applications 17,114-131. MR 45#8370
  12. Kurtz, T.G. and Stockbridge, R.H. (1998), Existence of Markov controls and characterization of optimal controls, SIAM J.Control Optimization 36,609-653. MR 99b:93051
  13. Kushner, H.J. (1978), Optimality conditions for the average cost per unit time problem with a diffusion model, SIAM J.Control Optimization 16,330-346. MR 58#9718
  14. Kushner, H.J. (1999), Existence of optimal controls for variance control, in Stochastic Analysis, Control, Optimization, and Applications: a volume in honor of W.H.~Fleming, edited by McEneany, W.H. and Yin, G.G. and Zhang, Q., Birkh"auser, Boston, 421-437. MR 2001d:4903
  15. Lions, P-L.(1981) Control of diffusions in $R^n$,, Comm. Pure Appl. Math. 34,121-147. MR 82i:60127
  16. Mandl, P. (1968), Analytical Treatment of One-Dimensional Markov Processes}, Springer-Verlag, New York. MR 40#930
  17. Ocone, D. and Weerasinghe, A. (2000), Degenerate variance control of a one-dimensional diffusion, SIAM J.Control Optimization 39,1-24. MR 2001j:93111
  18. Tarres, R. (1988), Asymptotic evolution of a stochastic control problem, SIAM J.Control Optimization 23,614-631. MR 86m:49043
















Research
Support Tool
Capture Cite
View Metadata
Printer Friendly
Context
Author Address
Action
Email Author
Email Others


Home | Contents | Submissions, editors, etc. | Login | Search | ECP

Electronic Journal of Probability. ISSN: 1083-6489