Large Deviations Asymptotics and the Spectral Theory of Multiplicatively Regular Markov Processes
Ioannis Kontoyiannis, Brown University
Sean P Meyn, University of Illinois, Urbana-Champaign
Abstract
In this paper we continue the investigation of the spectral theory and exponential asymptotics of primarily discrete-time Markov processes, following Kontoyiannis and Meyn (2003). We introduce a new family of nonlinear Lyapunov drift criteria, which characterize distinct subclasses of geometrically ergodic Markov processes in terms of simple inequalities for the nonlinear generator. We concentrate primarily on the class of multiplicatively regular Markov processes, which are characterized via simple conditions similar to (but weaker than) those of Donsker-Varadhan. For any such process {Phi(t)} with transition kernel P on a general state space X, the following are obtained.
Spectral Theory:
For a large class of (possibly unbounded) functionals F on X, the kernel P-hat(x,dy) = e^{F(x)} P(x,dy) has a discrete spectrum in an appropriately defined Banach space. It follows that there exists a "maximal," well-behaved solution to the "multiplicative Poisson equation," defined as an eigenvalue problem for P-hat.
Multiplicative Mean Ergodic Theorem:
Consider the partial sums of this process with respect to any one of the functionals F considered above. The normalized mean of their moment generating function (and not the logarithm of the mean) converges to the above maximal eigenfunction
exponentially fast.
Multiplicative regularity:
The Lyapunov drift criterion under which our results are derived is equivalent
to the existence of regeneration times with finite exponential moments for the above partial sums.
Large Deviations:
The sequence of empirical measures of the process satisfies a large deviations principle in a topology finer that the usual tau-topology, generated by the above class of functionals. The rate function of this LDP is the convex dual of logarithm of the above
maximal eigenvalue, and it is shown to coincide with the Donsker-Varadhan rate function
in terms of relative entropy.
Exact Large Deviations Asymptotics:
The above partial sums are shown to satisfy an exact large deviations
expansion, analogous to that obtained by Bahadur and Ranga Rao for independent random variables.
Full text: PDF | PostScript
Copyright for articles published in this journal is retained by the authors, with first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
The authors of papers published in EJP/ECP retain the copyright. We ask for the permission to use the material in any form. We also require that the initial publication in EJP or ECP is acknowledged in any future publication of the same article.
Before a paper is published in the Electronic Journal of Probability or Electronic Communications in Probability we must receive a hard-copy of the copyright form. Please mail it to
Philippe Carmona
Laboratoire Jean Leray UMR 6629
Universite de Nantes,
2, Rue de la Houssinière BP 92208
F-44322 Nantes Cédex 03
France
You can also send it by FAX: (33|0) 2 51 12 59 12 to the attention of Philippe Carmona. You can even send a scanned jpeg or pdf of this copyright form to the managing editor ejpecpme@math.univ-nantes.fr. as an attached file.
If a paper has several authors, the corresponding author signs the copyright form on behalf of all the authors.