|
|
|
| | | | | |
|
|
|
|
|
Relative entropy and waiting times for continuous-time Markov processes
|
Jean-René Chazottes, CPht, CNRS, Ecole Polytechnique, 91128 Palaiseau Cedex, France. Cristian Giardina, Eurandom, Postbus 513, 5600 MB Eindhoven, the Netherlands Frank Redig, Mathematical Institute Leiden university |
Abstract
For discrete-time stochastic processes, there is a close connection
between return (resp. waiting) times and entropy (resp. relative entropy). Such a connection cannot
be straightforwardly extended to the continuous-time
setting. Contrarily to the discrete-time case one needs a
reference measure on path space and so the natural object is relative entropy rather
than entropy. In this paper we elaborate on this in the case of
continuous-time Markov processes with finite state space. A reference
measure of special interest is the one associated to the time-reversed
process. In that case relative entropy is interpreted as the entropy
production rate. The main results of this paper are: almost-sure
convergence to relative entropy of the logarithm of
waiting-times ratios suitably normalized, and their
fluctuation properties (central limit theorem and large deviation principle).
|
Full text: PDF
Pages: 1049-1068
Published on: November 28, 2006
|
Bibliography
- Abadi, Miguel. Exponential approximation for hitting times in mixing processes.
Math. Phys. Electron. J. 7 (2001), Paper 2, 19 pp. (electronic). MR1871384 (2002h:60069)
- Abadi, M.; Chazottes, J.-R.; Redig, F.; Verbitskiy, E.. Exponential distribution for the occurrence of rare patterns in
Comm. Math. Phys. 246 (2004), no. 2, 269--294. MR2048558 (2005b:60129)
- Chazottes, J.-R.; Redig, F. Testing the irreversibility of a Gibbsian process via hitting and
Nonlinearity 18 (2005), no. 6, 2477--2489. MR2176943 (2006m:82066)
- Dembo, Amir; Zeitouni, Ofer. Large deviations techniques and applications.
Applications of Mathematics (New York), 38. Springer-Verlag, New York, 1998. xvi+396 pp. ISBN: 0-387-98406-2 MR1619036 (99d:60030)
- Jiang, Da-Quan; Qian, Min; Qian, Min-Ping. Mathematical theory of nonequilibrium steady states.
Lecture Notes in Mathematics, 1833. Springer-Verlag, Berlin, 2004. x+280 pp. ISBN: 3-540-20611-6 MR2034774 (2006e:82043)
- Kipnis, Claude; Landim, Claudio. Scaling limits of interacting particle systems.
of Mathematical Sciences], 320. Springer-Verlag, Berlin, 1999. xvi+442 pp. ISBN: 3-540-64913-1 MR1707314 (2000i:60001)
- R.S. Lipster and A.N. Shiryayev,
Statistics of random processes, Volume II,
Springer, New York (1977).
- Maes, Christian. The fluctuation theorem as a Gibbs property.
J. Statist. Phys. 95 (1999), no. 1-2, 367--392. MR1705591 (2000g:60158)
- Ornstein, Donald; Weiss, Benjamin. Entropy and recurrence rates for stationary random fields.
IEEE Trans. Inform. Theory 48 (2002), no. 6, 1694--1697. MR1909482 (2003e:94039)
- Plachky, D.; Steinebach, J. A theorem about probabilities of large deviations with an application
Period. Math. Hungar. 6 (1975), no. 4, 343--345. MR0410870 (53 #14613)
- Shields, Paul C. The ergodic theory of discrete sample paths.
Graduate Studies in Mathematics, 13. American Mathematical Society, Providence, RI, 1996. xii+249 pp. ISBN: 0-8218-0477-4 MR1400225 (98g:28029)
- Stroock, D. W. An introduction to the theory of large deviations.
Universitext. Springer-Verlag, New York, 1984. vii+196 pp. ISBN: 0-387-96021-X MR0755154 (86h:60067a)
- Varadhan, S. R. S. Large deviations and applications.
PA, 1984. v+75 pp. ISBN: 0-89871-189-4 MR0758258 (86h:60067b)
- Wyner, Abraham J. More on recurrence and waiting times.
Ann. Appl. Probab. 9 (1999), no. 3, 780--796. MR1722282 (2001b:60054)
|
|
|
|
|
|
|
| | | | |
Electronic Journal of Probability. ISSN: 1083-6489 |
|