Moments of recurrence times for Markov chains

Frank Aurzada (TU Berlin)
Hanna Döring (TU Berlin)
Marcel Ortgiese (TU Berlin)
Michael Scheutzow (TU Berlin)

Abstract


We consider moments of the return times (or first hitting times) in an irreducible discrete time discrete space Markov chain. It is classical that the finiteness of the first moment of a return time of one state implies the finiteness of the first moment of the first return time of any other state. We extend this statement to moments with respect to a function $f$, where $f$ satisfies a certain, best possible condition. This generalizes results of K.L. Chung (1954) who considered the functions $f(n)=n^p$ and wondered "[...] what property of the power $n^p$ lies behind this theorem [...]" (see Chung (1967), p. 70). We exhibit that exactly the functions that do not increase exponentially - neither globally nor locally - fulfill the above statement.

Full Text: Download PDF | View PDF online (requires PDF plugin)

Pages: 296-303

Publication Date: June 8, 2011

DOI: 10.1214/ECP.v16-1632

References

  1. Chung, K. L. Contributions to the theory of Markov chains. II. Trans. Amer. Math. Soc. 76 (1954), 397--419. MR0063603 (16,149e)
  2. Chung, K. L.. Markov chains with stationary transition probabilities. Second edition. Die Grundlehren der mathematischen Wissenschaften, Band 104 Springer-Verlag New York, Inc., New York 1967 xi+301 pp. MR0217872 (36 #961)
  3. Hodges, J. L., Jr.; Rosenblatt, M. Recurrence-time moments in random walks. Pacific J. Math. 3 (1953), 127--136. MR0054190 (14,886g)
  4. Kolmogoroff, A. Anfangsgründe der Theorie der Markoffschen Ketten mit unendlich vielen möglichen Zuständen. Rec. Math. [Mat. Sbornik] N.S. 1 (1936), no. 43, 607--610. Math. Review number not available.
  5. Lamperti, J.. The first-passage moments and the invariant measure of a Markov chain. Ann. Math. Statist. 31 (1960), 515--517. MR0117785 (22 #8559)
  6. Szewczak, Z. S. On moments of recurrence times for positive recurrent renewal sequences. Statist. Probab. Lett. 78 (2008), no. 17, 3086--3090. MR2474400 (2010b:60241)
  7. Yosida, K.; Kakutani, S. Markoff process with an enumerable infinite number of possible states. Jap. J. Math. 16 (1939), 47--55. MR0000375 (1,62g)


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.