A generalized Pólya's urn with graph based interactions: convergence at linearity

Jun Chen (Caltech)
Cyrille Lucas (Weizmann Institute of Science and Université Paris Diderot)

Abstract


We consider a special case of the generalized Pólya's urn model. Given a finite connected graph $G$, place a bin at each vertex. Two bins are called a pair if they share an edge of $G$. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls. A question of essential interest for the model is to understand the limiting behavior of the proportion of balls in the bins for different graphs $G$. In this paper, we present two results regarding this question. If $G$ is not balanced-bipartite, we prove that the proportion of balls converges to some deterministic point $v=v(G)$ almost surely. If $G$ is regular bipartite, we prove that the proportion of balls converges to a point in some explicit interval almost surely. The question of convergence remains open in the case when $G$ is non-regular balanced-bipartite.


Full Text: Download PDF | View PDF online (requires PDF plugin)

Pages: 1-13

Publication Date: October 3, 2014

DOI: 10.1214/ECP.v19-3094

References

  • Benaïm, Michel. A dynamical system approach to stochastic approximations. SIAM J. Control Optim. 34 (1996), no. 2, 437--472. MR1377706
  • Benaïm, Michel. Dynamics of stochastic approximation algorithms. Séminaire de Probabilités, XXXIII, 1--68, Lecture Notes in Math., 1709, Springer, Berlin, 1999. MR1767993
  • Bena"im, M., Benjamini, I., Chen, J., Lima, Y., A generalized pólya's urn with graph based interactions, 2013, Random structures and algorithms,
  • Benaïm, Michel; Hirsch, Morris W. Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dynam. Differential Equations 8 (1996), no. 1, 141--176. MR1388167
  • Duflo, Marie. Algorithmes stochastiques. (French) [Stochastic algorithms] Mathématiques & Applications (Berlin) [Mathematics & Applications], 23. Springer-Verlag, Berlin, 1996. xiv+319 pp. ISBN: 3-540-60699-8 MR1612815
  • Durrett, Rick. Probability: theory and examples. Fourth edition. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge, 2010. x+428 pp. ISBN: 978-0-521-76539-8 MR2722836
  • Hirsch, M. W.; Pugh, C. C.; Shub, M. Invariant manifolds. Lecture Notes in Mathematics, Vol. 583. Springer-Verlag, Berlin-New York, 1977. ii+149 pp. MR0501173
  • Lima, Y., Graph-based Pólya's urn: completion of the linear case, 2014, arXiv preprint arXiv:1409.7826
  • Schreiber, Sebastian J. Expansion rates and Lyapunov exponents. Discrete Contin. Dynam. Systems 3 (1997), no. 3, 433--438. MR1444204


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.