- 4,842,513 books for free!

2nd Edition

Book Info

Pages: 203

Language: English

Series: English

DOI: 10.1007/978-3-642-40523-5

ISBN: 9783540234999,3540234993

TAG:
Mathematics

This book provides a rigorous but elementary introduction to the theory of Markov Processes on a countable state space. It should be accessible to students with a solid undergraduate background in mathematics, including students from engineering, economics, physics, and biology. Topics covered are: Doeblin's theory, general ergodic properties, and continuous time processes. Applications are dispersed throughout the book. In addition, a whole chapter is devoted to reversible processes and the use of their associated Dirichlet forms to estimate the rate of convergence to equilibrium. These results are then applied to the analysis of the Metropolis (a.k.a simulated annealing) algorithm.

The corrected and enlarged 2^{nd} edition contains a new chapter in which the author develops computational methods for Markov chains on a finite state space. Most intriguing is the section with a new technique for computing stationary measures, which is applied to derivations of Wilson's algorithm and Kirchoff's formula for spanning trees in a connected graph.

Front Matter....Pages I-XVII

Random Walks, a Good Place to Begin....Pages 1-23

Doeblin’s Theory for Markov Chains....Pages 25-47

Stationary Probabilities....Pages 49-71

More About the Ergodic Properties of Markov Chains....Pages 73-98

Markov Processes in Continuous Time....Pages 99-136

Reversible Markov Processes....Pages 137-177

A Minimal Introduction to Measure Theory....Pages 179-198

Back Matter....Pages 199-203