Markov chains : Gibbs fields, Monte Carlo simulation and queues / Pierre Brémaud.
Brémaud, Pierre.
2020
QA274.7
Available Online

Linked e-resources

Linked Resource Online Access
Concurrent users Unlimited
Authorized users Authorized users
Document Delivery Supplied Can lend chapters, not whole ebooks

Details

Title Markov chains : Gibbs fields, Monte Carlo simulation and queues / Pierre Brémaud.
Author Brémaud, Pierre.
Edition 2nd ed.
ISBN 9783030459826 (electronic book)
3030459829 (electronic book)
9783030459819
Imprint Cham : Springer, 2020.
Language English
Description 1 online resource (564 pages).
Other Standard Identifiers 10.1007/978-3-030-45
Call Number QA274.7
Dewey Decimal Classification 519.2/33
519.2
Summary This 2nd edition is a thoroughly revised and augmented version of the book with the same title published in 1999. The author begins with the elementary theory of Markov chains and very progressively brings the reader to more advanced topics. He gives a useful review of probability, making the book self-contained, and provides an appendix with detailed proofs of all the prerequisites from calculus, algebra, and number theory. A number of carefully chosen problems of varying difficulty are proposed at the close of each chapter, and the mathematics is slowly and carefully developed, in order to make self-study easier. The book treats the classical topics of Markov chain theory, both in discrete time and continuous time, as well as connected topics such as finite Gibbs fields, nonhomogeneous Markov chains, discrete-time regenerative processes, Monte Carlo simulation, simulated annealing, and queuing theory. The main additions of the 2nd edition are the exact sampling algorithm of Propp and Wilson, the electrical network analogy of symmetric random walks on graphs, mixing times and additional details on the branching process. The structure of the book has been modified in order to smoothly incorporate this new material. Among the features that should improve reader-friendliness, the three main ones are: a shared numbering system for the definitions, theorems and examples; the attribution of titles to the examples and exercises; and the blue highlighting of important terms. The result is an up-to-date textbook on stochastic processes. Students and researchers in operations research and electrical engineering, as well as in physics and biology, will find it very accessible and relevant.
Access Note Access limited to authorized users.
Source of Description Description based on print version record.
Series Texts in applied mathematics ; 31.
Available in Other Form Markov Chains : Gibbs Fields, Monte Carlo Simulation and Queues
Linked Resources Online Access
Record Appears in Online Resources > Ebooks
All Resources
Preface
1 Probability Review
2 Discrete-Time Markov Chains
3 Recurrence and Ergodicity
4 Long-Run Behavior
5 Discrete-Time Renewal Theory
6 Absorption and Passage Times
7 Lyapunov Functions and Martingales
8 Random Walks on Graphs
9 Convergence Rates
10 Markov Fields on Graphs
11 Monte Carlo Markov Chains
12 Non-homogeneous Markov Chains
13 Continuous-Time Markov Chains
14 Markovian Queueing Theory
Appendices
Bibliography
Index.

Browse Subjects

Show more subjects...

Statistics

from
to
Export