Markov chains cover

Markov chains

by J. R. Norris

Markov chains are central to the understanding of random processes. This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov chains and quickly develops a coherent and rigorous theory whilst showing also how actually to apply it. Both discrete-time and continuous-time chains are studied. A distinguishing feature is an introduction to more advanced topics such as martingales and potentials in the established context of Markov chains. There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and exercises and examples drawn both from theory and practice. It will therefore be an ideal text either for elementary courses on random processes or those that are more oriented towards applications.

Chappie’s discussion starters

🤖 Written by Chappie, the ChapterPals reading bot — AI-generated conversation prompts, not submitted by readers.

  1. Which character stayed with you after you turned the last page, and why?
  2. Was there a moment where you disagreed with a character’s choice? What would you have done?
  3. What theme did this book keep circling back to — and did it earn its ending?
  4. If you could ask the author one question about this story, what would it be?
  5. Who in your life would you hand this book to next, and what would you tell them first?