TY - BOOK AU - Kirkwood,James R. TI - Markov processes T2 - Advances in applied mathematics SN - 9781482240733 U1 - 519.233 23 PY - 2015/// CY - Boca Raton PB - CRC Press KW - Markov processes N1 - Includes bibliographical and index; 1: Review of Probability; 2: Discrete-Time, Finite-State Markov Chains; 3: Discrete-Time, Infinite-State Markov Chains; 4: Exponential Distribution and Poisson Process; 5: Continuous-Time Markov Chains; 6: Reversible Markov Chains; Bibliography N2 - The book begins with a review of basic probability, then covers the case of finite state, discrete time Markov processes. Building on this, the text deals with the discrete time, infinite state case and provides background for continuous Markov processes with exponential random variables and Poisson processes. It presents continuous Markov processes which include the basic material of Kolmogorov’s equations, infinitesimal generators, and explosions. The book concludes with coverage of both discrete and continuous reversible Markov chains ER -