Markov Models for disease progression are common in medical decision making (see references below). The parameters in a Markov model can be estimated by observing the time it takes patients in any ...

A Markov-modulated Poisson Process (MMPP) is a Poisson process that has its parameter controlled by a Markov process. These arrival processes are typical in communications modeling where time-varying ...

Gaussian and Poisson processes; Markov chains. REQUIRED TEXTS: Robert G. Gallager, "Stochastic Processes: Theory for Applications," Cambridge University Press, 2014. COURSE GOALS: Probability and ...