Probabilistic model checking and Markov decision processes (MDPs) form two interlinked branches of formal analysis for systems operating under uncertainty. These techniques offer a mathematical ...

Journal of the Royal Statistical Society. Series B (Statistical Methodology), Vol. 68, No. 2 (2006), pp. 155-178 (24 pages) For a class of latent Markov models for discrete variables having a ...

A 30-minute talk about Markov modeling generally, with specific reference to the seminal 1986 contribution of Professor Eaves, which described Markov processes for genetic and environmental variance ...

This paper proposes a hidden state Markov model (HMM) that incorporates workers’ unobserved labor market attachment into the analysis of labor market dynamics. Unlike previous literature, which ...

Stochastic epidemic models describe the dynamics of an epidemic as a disease spreads through a population. Typically, only a fraction of cases are observed at a set of discrete times. The absence of ...

With the development of satellite networks, space-air-ground integrated networks, and the Internet of Things, the future giant constellations, high-resolution earth observation, human-crewed ...