Deterministic Anytime Inference for Stochastic Continuous-Time Markov Processes (2014)

by E. Busra Celikkaya and Christian R. Shelton

Abstract: We describe a deterministic anytime method for calculating filtered and smoothed distributions in large variable-based continuous time Markov processes. Prior non-random algorithms do not converge to the true distribution in the limit of infinite computation time. Sampling algorithms give different results each time run, which can lead to instability when used inside expectation-maximization or other algorithms. Our method combines the anytime convergent properties of sampling with the non-random nature of variational approaches. It is built upon a sum of time-ordered products, an expansion of the matrix exponential. We demonstrate that our method performs as well as or better than the current best sampling approaches on benchmark problems.

Download Information

E. Busra Celikkaya and Christian R. Shelton (2014). "Deterministic Anytime Inference for Stochastic Continuous-Time Markov Processes." Proceedings of the Thirty-First International Conference on Machine Learning. [version here corrects typos and error in Figure 2].

Bibtex citation

@inproceedings{CelShe14,
     author = "E. Busra Celikkaya and Christian R. Shelton",
     title = "Deterministic Anytime Inference for Stochastic Continuous-Time {M}arkov Processes",
     booktitle = "Proceedings of the Thirty-First International Conference on Machine Learning",
     booktitleabbr = "ICML",
     year = 2014,
}

---

full list