Publications
Active inference for binary symmetric hidden Markov models
Abstract
We consider active maximum a posteriori (MAP) inference problem for hidden Markov models (HMM), where, given an initial MAP estimate of the hidden sequence, we select to label certain states in the sequence to improve the estimation accuracy of the remaining states. We focus on the binary symmetric HMM, and employ its known mapping to 1d Ising model in random fields. From the statistical physics viewpoint, the active MAP inference problem reduces to analyzing the ground state of the 1d Ising model under modified external fields. We develop an analytical approach and obtain a closed form solution that relates the expected error reduction to model parameters under the specified active inference scheme. We then use this solution to determine most optimal active inference scheme in terms of error reduction, and examine the relation of those schemes to heuristic principles of uncertainty reduction …
- Date
- January 1, 1970
- Authors
- Armen E Allahverdyan, Aram Galstyan
- Journal
- Journal of Statistical Physics
- Volume
- 161
- Pages
- 452-466
- Publisher
- Springer US