학술논문

Combining Monte Carlo and Mean-Field-Like Methods for Inference in Hidden Markov Random Fields
Document Type
Periodical
Author
Source
IEEE Transactions on Image Processing IEEE Trans. on Image Process. Image Processing, IEEE Transactions on. 16(3):824-837 Mar, 2007
Subject
Signal Processing and Analysis
Communication, Networking and Broadcast Technologies
Computing and Processing
Monte Carlo methods
Hidden Markov models
Convergence
Inference algorithms
Computational modeling
Constraint optimization
Approximation algorithms
Image segmentation
Cost function
Computational efficiency
Hidden Markov random fields (HMRFs)
image segmentation
Markov chain Monte Carlo-based approximations
variational expectation maximization (VEM)
Language
ISSN
1057-7149
1941-0042
Abstract
Issues involving missing data are typical settings where exact inference is not tractable as soon as nontrivial interactions occur between the missing variables. Approximations are required, and most of them are based either on simulation methods or on deterministic variational methods. While variational methods provide fast and reasonable approximate estimates in many scenarios, simulation methods offer more consideration of important theoretical issues such as accuracy of the approximation and convergence of the algorithms but at a much higher computational cost. In this work, we propose a new class of algorithms that combine the main features and advantages of both simulation and deterministic methods and consider applications to inference in hidden Markov random fields (HMRFs). These algorithms can be viewed as stochastic perturbations of variational expectation maximization (VEM) algorithms, which are not tractable for HMRF. We focus more specifically on one of these perturbations and we prove their (almost sure) convergence to the same limit set as the limit set of VEM. In addition, experiments on synthetic and real-world images show that the algorithm performance is very close and sometimes better than that of other existing simulation-based and variational EM-like algorithms.