학술논문

Bayesian Inference With Adaptive Fuzzy Priors and Likelihoods
Document Type
Periodical
Source
IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) IEEE Trans. Syst., Man, Cybern. B Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on. 41(5):1183-1197 Oct, 2011
Subject
Signal Processing and Analysis
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
General Topics for Engineers
Robotics and Control Systems
Power, Energy and Industry Applications
Fuzzy systems
Bayesian methods
Function approximation
Fuzzy sets
Adaptive systems
Adaptive function approximation
additive fuzzy system
Bayesian inference
conjugate priors
fuzzy learning laws
uniform approximation
Language
ISSN
1083-4419
1941-0492
Abstract
Fuzzy rule-based systems can approximate prior and likelihood probabilities in Bayesian inference and thereby approximate posterior probabilities. This fuzzy approximation technique allows users to apply a much wider and more flexible range of prior and likelihood probability density functions than found in most Bayesian inference schemes. The technique does not restrict the user to the few known closed-form conjugacy relations between the prior and likelihood. It allows the user in many cases to describe the densities with words and just two rules can absorb any bounded closed-form probability density directly into the rulebase. Learning algorithms can tune the expert rules as well as grow them from sample data. The learning laws and fuzzy approximators have a tractable form because of the convex-sum structure of additive fuzzy systems. This convex-sum structure carries over to the fuzzy posterior approximator. We prove a uniform approximation theorem for Bayesian posteriors: An additive fuzzy posterior uniformly approximates the posterior probability density if the prior or likelihood densities are continuous and bounded and if separate additive fuzzy systems approximate the prior and likelihood densities. Simulations demonstrate this fuzzy approximation of priors and posteriors for the three most common conjugate priors (as when a beta prior combines with a binomial likelihood to give a beta posterior). Adaptive fuzzy systems can also approximate non-conjugate priors and likelihoods as well as approximate hyperpriors in hierarchical Bayesian inference. The number of fuzzy rules can grow exponentially in iterative Bayesian inference if the previous posterior approximator becomes the new prior approximator.