Boosted Bayesian Network Classifiers

View/ Open
Date
2005Author
Jing, Yushi
Pavlovic, Vladimir
Rehg, James M.
Metadata
Show full item recordAbstract
The use of Bayesian networks for classification problems has received significant recent attention. Although computationally efficient, the standard maximum likelihood learning method tends to be suboptimal due to the mismatch between its optimization criteria (data likelihood) and the actual goal of classification (label prediction accuracy). Recent approaches to optimizing classification performance during parameter or structure learning show promise, but lack the favorable computational properties of maximum likelihood learning. In this paper we present Boosted Bayesian Network Classifiers, a framework to combine discriminative data-weighting with generative training of intermediate models. We show that Boosted Bayesian network Classifiers encompass the basic generative models in isolation, but improve their classification performance when the model structure is suboptimal. This framework can be easily extended to temporal Bayesian network models including HMM and DBN. On a large suite of benchmark data-sets, this approach outperforms generative graphical models such as naive Bayes, TAN, unrestricted Bayesian network and DBN in classification accuracy. Boosted Bayesian network classifiers have comparable or better performance in comparison to other discriminatively trained graphical models including ELR-NB, ELR-TAN, BNC-2P, BNC-MDL and CRF. Furthermore, boosted Bayesian networks require significantly less training time than all of the competing methods.
Collections
Related items
Showing items related by title, author, creator and subject.
-
High bandwidth wide LC-Resr compliant sigma-delta boost DC-DC switching converters
Keskar, Neeraj (Georgia Institute of Technology, 2008-03-26)In low power, battery-operated, portable applications, like cell phones, PDAs, digital cameras, etc., miniaturization at a low cost is a prominent driving factor behind product development and marketing efforts. As such, ... -
AI-infused security: Robust defense by bridging theory and practice
Chen, Shang-Tse (Georgia Institute of Technology, 2019-09-20)While Artificial Intelligence (AI) has tremendous potential as a defense against real-world cybersecurity threats, understanding the capabilities and robustness of AI remains a fundamental challenge. This dissertation ... -
Understanding perceived quality through visual representations
Temel, Dogancan (Georgia Institute of Technology, 2016-10-25)The formatting of images can be considered as an optimization problem, whose cost function is a quality assessment algorithm. There is a trade-off between bit budget per pixel and quality. To maximize the quality and ...