Document Type
Conference Proceeding
Publication Date
8-2003
Abstract
We present a new statistical learning paradigm for Boltzmann machines based on a new inference principle we have proposed: the latent maximum entropy principle (LME). LME is different both from Jaynes maximum entropy principle and from standard maximum likelihood estimation. We demonstrate the LME principle BY deriving new algorithms for Boltzmann machine parameter estimation, and show how robust and fast new variant of the EM algorithm can be developed. Our experiments show that estimation based on LME generally yields better results than maximum likelihood estimation, particularly when inferring hidden units from small amounts of data.
Repository Citation
Wang, S.,
Schuurmans, D.,
Peng, F.,
& Zhao, Y.
(2003). Boltzmann Machine Learning with the Latent Maximum Entropy Principle. Proceedings of the Nineteenth Conference on Uncertainty in Artificial Intelligence, 567-574.
https://corescholar.libraries.wright.edu/knoesis/1010
Included in
Bioinformatics Commons, Communication Technology and New Media Commons, Databases and Information Systems Commons, OS and Networks Commons, Science and Technology Studies Commons
Comments
Presented at the 19th Conference on Uncertainty in Artificial Intelligence, Acapulco, Mexico, August 7-10, 2003.