Stochastic Analysis of Lexical and Semantic Enhanced Structural Language Model

Document Type

Conference Proceeding

Publication Date

2006

Find in a Library

Catalog Record

Abstract

In this paper, we present a directed Markov random field model that integrates trigram models, structural language models (SLM) and probabilistic latent semantic analysis (PLSA) for the purpose of statistical language modeling. The SLM is essentially a generalization of shift-reduce probabilistic push-down automata thus more complex and powerful than probabilistic context free grammars (PCFGs). The added context-sensitiveness due to trigrams and PLSAs and violation of tree structure in the topology of the underlying random field model make the inference and parameter estimation problems plausibly intractable, however the analysis of the behavior of the lexical and semantic enhanced structural language model leads to a generalized inside-outside algorithm and thus to rigorous exact EM type re-estimation of the composite language model parameters.

Comments

This paper was presented at the 8th International Colloquium, ICGI 2006, Tokyo, Japan, September 20-22, 2006.

DOI

10.1007/11872436_9

Catalog Record

Share

COinS