Latent Structured Perceptrons for Large-Scale Learning with Hidden   Information

doi:10.1109/TKDE.2012.129

CORC > 北京大学 > 信息科学技术学院

	Latent Structured Perceptrons for Large-Scale Learning with Hidden Information
	Sun, Xu ; Matsuzaki, Takuya ; Li, Wenjie
刊名	ieee知识与数据工程汇刊
	2013
关键词	Structured perceptron latent variable hidden information convergence analysis large-scale learning
DOI	10.1109/TKDE.2012.129
英文摘要	Many real-world data mining problems contain hidden information (e.g., unobservable latent dependencies). We propose a perceptron-style method, latent structured perceptron, for fast discriminative learning of structured classification with hidden information. We also give theoretical analysis and demonstrate good convergence properties of the proposed method. Our method extends the perceptron algorithm for the learning task with hidden information, which can be hardly captured by traditional models. It relies on Viterbi decoding over latent variables, combined with simple additive updates. We perform experiments on one synthetic data set and two real-world structured classification tasks. Compared to conventional nonlatent models (e.g., conditional random fields, structured perceptrons), our method is more accurate on real-world tasks. Compared to existing heavy probabilistic models of latent variables (e.g., latent conditional random fields), our method lowers the training cost significantly (almost one order magnitude faster) yet with comparable or even superior classification accuracy. In addition, experiments demonstrate that the proposed method has good scalability on large-scale problems.; Computer Science, Artificial Intelligence; Computer Science, Information Systems; Engineering, Electrical & Electronic; SCI(E); EI; 1; ARTICLE; 9; 2063-2075; 25
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/221000]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Sun, Xu,Matsuzaki, Takuya,Li, Wenjie. Latent Structured Perceptrons for Large-Scale Learning with Hidden Information[J]. ieee知识与数据工程汇刊,2013.
APA	Sun, Xu,Matsuzaki, Takuya,&Li, Wenjie.(2013).Latent Structured Perceptrons for Large-Scale Learning with Hidden Information.ieee知识与数据工程汇刊.
MLA	Sun, Xu,et al."Latent Structured Perceptrons for Large-Scale Learning with Hidden Information".ieee知识与数据工程汇刊 (2013).