A novel two-level nearest neighbor classification algorithm using an adaptive distance metric

CORC > 厦门大学 > 信息技术－已发表论文

	A novel two-level nearest neighbor classification algorithm using an adaptive distance metric
	Gao, Yunlong ; Pan, Jinyan ; Ji, Guoli ; Yang, Zijiang ; Ji GL(吉国力)
刊名	http://dx.doi.org/10.1016/j.knosys.2011.07.010
	2012-02
关键词	MARGIN
英文摘要	National Natural Science Foundation of China [61174161]; Specialized Research Fund for the Doctoral Program of Higher Education of China [20090121110022]; Xiamen University [2011121047, 201112G018, CXB2011035, 0630-E72000]; Key Research Project of Fujian Province of China [2009H0044]; When there exist an infinite number of samples in the training set, the outcome from nearest neighbor classification (kNN) is independent on its adopted distance metric. However, it is impossible that the number of training samples is infinite. Therefore, selecting distance metric becomes crucial in determining the performance of kNN. We propose a novel two-level nearest neighbor algorithm (TLNN) in order to minimize the mean-absolute error of the misclassification rate of kNN with finite and infinite number of training samples. At the low-level, we use Euclidean distance to determine a local subspace centered at an unlabeled test sample. At the high-level, AdaBoost is used as guidance for local information extraction. Data invariance is maintained by TLNN and the highly stretched or elongated neighborhoods along different directions are produced. The TLNN algorithm can reduce the excessive dependence on the statistical method which learns prior knowledge from the training data. Even the linear combination of a few base classifiers produced by the weak learner in AdaBoost can yield much better kNN classifiers. The experiments on both synthetic and real world data sets provide justifications for our proposed method. (C) 2011 Elsevier B.V. All rights reserved.
语种	英语
内容类型	期刊论文
源URL	[http://dspace.xmu.edu.cn/handle/2288/70701]
专题	信息技术－已发表论文
推荐引用方式 GB/T 7714	Gao, Yunlong,Pan, Jinyan,Ji, Guoli,et al. A novel two-level nearest neighbor classification algorithm using an adaptive distance metric[J]. http://dx.doi.org/10.1016/j.knosys.2011.07.010,2012.
APA	Gao, Yunlong,Pan, Jinyan,Ji, Guoli,Yang, Zijiang,&吉国力.(2012).A novel two-level nearest neighbor classification algorithm using an adaptive distance metric.http://dx.doi.org/10.1016/j.knosys.2011.07.010.
MLA	Gao, Yunlong,et al."A novel two-level nearest neighbor classification algorithm using an adaptive distance metric".http://dx.doi.org/10.1016/j.knosys.2011.07.010 (2012).