Feature Selection for Multi-label Classification Using Neighborhood Preservation
Abstract:
Multi-label learning deals with data associated with a set of labels simultaneously.Dimensionality reduction is an important but challenging task in multi-label learning.Feature selection is an efficient technique for dimensionality reduction to search an optimal feature subset preserving the most relevant information.In this paper,we propose an effective feature evaluation criterion for multi-label feature selection,called neighborhood relationship preserving score.This criterion is inspired by similarity preservation,which is widely used in single-label feature selection.It evaluates each feature subset by measuring its capability in preserving neighborhood relationship among samples.Unlike similarity preservation,we address the order of sample similarities which can well express the neighborhood relationship among samples,not just the pairwise sample similarity.With this criterion,we also design one ranking algorithm and one greedy algorithm for feature selection problem.The proposed algorithms are validated in six publicly available data sets from machine learning repository.Experimental results demonstrate their superiorities over the compared state-of-the-art methods.
Author: Zhiling Cai William Zhu
作者单位: Laboratory of Granular Computing and AI, Institute of Fundamental and Frontier Sciences,University of Electronic Science and Technology of China, Chengdu 610054, China
年,卷(期): 2018, 5(1)
在线出版日期: 2018年5月30日
基金项目: This work was supported in part by the National Natural Science Foundation of China