Sentiment analysis of feature ranking methods for classification accuracy

[摘要] Text pre-processing and feature selection are important and critical steps in text mining. Text pre-processing of large volumes of datasets is a difficult task as unstructured raw data is converted into structured format. Traditional methods of processing and weighing took much time and were less accurate. To overcome this challenge, feature ranking techniques have been devised. A feature set from text preprocessing is fed as input for feature selection. Feature selection helps improve text classification accuracy. Of the three feature selection categories available, the filter category will be the focus. Five feature ranking methods namely: document frequency, standard deviation information gain, CHI-SQUARE, and weighted-log likelihood -ratio is analyzed.

[发布机构] School of Information Technology and Engineering, VIT University, Vellore; 632014, India^1

[效力级别] 工业技术

[关键词] Classification accuracy;datasets;Document frequency;Feature ranking;Log likelihood ratio;Pre-processing;Text classification;Text preprocessing