Journal Article

·2007

A New Feature Extraction Method for Text Classification

H. Kemal Yildiz YTU , Murat Genctav YTU , Nurullah Usta YTU , Banu Di̇ri̇ YTU , Mehmet Fatih Amasyalı YTU

Abstract

In this study, we have established a feature extraction process for the classification of unknown genres of Turkish texts by using Turkish morphology. The proposed method considers the features as the word stems. The fact that the number of the features exceeds the practical computing limits each document represented by a number of features as in the document classes. Each word stem in a document analyzed in different classes and the sum of the usage frequency in the document classes given the feature value of that document. To speed up the process of extracting usage frequencies of word stems and analyzing it in different document classes Trie tree structure has been used. In this study, we have selected five different classes which are economy, healthy, magazine, sports and politics. The performance of the established method has been compared the bag of words approach by using naive Bayes, support vector machine, K-nearest neighbor, C 4.5 and random forest. The best performance achieved is 96.25% which has been observed using the naive Bayes with our new feature vectors.

Keywords

Naive Bayes classifier Computer science Word (group theory) Artificial intelligence Feature extraction Document classification tf–idf Feature (linguistics) k-nearest neighbors algorithm Pattern recognition (psychology) Trie Feature vector Random forest Turkish Support vector machine Word lists by frequency Tree (set theory) Natural language processing Mathematics Data structure Term (time)

Subject Areas

Natural Language Processing Techniques ·Artificial Intelligence ·Physical Sciences
Text and Document Classification Technologies ·Artificial Intelligence ·Physical Sciences
Advanced Text Analysis Techniques ·Artificial Intelligence ·Physical Sciences

Citations by Year