Journal Article

·2019 OPEN ACCESS

Effect of Imputation Methods in the Classifier Performance

Pınar Cihan YTU , Oya Kalıpsız YTU , Erhan GÖKÇE

Sakarya University Journal of Science

Abstract

Missing values in a data set present an important problem for almost any traditional and modern statistical method, since most of these methods were developed under the assumption that the data set was complete. However, in the real world no complete datasets are available and the issue of missing data is frequently encountered in veterinary field studies as in other fields. While imputation of missing data is important in veterinary field studies where data mining is newly starting to be implemented, another important issue is how it should be imputed. This is because in many studies observations with any variables having missing values are being removed or they are completed by traditional methods. In recent years, while alternative approaches are widely available to prevent removal of observations with missing values, they are being used rarely. The aim of this study is to examine mean, median, nearest neighbors, mice and missForest methods to impute the simulated missing data which is the randomly removed with varying frequencies (5 to 25% by 5%) from original veterinary dataset. Then highly accurate methods selected to impute original dataset for observation of influence in classifier performance and to determine the optimal imputation method for the original dataset.

Keywords

Missing data Imputation (statistics) Data mining Classifier (UML) Statistics Computer science Data set Mathematics Artificial intelligence

Subject Areas

Genetic and phenotypic traits in livestock ·Genetics ·Life Sciences
Gene expression and cancer classification ·Molecular Biology ·Life Sciences
Genetic Mapping and Diversity in Plants and Animals ·Genetics ·Life Sciences

Citations by Year