Journal Article

·2020 OPEN ACCESS

Summarising big data: public GitHub dataset for software engineering challenges

Abdulkadir Şeker , Banu Diri YTU , Halil Arslan , Mehmet Fatih Amasyalı YTU

Cumhuriyet Science Journal

Abstract

In open-source software development environments; textual, numerical, and relationship-based data generated are of interest to researchers. Various data sets are available for this data, which is frequently used in areas such as software engineering and natural language processing. However, since these data sets contain all the data in the environment, the problem arises in the terabytes of data processing. For this reason, almost all of the studies using GitHub data use filtered data according to certain criteria. In this context, using a different data set in each study makes a comparison of the accuracy of the studies quite difficult. In order to solve this problem, a common dataset was created and shared with the researchers, which would allow to work on many software engineering problems.

Keywords

Terabyte Software Big data Set (abstract data type) Data set Software development Work (physics) Computer science Software engineering Data science Data mining

Subject Areas

Software Engineering Research ·Information Systems ·Physical Sciences
Scientific Computing and Data Management ·Information Systems and Management ·Social Sciences
Data Analysis with R ·Artificial Intelligence ·Physical Sciences

Citations by Year