Abstract
The challenge of conducting reproducible computational research is acknowledged across myriad disciplines from biology to computer science. In the latter, research leveraging online social networks (OSNs) must deal with a set of complex issues, such as ensuring data can be collected in an appropriate and reproducible manner. Making research reproducible is difficult, and researchers may need suitable incentives, and tools and systems, to do so. In this paper, we explore the state-of-the-art in OSN research reproducibility, and present an architecture to aid reproducibility. We characterize the reproducible OSN research using three main themes: 1) reporting of methods; 2) availability of code; and 3) sharing of research data. We survey 505 papers and assess the extent to which they achieve these reproducibility objectives. While systems-oriented papers are more likely to explain data-handling aspects of their methodology, social science papers are better at describing their participant-handling procedures. We then examine incentives to make research reproducible, by conducting a citation analysis of these papers. We find that sharing data are associated with increased citation count, while sharing method and code does not appear to be. Finally, we introduce our architecture which supports the conduct of reproducible OSN research, which we evaluate by replicating an existing research study.
Original language | English |
---|---|
Pages (from-to) | 156-167 |
Number of pages | 12 |
Journal | IEEE Transactions on Emerging Topics in Computing |
Volume | 6 |
Issue number | 1 |
Early online date | 20 Jul 2015 |
DOIs | |
Publication status | Published - Mar 2018 |
Keywords
- Data sharing
- Online social networks
- Reproducibility
- Survey
Fingerprint
Dive into the research topics of 'Towards reproducibility in online social network research'. Together they form a unique fingerprint.Profiles
-
Tristan Henderson
- School of Computer Science - Senior Lecturer
- Centre for Research into Equality, Diversity & Inclusion
Person: Academic
Datasets
-
Data for the paper "Towards reproducibility in online social network research"
Henderson, T. N. H. (Creator) & Hutton, L. (Creator), Figshare, 28 Aug 2014
DOI: 10.6084/m9.figshare.1153740
Dataset