Repeatability, reproducibility, and rigor in systems research

TitleRepeatability, reproducibility, and rigor in systems research
Publication TypeConference Paper
Year of Publication2011
AuthorsVitek, J, Kalibera T
Conference NameProceedings of the ninth ACM international conference on Embedded software
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-0714-7
Keywordsrepeatability, Reproducibility, scientific method

Computer systems research spans sub-disciplines that include embedded and real-time systems, compilers, networking, and operating systems. Our contention is that a number of structural factors inhibit quality research and decrease the velocity of science. We highlight some of the factors we have encountered in our work and observed in published papers and propose solutions that, if widely adopted, could both increase the productivity of researchers and the quality of their output.