Rethinking Experimental Methods in Computing (Dagstuhl Seminar 16111)

TitleRethinking Experimental Methods in Computing (Dagstuhl Seminar 16111)
Publication TypeJournal Article
Year of Publication2016
AuthorsDelling, D, Demetrescu C, Johnson DS, Vitek J
Secondary AuthorsDelling, D, Demetrescu C, Johnson DS, Vitek J
JournalDagstuhl Reports
Volume6
Pagination24–43
Date Published01/2016
ISSN2192-5283
KeywordsAlgorithms, Benchmarks, Data sets, experiments, repeatability, Reproducibility, Software Artifacts, statistics
Abstract

This report documents the talks and discussions at the Dagstuhl seminar 16111 "Rethinking Experimental Methods in Computing". The seminar brought together researchers from several computer science communities, including algorithm engineering, programming languages, information retrieval, high-performance computing, operations research, performance analysis, embedded systems, distributed systems, and software engineering. The main goals of the seminar were building a network of experimentalists and fostering a culture of sound quantitative experiments in computing. During the seminar, groups of participants have worked on distilling useful resources based on the collective experience gained in different communities and on planning actions to promote sound experimental methods and reproducibility efforts.

URLhttp://drops.dagstuhl.de/opus/volltexte/2016/6146
DOI10.4230/DagRep.6.3.24