]
.
2008. Java performance evaluation through rigorous replay compilation. Proceedings of the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications. :367–384. Abstract
.
2011. A literate experimentation manifesto. Proceedings of the 10th SIGPLAN symposium on New ideas, new paradigms, and reflections on programming and software. :91–102. Abstract
.
2011. A microbenchmark case study and lessons learned. Proceedings of the compilation of the co-located workshops on DSM'11, TMC'11, AGERE!'11, AOOPES'11, NEAT'11, &\#38; VMIL'11. :297–308. Abstract
.
2009. Misleading performance claims in parallel computations. Proceedings of the 46th Annual Design Automation Conference. :528–533. Abstract
.
2010. The missing links: bugs and bug-fix commits. Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering. :97–106. Abstract
.
2006. On the success of empirical studies in the international conference on software engineering. Proceedings of the 28th international conference on Software engineering. :341–350. Abstract
.
2005. Pitfalls in parallel job scheduling evaluation. Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing. :257–282. Abstract
.
2009. Producing wrong data without doing anything obviously wrong!. ASPLOS '09: Proceeding of the 14th international conference on Architectural support for programming languages and operating systems. :265–276. Abstract
.
2010. Qualitas Corpus: A Curated Collection of Java Code for Empirical Studies. 2010 Asia Pacific Software Engineering Conference (APSEC2010). Abstract
.
2011. Repeatability, reproducibility, and rigor in systems research. Proceedings of the ninth ACM international conference on Embedded software. :33–38. Abstract
.
2009. Replicability in not Reproducibility: Nor is it Good Science. The 4th workshop on Evaluation Methods for Machine Learning. Abstract
.
2013. Rigorous Benchmarking in Reasonable Time. Proceedings of the 2013 International Symposium on Memory Management. :63–74. Abstract
.
1996. The role of experimentation in software engineering: past, current, and future. Proceedings of the 18th international conference on Software engineering. :442–449. Abstract
.
2015. Scientific Benchmarking of Parallel Computing Systems: Twelve Ways to Tell the Masses when Reporting Performance Results. Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. :73:1–73:12. Abstract
.
2013. STABILIZER: Statistically Sound Performance Evaluation. Proceedings of the Eighteenth International Conference on Architectural Support for Programming Languages and Operating Systems. :219–228. Abstract
.
2007. Statistically rigorous java performance evaluation. OOPSLA '07: Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications. :57–76. Abstract
.
2004. Xen and the art of repeated research. Proceedings of the annual conference on USENIX Annual Technical Conference. :47–47. Abstract
.
1994. Academic careers for experimental computer scientists and engineers. Commun. ACM. 37:87–90. Abstract
.
1981. ACM president's letter: performance analysis: experimental computer science as its best. Commun. ACM. 24:725–727.
.
2016. Artifact Evaluation for Publications (Dagstuhl Perspectives Workshop 15452). Dagstuhl Reports. 5:29–35. Abstract
.
1974. Cargo Cult Science. Engineering and Science. 37(7):10-13. Abstract
.
2004. The case for repeated research in operating systems. SIGOPS Oper. Syst. Rev.. 38:5–7. Abstract
.
2011. Empirical software research: an interview with Dag Sjøberg, University of Oslo, Norway. Ubiquity. 2011:2:1–2:14. Abstract
.
2017. Engineering Academic Software (Dagstuhl Perspectives Workshop 16252). Dagstuhl Manifestos. 6:1–20. Abstract
.
1986. How Not to Lie with Statistics: The Correct Way to Summarize Benchmark Results. Commun. ACM. 29:218–221. Abstract
