observational studies
Paper Bricks: An Alternative to Complete-Story Peer Reviewing
Fri, 10/19/2012 - 13:30 — Matthias HauswirthThe missing links: bugs and bug-fix commits
Thu, 10/11/2012 - 12:41 — Matthias HauswirthFair and balanced?: bias in bug-fix datasets
Thu, 10/11/2012 - 12:36 — Matthias HauswirthEvaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation
Thu, 10/11/2012 - 10:14 — Matthias HauswirthThe role of experimentation in software engineering: past, current, and future
Sun, 11/14/2010 - 15:13 — Matthias HauswirthHow to Write and Read a Scientific Evaluation Paper
Mon, 11/08/2010 - 17:01 — Matthias HauswirthExperimental Computer Science: The Need for a Cultural Change
Mon, 11/08/2010 - 11:12 — Matthias HauswirthShould Computer Scientists Experiment More?
Sat, 09/18/2010 - 15:03 — Matthias Hauswirth
OOPSLA'13 Artifacts
Authors of OOPSLA research papers accepted in the first reviewing phase are invited to formally submit supporting materials to the Artifact Evaluation process. The high level goal of the Artifact Evaluation (AE) process is to empower others to build upon the contributions of a paper. The AE process, new this year, is run by a separate committee whose task is to assess how the artifacts support the work described in the papers. This submission is voluntary and will not influence the final decision regarding the papers. Papers that go through the Artifact Evaluation process successfully will receive a seal of approval printed on the papers themselves.
OOPSLA'13 Artifact Call
Submission Deadline: June 1, 2013.
The Canon
Let's build an "Experimental Evaluation in Software and Systems Canon", a list of readings on experimental evaluation and "good science" that have influenced us and that have the potential to influence the researchers coming after us.
Letter to PC Chairs
Are you working on a call for papers for a systems or software venue?
Of Interest
SPEC forms a Research Group to provide a platform for collaborative research projects in the area of performance measurement, load testing, profiling, workload characterization, dependability and efficiency evaluation of computing systems.