Experimental Evaluation of Software and Systems in Computer ScienceExperimental Evaluation of Software and Systems in Computer Science

Search

Navigation

  • Letter to PC Chairs
  • Anti-Patterns
  • Technical Reports
  • Evaluate 2012
  • Issues
  • Biblio
  • Venues
  • Resources
    • Presentations

Follow @EvaluateWell

User login

  • Request new password
Home › Resources

Presentations on Experimental Evaluation

Title Slides
Compiler Optimization: Increasing Research Impact http://www.nondot.org/sabre/2012-04-02-CGOKeynote.pdf
How to cheat at benchmarking http://fsbench.filesystems.org/papers/cheating.pdf
12 Ways to Fool the Masses: Fast Forward to 2011 http://crd-legacy.lbl.gov/~dhbailey/dhbtalks/dhb-12ways.pdf
How did this get published? Pitfalls in experimental evaluation of computer systems http://webdocs.cs.ualberta.ca/~amaral/Amaral-LCTES2012.pptx
Should you trust your experimental results?
""

OOPSLA'13 Artifacts

OOPSLA'13 AE Badge

Authors of OOPSLA research papers accepted in the first reviewing phase are invited to formally submit supporting materials to the Artifact Evaluation process. The high level goal of the Artifact Evaluation (AE) process is to empower others to build upon the contributions of a paper. The AE process, new this year, is run by a separate committee whose task is to assess how the artifacts support the work described in the papers. This submission is voluntary and will not influence the final decision regarding the papers. Papers that go through the Artifact Evaluation process successfully will receive a seal of approval printed on the papers themselves.

OOPSLA'13 Artifact Call

Submission Deadline: June 1, 2013.

Evaluate 2012


Please read our Comments on the Computer Science Curricula 2013 Strawman Draft.

The Canon

Let's build an "Experimental Evaluation in Software and Systems Canon", a list of readings on experimental evaluation and "good science" that have influenced us and that have the potential to influence the researchers coming after us.

Go to the Canon.

Letter to PC Chairs

Are you working on a call for papers for a systems or software venue?

Please read our open letter to PC chairs.

Of Interest

SPEC forms a Research Group to provide a platform for collaborative research projects in the area of performance measurement, load testing, profiling, workload characterization, dependability and efficiency evaluation of computing systems.