How to Write and Read a Scientific Evaluation Paper

TitleHow to Write and Read a Scientific Evaluation Paper
Publication TypeConference Paper
Year of Publication2009
AuthorsWieringa, R, Heerkens H, Regnell B
Conference NameProceedings of the 2009 17th IEEE International Requirements Engineering Conference, RE
PublisherIEEE Computer Society
Conference LocationWashington, DC, USA
ISBN Number978-0-7695-3761-0
KeywordsResearch methodology, Research reporting, Scientific evaluation papers

Scientific evaluation papers investigate existing problem situations or validate proposed solutions with scientific means, such as by experiment or case study. There is a growing amount of literature about how to report about empirical research in software engineering, but there is still some confusion about the difference between a scientific evaluation paper and other kinds of research papers. This is related to lack of clarity about the relation between empirical research, engineering, and industrial practice. In this minitutorial we give a brief rundown on how to structure a scientific evaluation papers as a special kind of research paper, using experiment reports and case study reports as examples. We give checklists of items that a reader should be able to find in these papers, and sketch the dilemmas that writers and readers of these papers face when applying these checklists.