Experimental Evaluation of Software and Systems in Computer Science

Evaluation theorists for years have advised evaluators to “take into account” all relevant values as part of an evaluation. But especially for the relatively new evaluator (even one who is knowledgeable and experienced in research methodology), there is not a lot of guidance about how this is done. Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation provides a step-by-step guide for doing a real evaluation. It focuses on the main kinds of “big picture” questions that evaluators usually need to answer, and how the nature of such questions is linked to evaluation methodology choices. Jane Davidson explains how to combine a mix of qualitative and quantitative data with “relevant values” (such as needs) to draw explicitly evaluative conclusions.

Many students and evaluators find it difficult to visualize what evaluation logic and methodology “look like” in practice. To address this, Davidson presents readers with useful rubrics and flowcharts that may be used during each stage of the evaluation. Many of the concepts presented in the chapters are illustrated with specific examples from a range of disciplines. Exercises and “pop quiz” questions help reinforce the key points covered in each chapter, provide homework assignments for those teaching an evaluation course, and allow learners to develop slices of an evaluation plan as they work their way through the text.

Evaluation Methodology Basics is an ideal text for students of evaluation and students in programs that have evaluation course requirements, such as education, health, sociology, psychology, and many others throughout the social sciences. It will also be essential reading for practitioners who find themselves thrown into evaluation roles without the benefit of specialized evaluation training.