<?xml version="1.0" encoding="UTF-8"?><xml><records><record><source-app name="Biblio" version="6.x">Drupal-Biblio</source-app><ref-type>47</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Raymond P.L. Buse</style></author><author><style face="normal" font="default" size="100%">Caitlin Sadowski</style></author><author><style face="normal" font="default" size="100%">Westley Weimer</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Benefits and Barriers of User Evaluation in Software Engineering Research</style></title><secondary-title><style face="normal" font="default" size="100%">OOPSLA '11: Proceedings of the ACM international conference on Object oriented programming systems languages and applications</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">Human study</style></keyword><keyword><style  face="normal" font="default" size="100%">User evaluation</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2011</style></year><pub-dates><date><style  face="normal" font="default" size="100%">10/2011</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.cs.virginia.edu/~weimer/p/oopsla052-buse.pdf</style></url></web-urls></urls><publisher><style face="normal" font="default" size="100%">ACM</style></publisher><pub-location><style face="normal" font="default" size="100%">Portland, Oregon, USA</style></pub-location><abstract><style face="normal" font="default" size="100%">In this paper, we identify trends about, benefits from, and barriers to performing user evaluations in software engineering research. From a corpus of over 3,000 papers spanning ten years, we report on various subtypes of user evaluations (e.g., coding tasks vs. questionnaires) and relate user evaluations to paper topics (e.g., debugging vs. technology transfer). We identify the external measures of impact, such as best paper awards and citation counts, that are correlated with the presence of user evaluations. We complement this with a survey of over 100 researchers from over 40 different universities and labs in which we identify a set of perceived barriers to performing user evaluations. </style></abstract></record></records></xml>