On the success of empirical studies in the international conference on software engineering

TitleOn the success of empirical studies in the international conference on software engineering
Publication TypeConference Paper
Year of Publication2006
AuthorsZannier, C, Melnik G, Maurer F
Conference NameProceedings of the 28th international conference on Software engineering
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number1-59593-375-1
Keywordsempirical evaluation
Abstract

Critiques of the quantity and quality of empirical evaluations in software engineering have existed for quite some time. However such critiques are typically not empirically evaluated. This paper fills this gap by empirically analyzing papers published by ICSE, the prime research conference on Software Engineering. We present quantitative and qualitative results of a quasi-random experiment of empirical evaluations over the lifetime of the conference. Our quantitative results show the quantity of empirical evaluation has increased over 29 ICSE proceedings but we still have room to improve the soundness of empirical evaluations in ICSE proceedings. Our qualitative results point to specific areas of improvement in empirical evaluations.

URLhttp://doi.acm.org/10.1145/1134285.1134333
DOIhttp://doi.acm.org/10.1145/1134285.1134333