http://evaluate.inf.usi.ch/taxonomy/term/69/0 en http://evaluate.inf.usi.ch/node/380 <span class="biblio-authors"><a href="/biblio/author/4">Blackburn, SM</a>, <a href="/biblio/author/10">Diwan A</a>, <a href="/biblio/author/26">Hauswirth M</a>, <a href="/biblio/author/27">Sweeney PF</a>, <a href="/biblio/author/274">Amaral J N</a>, <a href="/biblio/author/275">Brecht T</a>, <a href="/biblio/author/276">Bulej L\&#039;ır</a>, <a href="/biblio/author/277">Click C</a>, <a href="/biblio/author/3">Eeckhout L</a>, <a href="/biblio/author/278">Fischmeister S</a> et al.</span>.&nbsp; 2016.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/380">The Truth, The Whole Truth, and Nothing But the Truth: A Pragmatic Guide to Assessing Empirical Evaluations</a>. </span>ACM Trans. Program. Lang. Syst.. 38:15:1–15:20.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.atitle=The+Truth%2C+The+Whole+Truth%2C+and+Nothing+But+the+Truth%3A+A+Pragmatic+Guide+to+Assessing+Empirical+Evaluations&amp;rft.title=ACM+Trans.+Program.+Lang.+Syst.&amp;rft.issn=0164-0925&amp;rft.date=2016&amp;rft.volume=38&amp;rft.spage=15%3A1%E2%80%9315%3A20&amp;rft.aulast=Blackburn&amp;rft.aufirst=Stephen&amp;rft.pub=ACM&amp;rft.place=New+York%2C+NY%2C+USA&amp;rft_id=info%3Adoi%2F10.1145%2F2983574"></span> http://evaluate.inf.usi.ch/node/380#comments accuracy benchmarks metrics reproducibility statistics Wed, 31 May 2017 11:23:23 +0000 Matthias Hauswirth 380 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/378 <span class="biblio-authors"><a href="/biblio/author/272">Curtsinger, C</a>, <a href="/biblio/author/273">Berger ED</a></span>.&nbsp; 2013.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/378">STABILIZER: Statistically Sound Performance Evaluation</a>. </span>Proceedings of the Eighteenth International Conference on Architectural Support for Programming Languages and Operating Systems. :219–228.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rft.title=STABILIZER%3A+Statistically+Sound+Performance+Evaluation&amp;rft.series=ASPLOS+%26%23039%3B13&amp;rft.isbn=978-1-4503-1870-9&amp;rft.date=2013&amp;rft.spage=219%E2%80%93228&amp;rft.aulast=Curtsinger&amp;rft.aufirst=Charlie&amp;rft.pub=ACM&amp;rft.place=New+York%2C+NY%2C+USA&amp;rft_id=info%3Adoi%2F10.1145%2F2451116.2451141"></span> http://evaluate.inf.usi.ch/node/378#comments accuracy metrics reproducibility statistics Wed, 31 May 2017 11:16:20 +0000 Matthias Hauswirth 378 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/377 <span class="biblio-authors"><a href="/biblio/author/245">Allen, A</a>, <a href="/biblio/author/246">Aragon C</a>, <a href="/biblio/author/247">Becker C</a>, <a href="/biblio/author/248">Carver J</a>, <a href="/biblio/author/249">Chis A</a>, <a href="/biblio/author/250">Combemale B</a>, <a href="/biblio/author/251">Croucher M</a>, <a href="/biblio/author/252">Crowston K</a>, <a href="/biblio/author/253">Garijo D</a>, <a href="/biblio/author/254">Gehani A</a> et al.</span>.&nbsp; 2017.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/377">Engineering Academic Software (Dagstuhl Perspectives Workshop 16252)</a>. </span>Dagstuhl Manifestos. 6:1–20.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.atitle=Engineering+Academic+Software+%28Dagstuhl+Perspectives+Workshop+16252%29&amp;rft.title=Dagstuhl+Manifestos&amp;rft.issn=2193-2433&amp;rft.date=2017&amp;rft.volume=6&amp;rft.spage=1%E2%80%9320&amp;rft.aulast=Allen&amp;rft.aufirst=Alice&amp;rft.pub=Schloss+Dagstuhl%E2%80%93Leibniz-Zentrum+fuer+Informatik&amp;rft.place=Dagstuhl%2C+Germany&amp;rft_id=info%3Adoi%2F10.4230%2FDagMan.6.1.1"></span> http://evaluate.inf.usi.ch/node/377#comments benchmarks reproducibility Wed, 31 May 2017 11:13:45 +0000 Matthias Hauswirth 377 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/376 <span class="biblio-authors"><a href="/biblio/author/239">Delling, D</a>, <a href="/biblio/author/240">Demetrescu C</a>, <a href="/biblio/author/241">Johnson DS</a>, <a href="/biblio/author/101">Vitek J</a></span>.&nbsp; 2016.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/376">Rethinking Experimental Methods in Computing (Dagstuhl Seminar 16111)</a>. </span>Dagstuhl Reports. 6:24–43.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.atitle=Rethinking+Experimental+Methods+in+Computing+%28Dagstuhl+Seminar+16111%29&amp;rft.title=Dagstuhl+Reports&amp;rft.issn=2192-5283&amp;rft.date=2016&amp;rft.volume=6&amp;rft.spage=24%E2%80%9343&amp;rft.aulast=Delling&amp;rft.aufirst=Daniel&amp;rft.pub=Schloss+Dagstuhl%E2%80%93Leibniz-Zentrum+fuer+Informatik&amp;rft.place=Dagstuhl%2C+Germany&amp;rft_id=info%3Adoi%2F10.4230%2FDagRep.6.3.24"></span> http://evaluate.inf.usi.ch/node/376#comments accuracy benchmarks human factors metrics negative results observational studies reproducibility statistics Wed, 31 May 2017 11:10:51 +0000 Matthias Hauswirth 376 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/366 <span class="biblio-authors"><a href="/biblio/author/220">Hoefler, T</a>, <a href="/biblio/author/221">Belli R</a></span>.&nbsp; 2015.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/366">Scientific Benchmarking of Parallel Computing Systems: Twelve Ways to Tell the Masses when Reporting Performance Results</a>. </span>Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. :73:1–73:12.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rft.title=Scientific+Benchmarking+of+Parallel+Computing+Systems%3A+Twelve+Ways+to+Tell+the+Masses+when+Reporting+Performance+Results&amp;rft.series=SC+%26%23039%3B15&amp;rft.isbn=978-1-4503-3723-6&amp;rft.date=2015&amp;rft.spage=73%3A1%E2%80%9373%3A12&amp;rft.aulast=Hoefler&amp;rft.aufirst=Torsten&amp;rft.pub=ACM&amp;rft.place=New+York%2C+NY%2C+USA&amp;rft_id=info%3Adoi%2F10.1145%2F2807591.2807644"></span> http://evaluate.inf.usi.ch/node/366#comments reproducibility Tue, 15 Mar 2016 15:47:34 +0000 Matthias Hauswirth 366 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/365 <span class="biblio-authors"><a href="/biblio/author/212">Childers, BR</a>, <a href="/biblio/author/213">Fursin G</a>, <a href="/biblio/author/214">Krishnamurthi S</a>, <a href="/biblio/author/215">Zeller A</a></span>.&nbsp; 2016.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/365">Artifact Evaluation for Publications (Dagstuhl Perspectives Workshop 15452)</a>. </span>Dagstuhl Reports. 5:29–35.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.atitle=Artifact+Evaluation+for+Publications+%28Dagstuhl+Perspectives+Workshop+15452%29&amp;rft.title=Dagstuhl+Reports&amp;rft.issn=2192-5283&amp;rft.date=2016&amp;rft.volume=5&amp;rft.spage=29%E2%80%9335&amp;rft.aulast=Childers&amp;rft.aufirst=Bruce&amp;rft.pub=Schloss+Dagstuhl%E2%80%93Leibniz-Zentrum+fuer+Informatik&amp;rft.place=Dagstuhl%2C+Germany&amp;rft_id=info%3Adoi%2Fhttp%3A%2F%2Fdx.doi.org%2F10.4230%2FDagRep.5.11.29"></span> http://evaluate.inf.usi.ch/node/365#comments reproducibility Tue, 15 Mar 2016 15:39:31 +0000 Matthias Hauswirth 365 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/364 <span class="biblio-authors"><a href="/biblio/author/102">Kalibera, T</a>, <a href="/biblio/author/211">Jones R</a></span>.&nbsp; 2013.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/364">Rigorous Benchmarking in Reasonable Time</a>. </span>Proceedings of the 2013 International Symposium on Memory Management. :63–74.<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rft.title=Rigorous+Benchmarking+in+Reasonable+Time&amp;rft.series=ISMM+%26%23039%3B13&amp;rft.isbn=978-1-4503-2100-6&amp;rft.date=2013&amp;rft.spage=63%E2%80%9374&amp;rft.aulast=Kalibera&amp;rft.aufirst=Tomas&amp;rft.pub=ACM&amp;rft.place=New+York%2C+NY%2C+USA&amp;rft_id=info%3Adoi%2F10.1145%2F2464157.2464160"></span> http://evaluate.inf.usi.ch/node/364#comments accuracy benchmarks reproducibility statistics Mon, 14 Mar 2016 21:54:50 +0000 Matthias Hauswirth 364 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/363 <span class="biblio-authors"><a href="/biblio/author/207">Atmanspacher, H</a>, <a href="/biblio/author/208">Lambert BL</a>, <a href="/biblio/author/209">Folkers G</a>, <a href="/biblio/author/210">Schubiger PA</a></span>.&nbsp; 2014.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/363">Relevance relations for the concept of reproducibility</a>. </span>J. R. Soc. Interface. 11(94)<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.atitle=Relevance+relations+for+the+concept+of+reproducibility&amp;rft.title=J.+R.+Soc.+Interface&amp;rft.date=2014&amp;rft.volume=11&amp;rft.issue=94&amp;rft.aulast=Atmanspacher&amp;rft.auinit=H&amp;rft_id=info%3Adoi%2F10.1098%2F%E2%80%8Brsif.2013.1030"></span> http://evaluate.inf.usi.ch/node/363#comments reproducibility Mon, 20 Oct 2014 10:27:15 +0000 Matthias Hauswirth 363 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/359 <span class="biblio-authors">[Anonymous]</span>.&nbsp; 2013.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/359">Unreliable research: Trouble at the lab</a>. </span>The Economist. <span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rft.title=Unreliable+research%3A+Trouble+at+the+lab&amp;rft.date=2013"></span> http://evaluate.inf.usi.ch/node/359#comments negative results reproducibility statistics Sat, 19 Oct 2013 20:58:24 +0000 Matthias Hauswirth 359 at http://evaluate.inf.usi.ch http://evaluate.inf.usi.ch/node/310 <span class="biblio-authors"><a href="/biblio/author/195">Norvig, P</a></span>.&nbsp; 2012.&nbsp;&nbsp;<span class="biblio-title"><a href="/biblio/view/310">Warning Signs in Experimental Design and Interpretation</a>. </span>2012<span class="Z3988" title="ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&amp;rft.title=Warning+Signs+in+Experimental+Design+and+Interpretation&amp;rft.date=2012&amp;rft.volume=2012&amp;rft.aulast=Norvig&amp;rft.aufirst=Peter"></span> http://evaluate.inf.usi.ch/node/310#comments reproducibility statistics Thu, 22 Nov 2012 08:31:41 +0000 Matthias Hauswirth 310 at http://evaluate.inf.usi.ch