Pitfalls in parallel job scheduling evaluation

TitlePitfalls in parallel job scheduling evaluation
Publication TypeConference Paper
Year of Publication2005
AuthorsFrachtenberg, E, Feitelson DG
Conference NameProceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Conference LocationBerlin, Heidelberg
ISBN Number3-540-31024-X, 978-3-540-31024-2
Keywordsdynamic workload, experimental methodology, parallel job scheduling, performance evaluation, simulation, static workload

There are many choices to make when evaluating the performance of a complex system. In the context of parallel job scheduling, one must decide what workload to use and what measurements to take. These decisions sometimes have subtle implications that are easy to overlook. In this paper we document numerous pitfalls one may fall into, with the hope of providing at least some help in avoiding them. Along the way, we also identify topics that could benefit from additional research.

Refereed DesignationRefereed