Inconsistent Workloads
When an evaluation compares two or more systems, it is essential that the systems under test are subjected to the same workloads.
Example: You claim that your new system consumes only 10% more power than your old system. Your evaluation compared the old system's power consumption as measured during the "Flash Crash" of May 6, 2010, to the new system's consumption during a day when markets were stable.
Real-World Examples
...
