Ignored Workloads

In the real world, most systems are subjected to diverse workloads. The selection of workloads must include sufficient diversity to support the intended claims. Alternatively, if the workloads are not sufficiently diverse, the claim must be narrowed appropriately.

Example: You claim that your newly developed high‐frequency trading algorithm outperforms the currently used algorithm. Your evaluation used a workload that ignores one of the largest markets in which your institution participates and on which your system is employed.

Real-World Examples