HyperLink   Parboil: A Revised Benchmark Suite for Scientific and Commercial Throughput Computing
Paper of IMPACT - Cited Greater than 300 Times
Publication Year:
  John A. Stratton, Christopher I. Rodrigues, I-Jui Sung, Nady Obeid, Li-Wen Chang, Nasser Anssari, Daniel Liu, Wen-mei Hwu
  IMPACT Technical Report, IMPACT-12-01, University of Illinois at Urbana-Champaign, Center for Reliable and High-Performance Computing, March 2, 2012

The Parboil benchmarks are a set of throughput computing applications useful for studying the performance of throughput computing architecture and compilers. The name comes from the culinary term for a partial cooking
process, which represents our belief that useful throughput computing benchmarks must be cooked, or preselected to implement a scalable algorithm with fine-grained parallel tasks. But useful benchmarks for this field cannot be fully cooked, because the architectures and programming models and supporting tools are evolving rapidly enough that static benchmark codes will lose relevance very quickly. 

We have collected benchmarks from throughput computing application researchers in many different scientific and commercial fields including image processing, biomolecular simulation, fluid dynamics, and astronomy. Each benchmark includes several implementations. Some implementations we provide as readable base implementations from which new optimization efforts can begin, and others as examples of the current state-of-the-art targeting specific CPU and GPU architectures. As we continue to optimize these benchmarks for new and existing architectures ourselves, we will also gladly accept new implementations and benchmark contributions from developers to recognize those at the frontier of performance optimization on each architecture. 

Finally, by including versions of varying levels of optimization of the same fundamental algorithm, the benchmarks present opportunities to demonstrate tools and architectures that help programmers get the most out of their parallel hardware. Less optimized versions are presented as challenges to the compiler and architecture research communities: to develop the technology that automatically raises the performance of simpler implementations to the performance level of sophisticated programmer-optimized implementations, or demonstrate any other performance or programmability improvements. We hope that these benchmarks will facilitate effective demonstrations of such technology.

author = {Stratton, John A. and Rodrigrues, Christopher and Sung, I-Jui and Obeid, Nady and Chang, Liwen and Liu, Geng and Hwu, Wen-Mei W.},
title = {Parboil: A Revised Benchmark Suite for Scientific and Commercial Throughput Computing},
institution = {University of Illinois at Urbana-Champaign},
number = {IMPACT-12-01},
address = {Urbana},
year = {2012},
month = mar