Automatic inversion generates divide-and-conquer parallel programs

Kazutaka Morita, Akimasa Morihata, Kiminori Matsuzaki, Zhenjiang Hu, Masato Takeichi

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Divide-and-conquer algorithms are suitable for modern parallel machines, tending to have large amounts of inherent parallelism and working well with caches and deep memory hierarchies. Among others, list homomorphisms are a class of recursive functions on lists, which match very well with the divide-and-conquer paradigm. However, direct programming with list homomorphisms is a challenge for many programmers. In this paper, we propose and implement a novel system that can automatically derive cost-optimal list homomorphisms from a pair of sequential programs, based on the third homomorphism theorem. Our idea is to reduce extraction of list homomorphisms to derivation of weak right inverses. We show that a weak right inverse always exists and can be automatically generated from a wide class of sequential programs. We demonstrate our system with several nontrivial examples, including the maximum prefix sum problem, the prefix sum computation, the maximum segment sum problem, and the line-of-sight problem. The experimental results show practical efficiency of our automatic parallelization algorithm and good speedups of the generated parallel programs.

Original languageEnglish
Pages (from-to)146-155
Number of pages10
JournalACM SIGPLAN Notices
Volume42
Issue number6
DOIs
Publication statusPublished - 2007 Jun

Keywords

  • Divide-and-conquer parallelism
  • Inversion
  • Program transformation
  • Third homomorphism theorem

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Automatic inversion generates divide-and-conquer parallel programs'. Together they form a unique fingerprint.

  • Cite this

    Morita, K., Morihata, A., Matsuzaki, K., Hu, Z., & Takeichi, M. (2007). Automatic inversion generates divide-and-conquer parallel programs. ACM SIGPLAN Notices, 42(6), 146-155. https://doi.org/10.1145/1273442.1250752