A codesign framework for online data analysis and reduction

Kshitij Mehta, Ian Foster, Scott Klasky, Bryce Allen, Matthew Wolf, Jeremy Logan, Eric Suchyta, Jong Choi, Keichi Takahashi, Igor Yakushin, Todd Munson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

In this paper we discuss our design of a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for performing parametric studies on coupled applications. Cheetah facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage vs. compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design choices of Cheetah by using a reaction-diffusion simulation (Gray-Scott) paired with an analysis application to demonstrate initial results of fine-grained process placement on Summit, a pre-exascale supercomputer at Oak Ridge National Laboratory.

Original languageEnglish
Title of host publicationProceedings of WORKS 2019
Subtitle of host publication14th Workshop on Workflows in Support of Large-Scale Science - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages11-20
Number of pages10
ISBN (Electronic)9781728159973
DOIs
Publication statusPublished - 2019 Nov
Externally publishedYes
Event14th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2019 - Denver, United States
Duration: 2019 Nov 17 → …

Publication series

NameProceedings of WORKS 2019: 14th Workshop on Workflows in Support of Large-Scale Science - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference14th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2019
Country/TerritoryUnited States
CityDenver
Period19/11/17 → …

Keywords

  • Cheetah
  • Codar
  • Codesign
  • Exascale
  • In situ
  • Online
  • Reduction
  • Savanna
  • Summit
  • Workflows

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'A codesign framework for online data analysis and reduction'. Together they form a unique fingerprint.

Cite this