A layer-adaptable cache hierarchy by a multiple-layer bypass mechanism

Ryusuke Egawa, Ryoma Saito, Masayuki Sato, Hiroaki Kobayashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The cache hierarchy consists of several cache layers to hide the memory access latency in modern microprocessors, and the capacity and energy consumption of the cache hierarchy increase significantly as the number of layers and their sizes increase. However, since one cache configuration cannot fit all applications, the recent deep cache hierarchy sometimes degrades the energy efficiency of the computing system. In this paper, we propose a layer-adaptable cache hierarchy, which changes the structure of the cache hierarchy according to the memory access behavior of applications by a multiple-layer bypass mechanism. The proposal judges how each cache layer contributes to performance improvement and bypasses ineffective cache layers. Then the data arrays of the bypassed layers are disabled by controlling power supply. The evaluation results show that the proposed mechanism improves the energy efficiency of the computing system by up to 37% and 25% on average while keeping performance.

Original languageEnglish
Title of host publicationProceedings of the 10th International Symposium on Highly-Efficient Accelerators and Reconfigurable Technologies, HEART 2019
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450372558
DOIs
Publication statusPublished - 2019 Jun 6
Event10th International Symposium on Highly-Efficient Accelerators and Reconfigurable Technologies, HEART 2019 - Nagasaki, Japan
Duration: 2019 Jun 62019 Jun 7

Publication series

NameACM International Conference Proceeding Series

Conference

Conference10th International Symposium on Highly-Efficient Accelerators and Reconfigurable Technologies, HEART 2019
CountryJapan
CityNagasaki
Period19/6/619/6/7

Keywords

  • Bypassing
  • Cache memory
  • Energy consumption

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'A layer-adaptable cache hierarchy by a multiple-layer bypass mechanism'. Together they form a unique fingerprint.

Cite this