Context-aware task allocation for fast parallel big data processing in optical-wireless networks

Katsuya Suto, Hiroki Nishiyama, Nei Kato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

MapReduce architecture has been considered as one of the most promising candidates for efficient and reliable big data mining. While current MapReduce is basically designed for data center and enterprise networks, in which a number of servers are interconnected with optical fiber cables, prospective MapReduce would be applied in optical-wireless environment such as optical-wireless data center network, fiber-wireless (FiWi) access network, and so forth. To modify MapReduce for opticalwireless hybrid network, we need to answer the fundamental research problem, 'How does MapReduce architecture use optical and wireless resources for task allocation?' To answer this question, this paper reveals some challenging issues and proposes a context-aware task allocation scheme that is designed by considering characteristics of both optical and wireless communications. Our proposed task allocation scheme can minimize the completion time of big data processing. Numerical results are presented to demonstrate the effectiveness of our proposed method compared with existing task allocation schemes.

Original languageEnglish
Title of host publicationIWCMC 2014 - 10th International Wireless Communications and Mobile Computing Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages423-428
Number of pages6
ISBN (Electronic)9781479909599
DOIs
Publication statusPublished - 2014 Sep 22
Event10th International Wireless Communications and Mobile Computing Conference, IWCMC 2014 - Nicosia, Cyprus
Duration: 2014 Aug 42014 Aug 8

Publication series

NameIWCMC 2014 - 10th International Wireless Communications and Mobile Computing Conference

Other

Other10th International Wireless Communications and Mobile Computing Conference, IWCMC 2014
CountryCyprus
CityNicosia
Period14/8/414/8/8

Keywords

  • Context-aware task allocation
  • MapReduce
  • minimizing completion time
  • optical-wireless network

ASJC Scopus subject areas

  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Context-aware task allocation for fast parallel big data processing in optical-wireless networks'. Together they form a unique fingerprint.

  • Cite this

    Suto, K., Nishiyama, H., & Kato, N. (2014). Context-aware task allocation for fast parallel big data processing in optical-wireless networks. In IWCMC 2014 - 10th International Wireless Communications and Mobile Computing Conference (pp. 423-428). [6906394] (IWCMC 2014 - 10th International Wireless Communications and Mobile Computing Conference). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWCMC.2014.6906394