Intelligent Image-Activated Cell Sorting

Nao Nitta; Takeaki Sugimura; Akihiro Isozaki; Hideharu Mikami; Kei Hiraki; Shinya Sakuma; Takanori Iino; Fumihito Arai; Taichiro Endo; Yasuhiro Fujiwaki; Hideya Fukuzawa; Misa Hase; Takeshi Hayakawa; Kotaro Hiramatsu; Yu Hoshino; Mary Inaba; Takuro Ito; Hiroshi Karakawa; Yusuke Kasai; Kenichi Koizumi; Sang Wook Lee; Cheng Lei; Ming Li; Takanori Maeno; Satoshi Matsusaka; Daichi Murakami; Atsuhiro Nakagawa; Yusuke Oguchi; Minoru Oikawa; Tadataka Ota; Kiyotaka Shiba; Hirofumi Shintaku; Yoshitaka Shirasaki; Kanako Suga; Yuta Suzuki; Nobutake Suzuki; Yo Tanaka; Hiroshi Tezuka; Chihana Toyokawa; Yaxiaer Yalikun; Makoto Yamada; Mai Yamagishi; Takashi Yamano; Atsushi Yasumoto; Yutaka Yatomi; Masayuki Yazawa; Dino Di Carlo; Yoichiroh Hosokawa; Sotaro Uemura; Yasuyuki Ozeki; Keisuke Goda

doi:10.1016/j.cell.2018.08.028

Intelligent Image-Activated Cell Sorting

Nao Nitta, Takeaki Sugimura, Akihiro Isozaki, Hideharu Mikami, Kei Hiraki, Shinya Sakuma, Takanori Iino, Fumihito Arai, Taichiro Endo, Yasuhiro Fujiwaki, Hideya Fukuzawa, Misa Hase, Takeshi Hayakawa, Kotaro Hiramatsu, Yu Hoshino, Mary Inaba, Takuro Ito, Hiroshi Karakawa, Yusuke Kasai, Kenichi KoizumiSang Wook Lee, Cheng Lei, Ming Li, Takanori Maeno, Satoshi Matsusaka, Daichi Murakami, Atsuhiro Nakagawa, Yusuke Oguchi, Minoru Oikawa, Tadataka Ota, Kiyotaka Shiba, Hirofumi Shintaku, Yoshitaka Shirasaki, Kanako Suga, Yuta Suzuki, Nobutake Suzuki, Yo Tanaka, Hiroshi Tezuka, Chihana Toyokawa, Yaxiaer Yalikun, Makoto Yamada, Mai Yamagishi, Takashi Yamano, Atsushi Yasumoto, Yutaka Yatomi, Masayuki Yazawa, Dino Di Carlo, Yoichiroh Hosokawa, Sotaro Uemura, Yasuyuki Ozeki, Keisuke Goda

Clinical Research, Innovation and Education Center

Research output: Contribution to journal › Article › peer-review

297 Citations (Scopus)

Abstract

A fundamental challenge of biology is to understand the vast heterogeneity of cells, particularly how cellular composition, structure, and morphology are linked to cellular physiology. Unfortunately, conventional technologies are limited in uncovering these relations. We present a machine-intelligence technology based on a radically different architecture that realizes real-time image-based intelligent cell sorting at an unprecedented rate. This technology, which we refer to as intelligent image-activated cell sorting, integrates high-throughput cell microscopy, focusing, and sorting on a hybrid software-hardware data-management infrastructure, enabling real-time automated operation for data acquisition, data processing, decision-making, and actuation. We use it to demonstrate real-time sorting of microalgal and blood cells based on intracellular protein localization and cell-cell interaction from large heterogeneous populations for studying photosynthesis and atherothrombosis, respectively. The technology is highly versatile and expected to enable machine-based scientific discovery in biological, pharmaceutical, and medical sciences. Artificial-intelligence-assisted, image-based flow cytometry in real-time enables rapid cell sorting based on unique chemical and morphological features.

Original language	English
Pages (from-to)	266-276.e13
Journal	Cell
Volume	175
Issue number	1
DOIs	https://doi.org/10.1016/j.cell.2018.08.028
Publication status	Published - 2018 Sept 20

Keywords

cellular heterogeneity
cellular morphology
convolutional neural network
deep learning
high-throughput microscopy
high-throughput screening
image-activated cell sorting
machine intelligence

ASJC Scopus subject areas

Biochemistry, Genetics and Molecular Biology(all)

Access to Document

10.1016/j.cell.2018.08.028

Cite this

Nitta, N, Sugimura, T, Isozaki, A, Mikami, H, Hiraki, K, Sakuma, S, Iino, T, Arai, F, Endo, T, Fujiwaki, Y, Fukuzawa, H, Hase, M, Hayakawa, T, Hiramatsu, K, Hoshino, Y, Inaba, M, Ito, T, Karakawa, H, Kasai, Y, Koizumi, K, Lee, SW, Lei, C, Li, M, Maeno, T, Matsusaka, S, Murakami, D, Nakagawa, A, Oguchi, Y, Oikawa, M, Ota, T, Shiba, K, Shintaku, H, Shirasaki, Y, Suga, K, Suzuki, Y, Suzuki, N, Tanaka, Y, Tezuka, H, Toyokawa, C, Yalikun, Y, Yamada, M, Yamagishi, M, Yamano, T, Yasumoto, A, Yatomi, Y, Yazawa, M, Di Carlo, D, Hosokawa, Y, Uemura, S, Ozeki, Y & Goda, K 2018, 'Intelligent Image-Activated Cell Sorting', Cell, vol. 175, no. 1, pp. 266-276.e13. https://doi.org/10.1016/j.cell.2018.08.028

@article{49389fa737954ca09fce95a6a90a5974,

title = "Intelligent Image-Activated Cell Sorting",

abstract = "A fundamental challenge of biology is to understand the vast heterogeneity of cells, particularly how cellular composition, structure, and morphology are linked to cellular physiology. Unfortunately, conventional technologies are limited in uncovering these relations. We present a machine-intelligence technology based on a radically different architecture that realizes real-time image-based intelligent cell sorting at an unprecedented rate. This technology, which we refer to as intelligent image-activated cell sorting, integrates high-throughput cell microscopy, focusing, and sorting on a hybrid software-hardware data-management infrastructure, enabling real-time automated operation for data acquisition, data processing, decision-making, and actuation. We use it to demonstrate real-time sorting of microalgal and blood cells based on intracellular protein localization and cell-cell interaction from large heterogeneous populations for studying photosynthesis and atherothrombosis, respectively. The technology is highly versatile and expected to enable machine-based scientific discovery in biological, pharmaceutical, and medical sciences. Artificial-intelligence-assisted, image-based flow cytometry in real-time enables rapid cell sorting based on unique chemical and morphological features.",

keywords = "cellular heterogeneity, cellular morphology, convolutional neural network, deep learning, high-throughput microscopy, high-throughput screening, image-activated cell sorting, machine intelligence",

author = "Nao Nitta and Takeaki Sugimura and Akihiro Isozaki and Hideharu Mikami and Kei Hiraki and Shinya Sakuma and Takanori Iino and Fumihito Arai and Taichiro Endo and Yasuhiro Fujiwaki and Hideya Fukuzawa and Misa Hase and Takeshi Hayakawa and Kotaro Hiramatsu and Yu Hoshino and Mary Inaba and Takuro Ito and Hiroshi Karakawa and Yusuke Kasai and Kenichi Koizumi and Lee, {Sang Wook} and Cheng Lei and Ming Li and Takanori Maeno and Satoshi Matsusaka and Daichi Murakami and Atsuhiro Nakagawa and Yusuke Oguchi and Minoru Oikawa and Tadataka Ota and Kiyotaka Shiba and Hirofumi Shintaku and Yoshitaka Shirasaki and Kanako Suga and Yuta Suzuki and Nobutake Suzuki and Yo Tanaka and Hiroshi Tezuka and Chihana Toyokawa and Yaxiaer Yalikun and Makoto Yamada and Mai Yamagishi and Takashi Yamano and Atsushi Yasumoto and Yutaka Yatomi and Masayuki Yazawa and {Di Carlo}, Dino and Yoichiroh Hosokawa and Sotaro Uemura and Yasuyuki Ozeki and Keisuke Goda",

note = "Funding Information: This work was funded by the ImPACT program of the Council for Science, Technology, and Innovation (Cabinet Office, Government of Japan) . We thank M. Kanematsu, M. Urakawa, and A. Komiya for assistance. N.N. is an ISAC Marylou Ingram Scholar. Funding Information: This work was funded by the ImPACT program of the Council for Science, Technology, and Innovation (Cabinet Office, Government of Japan). We thank M. Kanematsu, M. Urakawa, and A. Komiya for assistance. N.N. is an ISAC Marylou Ingram Scholar. Publisher Copyright: {\textcopyright} 2018 Elsevier Inc.",

year = "2018",

month = sep,

day = "20",

doi = "10.1016/j.cell.2018.08.028",

language = "English",

volume = "175",

pages = "266--276.e13",

journal = "Cell",

issn = "0092-8674",

publisher = "Cell Press",

number = "1",

}

TY - JOUR

T1 - Intelligent Image-Activated Cell Sorting

AU - Nitta, Nao

AU - Sugimura, Takeaki

AU - Isozaki, Akihiro

AU - Mikami, Hideharu

AU - Hiraki, Kei

AU - Sakuma, Shinya

AU - Iino, Takanori

AU - Arai, Fumihito

AU - Endo, Taichiro

AU - Fujiwaki, Yasuhiro

AU - Fukuzawa, Hideya

AU - Hase, Misa

AU - Hayakawa, Takeshi

AU - Hiramatsu, Kotaro

AU - Hoshino, Yu

AU - Inaba, Mary

AU - Ito, Takuro

AU - Karakawa, Hiroshi

AU - Kasai, Yusuke

AU - Koizumi, Kenichi

AU - Lee, Sang Wook

AU - Lei, Cheng

AU - Li, Ming

AU - Maeno, Takanori

AU - Matsusaka, Satoshi

AU - Murakami, Daichi

AU - Nakagawa, Atsuhiro

AU - Oguchi, Yusuke

AU - Oikawa, Minoru

AU - Ota, Tadataka

AU - Shiba, Kiyotaka

AU - Shintaku, Hirofumi

AU - Shirasaki, Yoshitaka

AU - Suga, Kanako

AU - Suzuki, Yuta

AU - Suzuki, Nobutake

AU - Tanaka, Yo

AU - Tezuka, Hiroshi

AU - Toyokawa, Chihana

AU - Yalikun, Yaxiaer

AU - Yamada, Makoto

AU - Yamagishi, Mai

AU - Yamano, Takashi

AU - Yasumoto, Atsushi

AU - Yatomi, Yutaka

AU - Yazawa, Masayuki

AU - Di Carlo, Dino

AU - Hosokawa, Yoichiroh

AU - Uemura, Sotaro

AU - Ozeki, Yasuyuki

AU - Goda, Keisuke

N1 - Funding Information: This work was funded by the ImPACT program of the Council for Science, Technology, and Innovation (Cabinet Office, Government of Japan) . We thank M. Kanematsu, M. Urakawa, and A. Komiya for assistance. N.N. is an ISAC Marylou Ingram Scholar. Funding Information: This work was funded by the ImPACT program of the Council for Science, Technology, and Innovation (Cabinet Office, Government of Japan). We thank M. Kanematsu, M. Urakawa, and A. Komiya for assistance. N.N. is an ISAC Marylou Ingram Scholar. Publisher Copyright: © 2018 Elsevier Inc.

PY - 2018/9/20

Y1 - 2018/9/20

N2 - A fundamental challenge of biology is to understand the vast heterogeneity of cells, particularly how cellular composition, structure, and morphology are linked to cellular physiology. Unfortunately, conventional technologies are limited in uncovering these relations. We present a machine-intelligence technology based on a radically different architecture that realizes real-time image-based intelligent cell sorting at an unprecedented rate. This technology, which we refer to as intelligent image-activated cell sorting, integrates high-throughput cell microscopy, focusing, and sorting on a hybrid software-hardware data-management infrastructure, enabling real-time automated operation for data acquisition, data processing, decision-making, and actuation. We use it to demonstrate real-time sorting of microalgal and blood cells based on intracellular protein localization and cell-cell interaction from large heterogeneous populations for studying photosynthesis and atherothrombosis, respectively. The technology is highly versatile and expected to enable machine-based scientific discovery in biological, pharmaceutical, and medical sciences. Artificial-intelligence-assisted, image-based flow cytometry in real-time enables rapid cell sorting based on unique chemical and morphological features.

AB - A fundamental challenge of biology is to understand the vast heterogeneity of cells, particularly how cellular composition, structure, and morphology are linked to cellular physiology. Unfortunately, conventional technologies are limited in uncovering these relations. We present a machine-intelligence technology based on a radically different architecture that realizes real-time image-based intelligent cell sorting at an unprecedented rate. This technology, which we refer to as intelligent image-activated cell sorting, integrates high-throughput cell microscopy, focusing, and sorting on a hybrid software-hardware data-management infrastructure, enabling real-time automated operation for data acquisition, data processing, decision-making, and actuation. We use it to demonstrate real-time sorting of microalgal and blood cells based on intracellular protein localization and cell-cell interaction from large heterogeneous populations for studying photosynthesis and atherothrombosis, respectively. The technology is highly versatile and expected to enable machine-based scientific discovery in biological, pharmaceutical, and medical sciences. Artificial-intelligence-assisted, image-based flow cytometry in real-time enables rapid cell sorting based on unique chemical and morphological features.

KW - cellular heterogeneity

KW - cellular morphology

KW - convolutional neural network

KW - deep learning

KW - high-throughput microscopy

KW - high-throughput screening

KW - image-activated cell sorting

KW - machine intelligence

UR - http://www.scopus.com/inward/record.url?scp=85054484004&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054484004&partnerID=8YFLogxK

U2 - 10.1016/j.cell.2018.08.028

DO - 10.1016/j.cell.2018.08.028

M3 - Article

C2 - 30166209

AN - SCOPUS:85054484004

SN - 0092-8674

VL - 175

SP - 266-276.e13

JO - Cell

JF - Cell

IS - 1

ER -

Intelligent Image-Activated Cell Sorting

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this