Activity recognition using gazed text and viewpoint information for user support systems

Shun Chiba, Tomo Miyazaki, Yoshihiro Sugaya, Shinichiro Omachi

研究成果: Article査読

2 被引用数 (Scopus)


The development of information technology has added many conveniences to our lives. On the other hand, however, we have to deal with various kinds of information, which can be a difficult task for elderly people or those who are not familiar with information devices. A technology to recognize each person’s activity and providing appropriate support based on that activity could be useful for such people. In this paper, we propose a novel fine-grained activity recognition method for user support systems that focuses on identifying the text at which a user is gazing, based on the idea that the content of the text is related to the activity of the user. It is necessary to keep in mind that the meaning of the text depends on its location. To tackle this problem, we propose the simultaneous use of a wearable device and fixed camera. To obtain the global location of the text, we perform image matching using the local features of the images obtained by these two devices. Then, we generate a feature vector based on this information and the content of the text. To show the effectiveness of the proposed approach, we performed activity recognition experiments with six subjects in a laboratory environment.

ジャーナルJournal of Sensor and Actuator Networks
出版ステータスPublished - 2018 8月 2

ASJC Scopus subject areas

  • 器械工学
  • コンピュータ ネットワークおよび通信
  • 制御と最適化


「Activity recognition using gazed text and viewpoint information for user support systems」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。