Efficient second-order minimization based visual tracking on moving face

Le Duc Hanh, Chyi Yeu Lin, Chi Ying Lin, Koichi Hashimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution


This paper presents a visual feedback control system based on an efficient second-order minimization (ESM) [1] algorithm for tracking a face in motion. This research aims to control the camera installed at the end of a 3 DOF robot arm to fix its orientation to a face in motion so that the moving face appears in a constant position of the image. In this work, the ESM algorithm is firstly derived for feedback of the orientation of the 2D human face. Next, the conventional PD algorithm is applied to the tracking system to track and synchronize with the movement of the face. To track the face and also evaluate the effect of the synchronous motion of the robot system, a webcam is attached in the end effecter of the robot. If the orientation and position of the face of the jogger captured from the webcam appears stationary during its movement, the tracking and synchronous motion system will be proven effective. The experiments verified the effects. This implementation will be further applied on treadmills in which the entertaining LCD panel will synchronously move itself to match the motion of face of a jogger on a treadmill so that the jogger can watch a relatively stationary program on the LCD screen.

Original languageEnglish
Title of host publicationProceedings of the IASTED International Conference on Robotics, Robo 2010
Number of pages7
Publication statusPublished - 2010 Dec 1
EventIASTED International Conference on Robotics, Robo 2010 - Phuket, Thailand
Duration: 2010 Nov 242010 Nov 26


OtherIASTED International Conference on Robotics, Robo 2010


  • Homography based visual control
  • Image based tracking
  • PD control
  • Visual tracking

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction


Dive into the research topics of 'Efficient second-order minimization based visual tracking on moving face'. Together they form a unique fingerprint.

Cite this