Analysis of human learning process on manual control of complex systems

Takakuni Goto, Noriyasu Homma, Makoto Yoshizawa, Kenichi Abe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, a novel analysis technique is applied for investigating human operators' trial and error learning process to control a nonholonomic system, 2-link planer underactuated manipulator (2PUAM). An essential core of the technique is to use a value function of the reinforcement learning scheme for revealing how the operators can find a control strategy. It is an advantage of the proposed technique compared to the others that a transition of the value function may explain the changes of the operators' strategies during the learning process. According to the results of the analysis, the operators tended to explore an objective trajectory first, and then shift to the tracking control of the trajectory. The tracking was accompanied with acceleration to achieve the goal faster. Interestingly, the acceleration disturbs the objective trajectory due to the complex dynamics of the target, and induces another exploration to get better trajectories. The fact that this phase transition structure under unsupervised learning environment is consistent with previously reported results for a supervised case implies that the structure can be a general nature of human learning process.

Original languageEnglish
Title of host publication2006 IEEE International Conference on Systems, Man and Cybernetics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1648-1653
Number of pages6
ISBN (Print)1424401003, 9781424401000
DOIs
Publication statusPublished - 2006 Jan 1
Event2006 IEEE International Conference on Systems, Man and Cybernetics - Taipei, Taiwan, Province of China
Duration: 2006 Oct 82006 Oct 11

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2
ISSN (Print)1062-922X

Other

Other2006 IEEE International Conference on Systems, Man and Cybernetics
CountryTaiwan, Province of China
CityTaipei
Period06/10/806/10/11

Keywords

  • 2-link planer underactuated manipulator
  • Manual control
  • Reinforcement learning
  • Value function

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Analysis of human learning process on manual control of complex systems'. Together they form a unique fingerprint.

  • Cite this

    Goto, T., Homma, N., Yoshizawa, M., & Abe, K. (2006). Analysis of human learning process on manual control of complex systems. In 2006 IEEE International Conference on Systems, Man and Cybernetics (pp. 1648-1653). [4274089] (Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics; Vol. 2). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSMC.2006.384955