6D Pose Estimation of Occlusion-Free Objects for Robotic Bin-Picking Using PPF-MEAM with 2D Images (Occlusion-Free PPF-MEAM)

Diyi Liu, Shogo Arai, Yajun Xu, Fuyuki Tokuda, Kazuhiro Kosuge

Research output: Contribution to journalArticlepeer-review

Abstract

Pose estimation that locates objects in a bin is necessary for a robotic bin picking system. Although many algorithms have shown high performance in pose estimation, most algorithms estimate the poses of objects regardless of their occlusion. This can reduce the success rate in picking up the object. To resolve this issue, we propose a novel pipeline that estimates a pose only for occlusion-free objects based on point pair feature-based pose estimation with multiple edge appearance model (PPF-MEAM). The proposed method detects occlusion-free objects in the 2D image captured by a camera with a convolutional neural network framework. Next, corresponding point clouds of occlusion-free objects need to be extracted by using their locations in the 2D image. we propose a robust extraction method that finds the 3D points corresponding to image pixels in the 2D image to reduce the effect of the calibration errors between the camera and 3D sensor. The point cloud of the occlusion-free objects is finally input into a pipeline of PPF-MEAM to estimate the pose of the object. The experiment results prove that the proposed method is about 50% faster 30% higher in terms of pose estimation success rate compared with the original PPF. Moreover, it increases the success rate of picking tasks compared with the original PPF-MEAM.

Original languageEnglish
Article number9385060
Pages (from-to)50857-50871
Number of pages15
JournalIEEE Access
Volume9
DOIs
Publication statusPublished - 2021

Keywords

  • 6D pose estimation
  • multiple edge appearance model (MEAM)
  • occlusion-free
  • robotic bin picking

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of '6D Pose Estimation of Occlusion-Free Objects for Robotic Bin-Picking Using PPF-MEAM with 2D Images (Occlusion-Free PPF-MEAM)'. Together they form a unique fingerprint.

Cite this