3D fundus pattern reconstruction and display from multiple fundus images

This paper proposes a method to reconstruct and display 3D fundus (inner bottom of eye-ball) pattern from a set of multiple partial images of fundus. They were taken from several different view angles by shifting fundus camera. Because they are distorted by eye lens, a simple stereo technique does not work for the 3D reconstruction from any pair of images. Moreover, every fundus image's distortions differ from each other. In this method, we utilize the fact that a fundus has a spherical shape and that the image of sphere by the eye lens results in a quadratic surface. First, we determine each camera's viewing position and pose relative to the eye-ball and the shape of the quadratic surface by matching feature points in every fundus image on the quadratic image surface. Then, we identify the eye lens parameters so that the quadratic surface should be originated from a spherical fundus surface. As the final result, we obtain a wide area 3D fundus pattern reconstructed from the set of fundus images. This result will be helpful for medical diagnoses.