An approximation method of the quadratic discriminant function and its application to estimation of high-dimensional distribution

Shinichiro Omachi, Masako Omachi, Hirotomo Aso

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)

Abstract

In statistical pattern recognition, it is important to estimate the distribution of patterns precisely to achieve high recognition accuracy. In general, precise estimation of the parameters of the distribution requires a great number of sample patterns, especially when the feature vector obtained from the pattern is high-dimensional. For some pattern recognition problems, such as face recognition or character recognition, very high-dimensional feature vectors are necessary and there are always not enough sample patterns for estimating the parameters. In this paper, we focus on estimating the distribution of high-dimensional feature vectors with small number of sample patterns. First, we define a function, called simplified quadratic discriminant function (SQDF). SQDF can be estimated with small number of sample patterns and approximates the quadratic discriminant function (QDF). SQDF has fewer parameters and requires less computational time than QDF. The effectiveness of SQDF is confirmed by three types of experiments. Next, as an application of SQDF, we propose an algorithm for estimating the parameters of the normal mixture. The proposed algorithm is applied to face recognition and character recognition problems which require high-dimensional feature vectors.

Original languageEnglish
Pages (from-to)1160-1167
Number of pages8
JournalIEICE Transactions on Information and Systems
VolumeE90-D
Issue number8
DOIs
Publication statusPublished - 2007 Aug

Keywords

  • Normal mixture
  • Pattern recognition
  • Quadratic discriminant function
  • Simplified quadratic discriminant function
  • Small sample size problem

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'An approximation method of the quadratic discriminant function and its application to estimation of high-dimensional distribution'. Together they form a unique fingerprint.

Cite this