Mesh learning for object classification using fMRI measurements

Omer Ekmekci, Orhan Firat, Mete Ozay, Ilke Oztekin, Fatos T.Yarman Vural, Uygar Oztekin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


Machine learning algorithms have been widely used as reliable methods for modeling and classifying cognitive processes using functional Magnetic Resonance Imaging (fMRI) data. In this study, we aim to classify fMRI measurements recorded during an object recognition experiment. Previous studies focus on Multi Voxel Pattern Analysis (MVPA) which feeds a set of active voxels in a concatenated vector form to a machine learning algorithm to train and classify the cognitive processes. In most of the MVPA methods, after an image preprocessing step, the voxel intensity values are fed to a classifier to train and recognize the underlying cognitive process. Sometimes, the fMRI data is further processed for de-noising or feature selection where techniques, such as Generalized Linear Model (GLM), Independent Component Analysis (ICA) or Principal Component Analysis are employed. Although these techniques are proved to be useful in MVPA, they do not model the spatial connectivity among the voxels. In this study, we attempt to represent the local relations among the voxel intensity values by forming a mesh network around each voxel to model the relationship of a voxel and its surroundings. The degree of connectivity of a voxel to its surroundings is represented by the arc weights of each mesh. The arc weights, which are estimated by a linear regression model, are fed to a classifier to discriminate the brain states during an object recognition task. This approach, called Mesh Learning, provides a powerful tool to analyze various cognitive states using fMRI data. Compared to traditional studies which focus either merely on multi-voxel pattern vectors or their reduced-dimension versions, the suggested Mesh Learning provides a better representation of object recognition task. Various machine learning algorithms are tested to compare the suggested Mesh Learning to the state-of-the art MVPA techniques. The performance of the Mesh Learning is shown to be higher than that of the available MVPA techniques.

Original languageEnglish
Title of host publication2013 IEEE International Conference on Image Processing, ICIP 2013 - Proceedings
Number of pages4
Publication statusPublished - 2013 Dec 1
Event2013 20th IEEE International Conference on Image Processing, ICIP 2013 - Melbourne, VIC, Australia
Duration: 2013 Sep 152013 Sep 18

Publication series

Name2013 IEEE International Conference on Image Processing, ICIP 2013 - Proceedings


Other2013 20th IEEE International Conference on Image Processing, ICIP 2013
CityMelbourne, VIC


  • Functional Magnetic Resonance Imaging (fMRI)
  • Multi Voxel Pattern Analysis (MVPA)
  • brain decoding
  • classification
  • feature extraction
  • machine learning

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Mesh learning for object classification using fMRI measurements'. Together they form a unique fingerprint.

Cite this