Development of a peer review system using patient records for outcome evaluation of medical education: Reliability analysis

Junichi Kameoka, Tomoya Okubo, Emi Koguma, Fumie Takahashi, Seiichi Ishii, Hiroshi Kanatsuka

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In addition to input evaluation (education delivered at school) and output evaluation (students' capability at graduation), the methods for outcome evaluation (performance after graduation) of medical education need to be established. One approach is a review of medical records, which, however, has been met with difficulties because of poor inter-rater reliability. Here, we attempted to develop a peer review system of medical records with high inter-rater reliability. We randomly selected 112 patients (and finally selected 110 after removing two ineligible patients) who visited (and were hospitalized in) one of the four general hospitals in the Tohoku region of Japan between 2008 and 2012. Four reviewers, who were well-trained general internists from outside the Tohoku region, visited the hospitals independently and evaluated outpatient medical records based on an evaluation sheet that consisted of 14 items (3-point scale) for record keeping and 15 items (5-point scale) for quality of care. The mean total score was 84.1 ± 7.7. Cronbach's alpha for these items was 0.798. Single measure and average measure intraclass correlations for the reviewers were 0.733 (95% confidence interval: 0.720-0.745) and 0.917 (95% confidence interval: 0.912-0.921), respectively. An exploratory factor analysis revealed six factors: history taking, physical examination, clinical reasoning, management and outcome, rhetoric, and patient relationship. In conclusion, we have developed a peer review system of medical records with high inter-rater reliability, which may enable us, with further validity analysis, to measure quality of patient care as an outcome evaluation of medical education in the future.

Original languageEnglish
Pages (from-to)189-195
Number of pages7
JournalTohoku Journal of Experimental Medicine
Volume233
Issue number3
DOIs
Publication statusPublished - 2014

Keywords

  • Medical records
  • Outcome evaluation
  • Peer review system
  • Reliability
  • Validity

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)

Fingerprint Dive into the research topics of 'Development of a peer review system using patient records for outcome evaluation of medical education: Reliability analysis'. Together they form a unique fingerprint.

  • Cite this