Development of a clinical tool for rating the body function categories of the ICF generic-30/rehabilitation set in Japanese rehabilitation practice and examination of its interrater reliability

Yuki Senju, Masahiko Mukaino, Birgit Prodinger, Melissa Selb, Yuki Okouchi, Kouji Mizutani, Megumi Suzuki, Shin Yamada, Shin Ichi Izumi, Shigeru Sonoda, Yohei Otaka, Eiichi Saitoh, Gerold Stucki

Research output: Contribution to journalArticlepeer-review

Abstract

Background: The International Classification of Functioning, Disability, and Health (ICF) Generic-30 (Rehabilitation) Set is a tool used to assess the functioning of a clinical population in rehabilitation. The ICF Generic-30 consists of nine ICF categories from the component “body functions” and 21 from the component “activities and participation”. This study aimed to develop a rating reference guide for the nine body function categories of the ICF Generic-30 Set using a predefined, structured process and to examine the interrater reliability of the ratings using the rating reference guide. Methods: The development of the first version of the rating reference guide involved the following steps: (1) a trial of rating patients by several raters; (2) cognitive interviews with each rater to analyze the thought process involved in each rating; (3) the drafting of the rating reference guide by a multidisciplinary panel; and (4) a review by ICF specialists to confirm consistency with the ICF. Subsequently, we conducted a first field test to gain insight into the use of the guide in practice. The reference guide was modified based on the raters’ feedback in the field test, and an inter-rater reliability test was conducted thereafter. Interrater agreement was evaluated using weighted kappa statistics with linear weights. Results: The first version of the rating reference guide was successfully developed and tested. The weighted kappa coefficient in the field testing ranged from 0.25 to 0.92. The interrater reliability testing of the rating reference guide modified based on the field test results yielded an improved weighted kappa coefficient ranging from 0.53 to 0.78. Relative improvements in the weighted kappa coefficients were observed in seven out of the nine categories. Consequently, seven out of nine categories were found to have a weighted kappa coefficient of 0.61 or higher. Conclusions: In this study, we developed and modified a rating reference guide for the body function categories of the ICF Generic-30 Set. The interrater reliability test using the final version of the rating reference guide showed moderate to substantial interrater agreement, which encouraged the use of the ICF in rehabilitation practice.

Original languageEnglish
Article number121
JournalBMC Medical Research Methodology
Volume21
Issue number1
DOIs
Publication statusPublished - 2021 Dec

Keywords

  • Clinical tool
  • International Classification of Functioning, Disability, and Health
  • Interrater reliability
  • Rehabilitation

ASJC Scopus subject areas

  • Epidemiology
  • Health Informatics

Fingerprint

Dive into the research topics of 'Development of a clinical tool for rating the body function categories of the ICF generic-30/rehabilitation set in Japanese rehabilitation practice and examination of its interrater reliability'. Together they form a unique fingerprint.

Cite this