Clinical utility,validity and reliability of the IPad application for goal-setting: The aid for decision-making in occupation choice-2

Abstract

Objective

To evaluate the clinical utility, reliability, and validity of the second-generation aid for decision-making in occupation choice-2 (ADOC2), an iPad application designed for client-centred and occupation-centred goal setting.

Design

This study consisted of two components: (1) The development and refinement of the ADOC2 application, focusing on user interface design and structured goal-setting functionality; and (2) the clinical evaluation of its utility, validity, and reliability.

Setting

Eleven rehabilitation facilities in Japan (10 hospitals, 1 home-based setting).

Participants

A total of 116 occupational therapy clients and 56 occupational therapists participated in the study.

Main measures

Clinical utility was assessed using a structured questionnaire previously validated for the original ADOC. Validity was examined through correlations with the Canadian Occupational Performance Measure (COPM) and the EuroQol 5-Dimension 5-Level (EQ-5D-5L). Test–retest reliability of satisfaction and performance scores was analysed using weighted kappa coefficients.

Results

Over 90% of participants reported positive experiences with ADOC2 during the goal-setting process. The COPM scores showed strong correlations with ADOC2 ratings, while EQ-5D-5L scores showed weaker but expected correlations. Weighted kappa analyses indicated substantial to almost perfect agreement for test–retest reliability.

Conclusions

ADOC2 is a clinically useful, valid, and reliable tool for facilitating client-centred goal setting in occupational therapy practice.

Keywords

goal-setting iPad application Aid for Decision-making in Occupation Choice

Get full access to this article

View all access options for this article.

References

Locke

Latham

. The development of goal setting theory: a half century retrospective. Motivation Sci 2019; 5: 93–105.

Burnette

O’Boyle

VanEpps

, et al. Mind-Sets matter: a meta-analytic review of implicit theories and self-regulation. Psychol Bull 2013; 139: 655–701.

McEwan

Harden

Zumbo

, et al. The effectiveness of multi-component goal setting interventions for changing physical activity behaviour: a systematic review and meta-analysis. Health Psychol Rev 2015; 10: 67–88.

Dorothy

Ian

Katrine

S-S

, et al. Goal setting dynamics that facilitate or impede a client-centered approach. Scand J Occup Ther 2018; 26: 315–324.

Margot-Cattin

Page

Petrig

, et al. Creating a continuing professional development course on setting occupation-focused goals. World Fed Occup Ther Bull 2018; 74: 44–51.

Snyman

de Bruyn

Buys

. Goal setting practices of occupational therapists in spinal cord injury rehabilitation in Gauteng, South Africa. Spinal Cord Ser Cases 2021; 7: 48.

Fields

Smallfield

. Occupational therapy practice guidelines for adults with chronic conditions. Am J Occup Ther 2022; 76: 7602397010.

Law

Baptiste

Carswell

, et al. Canadian Occupational Performance Measure. 2015.

Crawford

Maxwell

Colquhoun

, et al. Facilitators and barriers to patient-centred goal-setting in rehabilitation: a scoping review. Clin Rehabil 2022; 36: 1694–1704.

10.

Brown

Levack

McPherson

, et al. Survival, momentum, and things that make me “me”: patients’ perceptions of goal setting after stroke. Disabil Rehabil 2014; 36: 1020–1026.

11.

Sawada

Tomori

Ohno

, et al. Information bias in the Canadian occupational performance measure: a qualitative study. Brit J Occup Ther 2022; 85: 722–732.

12.

Dutzi

Schwenk

Kirchner

, et al.

What would you like to achieve?

Goal- Setting in Patients with Dementia in Geriatric Rehabilitation 2019; 19: 280.

13.

Worrall

Sherratt

Rogers

, et al. What people with aphasia want: their goals according to the ICF. Aphasiology 2011; 25: 309–322.

14.

Tomori

Uezu

Kinjo

, et al. Utilization of the iPad application: Aid for decision-making in occupation choice. Occup Ther Int 2012; 19: 88–97.

15.

Tomori

Saito

Nagayama

, et al. Reliability and validity of individualized satisfaction score in aid for decision-making in occupation choice. Disabil Rehabil 2012; 35: 113–117.

16.

Tomori

Nagayama

Saito

, et al. Examination of a cut-off score to express the meaningful activity of people with dementia using iPad application (ADOC). Disability and Rehabilitation: Assistive Technology 2015; 10: 126–131.

17.

Levack

Tomori

Takahashi

, et al. Development of an English-language version of a Japanese iPad application to facilitate collaborative goal setting in rehabilitation: A Delphi study and field test. BMJ open 2018; 8: e018908.

18.

Strubbia

Levack

Grainger

, et al. Use of an iPad app (aid for decision-making in occupational choice) for collaborative goal setting in interprofessional rehabilitation: qualitative descriptive study. JMIR Rehabilitation Assist Technol 2021; 8: e33027.

19.

Graham

Logan

Bennett

, et al. Physicians’ intentions and use of three patient decision aids. BMC Med Inform Decis Mak 2007; 7: 20.

20.

Ohno

Tomori

Sawada

, et al. Measurement properties of the Canadian occupational performance measure: a systematic review. Am J Occup Ther 2021; 75: 7506205100.

21.

Foundation ER. EQ-5D-5L User Guide, https://euroqol.org/publications/user-guides (2019).

22.

Cohen

. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 1968; 70: 213–220.

23.

McHugh

. Interrater reliability: the kappa statistic. Biochem Med 2012; 22: 276–282.

24.

Randall

McEwen

. Writing patient-centered functional goals. Phys Ther 2000; 80: 1197–1203.

25.

Miller

. Motivational interviewing : preparing people for change. Guildford Press, 2013.

26.

Deci

and inquiry RRP. The” what” and” why” of goal pursuits: human needs and the self-determination of behavior. Taylor & Francis, 2000; 11: 227–268.

27.

Capdevila

Portell

Penelo

, et al. Measurement properties of the Spanish COPM in older adult rehabilitation inpatients. Scand J Occup Ther 2024; 31: 2377175.

28.

Ikeda

Shiroiwa

Igarashi

, et al. Developing a Japanese version of the EQ-5D-5L value set. J Natl Inst Public Health 2015; 1: 47–55.

29.

Sajobi

Brahmbatt

Lix

, et al. Scoping review of response shift methods: Current reporting practices and recommendations. Qual Life Res 2018; 27: 1133–1146.

30.

Ohno

Harada

, et al. Response shifts in the Canadian occupational performance measure: a convergent mixed-methods study. Am J Occup Ther 78: 7803205100.

31.

Yamamoto

Ito

Sakata

, et al. Japanese Version of the Mobile app rating scale (MARS): Development and validation. JMIR mHealth UHealth 2022; 10: e33725.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

12.00 MB