OBJECTIVE: To develop an observational coding instrument for evaluating the fidelity and quality of brief behavioral change interventions based on the behavioral theories of the 5 A's, Stages of Change and Motivational Interviewing. METHODS: Content and face validity were assessed prior to an intervention where psychometric properties were evaluated with a prospective cohort of 116 medical students. Properties assessed included the inter-rater reliability of the instrument, internal consistency of the full scale and sub-scales and descriptive statistics of the instrument. Construct validity was assessed based on student's scores. RESULTS: Inter-rater reliability for the instrument was 0.82 (intraclass correlation). Internal consistency for the full scale was 0.70 (KR20). Internal consistencies for the sub-scales were as follows: MI intervention component (KR20=.7); stage-appropriate MI-based intervention (KR20=.55); MI spirit (KR20=.5); appropriate assessment (KR20=.45) and appropriate assisting (KR20=.56). CONCLUSIONS: The instrument demonstrated good inter-rater reliability and moderate overall internal consistency when used to assess performing brief behavioral change interventions by medical students. PRACTICE IMPLICATIONS: This practical instrument can be used with minimal training and demonstrates promising psychometric properties when evaluated with medical students counseling standardized patients. Further testing is required to evaluate its usefulness in clinical settings.

Original publication

DOI

10.1016/j.pec.2010.04.012

Type

Journal article

Journal

Patient Educ Couns

Publication Date

04/2011

Volume

83

Pages

99 - 105

Keywords

Behavior Therapy, Counseling, Female, Health Behavior, Humans, Interviews as Topic, Male, Motivation, Observer Variation, Physician-Patient Relations, Pilot Projects, Primary Health Care, Psychometrics, Reproducibility of Results, Students, Medical, Surveys and Questionnaires, Young Adult