Parent–adolescent agreement on psychosis risk symptoms

https://doi.org/10.1016/j.schres.2013.03.007Get rights and content

Abstract

Despite practice guidelines recommending caregiver inclusion for assessment of mental health problems in adolescents, clinical high-risk (CHR) assessment tools that target attenuated psychosis symptoms rely solely on self-report. As many individuals in the clinical high-risk phase are expected to be adolescents, and programs of CHR research routinely recruit participants as young as twelve, parent input regarding adolescents' symptoms and functioning may help to inform clinical conceptualizations. No assessment tool targeting CHR symptoms has been developed for this purpose. We created a caregiver-report version of the 12-item Prime Screen-Revised and administered the measure to caregivers of 52 youth ages 12–19 referred by mental health providers for CHR study participation. Youth completed the Prime Screen-Revised as well as the Structured Interview for Psychosis Risk Syndromes (SIPS). Caregiver responses demonstrated poor agreement with youth ratings on Prime Screen-Revised (r = .09), but moderate agreement with clinician ratings (r = .41). The addition of caregiver screening data to youth self-report scores significantly improved a linear regression predicting clinician ratings. Using a threshold of four or more endorsements, the combined use of parent and adolescent responses accurately classified 75% of respondents with regard to SIPS-determined CHR status. Findings suggest that involving caregivers may help to improve the specificity of CHR screening and assessment procedures.

Introduction

The codification of a set of risk markers referred to as a “clinical high risk” state (CHR) or “attenuated psychosis syndrome” (APS) has advanced the possibility of developing targeted treatment to delay or prevent the onset of psychosis among individuals prodromal to schizophrenia and other psychotic spectrum disorders (Fusar-Poli et al., 2012). The inclusion of APS in section three of DSM-5 highlights the need to expand knowledge and practice for individuals thought to be most vulnerable to psychosis. Current research is focused on the goals of refining the CHR construct to limit the number of individuals falsely identified as being clinically high risk for psychosis, understanding the mechanisms governing the origins and progression of psychotic symptoms, and establishing interventions that are safe and effective for reducing both current distress and likelihood of future illness (Fusar-Poli et al., 2012).

The Structured Interview for Psychosis Risk Syndromes (SIPS; Miller et al., 1999) is the most widely used assessment tool used in North American efforts to identify CHR populations. Similar to its Australian predecessor, the Comprehensive Assessment of At-Risk Mental States (CAARMS; Yung et al., 2005), the SIPS emphasizes the appearance and worsening of attenuated positive symptoms (e.g., brief hallucinations, or unusual ideas), in addition to genetic risk and functional impairments, in its conceptualization of the CHR category. CHR criteria as defined by the SIPS form the basis of inclusion criteria for most programs of high-risk recruitment. Unfortunately, the interview requires considerable training and administration time. Thus, though considered the current gold standard as a highly specialized assessment tool for CHR status, the SIPS is impractical as a “first step” screener for symptoms that may indicate elevated clinical risk.

A few self-report measures have emerged as brief and low-cost methods for screening and monitoring psychosis risk symptoms (e.g., Heinimaa et al., 2003, Miller et al., 2004, Ord et al., 2004, Loewy et al., 2011). These tools have demonstrated good reliability and validity within validation samples. In a naturalistic clinical sample of help-seeking adolescents and young adults, three such tools demonstrated strong continuous agreement with the SIPS and adequate performance as screening tools for detecting potentially high-risk individuals (Kline et al., 2012a, Kline et al., 2012b). Moreover, a few of these screening tools have been used for ‘real-world’ applications, for example in screening newly incarcerated men for mental health needs (Jarrett et al., 2012) and as a first-step online assessment in a high-risk recruitment protocol (Ising et al., 2012, Rietdijk et al., 2012).

Given that median age of psychosis onset occurs around 22 years (Kessler et al., 2007) and that as many as 20% of first-episode patients may be eighteen or younger (Schimmelmann et al., 2007), the onset of CHR symptoms for many individuals on a trajectory toward psychosis is likely to occur during adolescence. Although eliciting information from parents or other adult informants is considered best practice when evaluating mental health and functioning in youth (McClellan et al., 2001), no formal or standardized instruments have been developed for the purpose of gathering information from parents about CHR symptoms. Both the SIPS and the self-report tools that have been validated against it focus solely on self-reported information and clinician impressions. Further, the few assessment tools that do solicit information from parents about psychotic symptoms in adolescents demonstrate only modest inter-rater agreement between parents and adolescents (Nugent et al., 2013), and interview-based measures that assess full-threshold psychosis in children do not appear to be effective for eliciting parents' reports of children's attenuated psychotic symptoms (Kelleher et al., 2011). Given the weight typically afforded to parent-reported information in assessing youth referred for other mental health concerns, it is surprising that no parent-driven assessment tool targeting CHR symptoms has been validated. Especially when information provided by parents and youth diverges, caregivers serve as vital and knowledgeable resources for learning about adolescents' history, behaviors, daily activities, and functioning.

Structured involvement of parents in the initial screening and assessment process has the potential to improve the quality of clinical information gathered by clinicians and to focus further resources (e.g., time spent in face-to-face clinical interviews) where they are likely to yield the greatest benefit. The creation of a screening tool to be completed by parents or other caregivers could serve this purpose. To this end, the current study aims to determine the agreement of parent- and child-reported information within questionnaires assessing attenuated symptoms, and to evaluate the incremental utility of including parent data within a screening protocol. We hypothesize that parent–child agreement on symptoms will be moderate, and that the inclusion of parent-reported information will enhance the concordance of screening data with SIPS interview results.

Section snippets

Procedure

All procedures were approved by the Institutional Review Boards of the University of Maryland, School of Medicine and University of Maryland, Baltimore County. A study staff spoke via telephone with interested caregivers and participants to provide information about the study and schedule an appointment. As the only entry criterion with respect to risk was that they were currently receiving mental health services, no preliminary screening procedures were used other than to confirm that

Results

Of the 52 participants, 27 (52%) were “positive cases” for a psychosis risk syndrome or psychosis by SIPS classification. See Table 2 for clinical characteristics of the sample.

Descriptive statistics for the continuous measures are displayed in Table 3. No significant differences in screening scores emerged between those who completed self-report forms using paper and pencil relative to those who completed forms orally due to reading difficulties. A matrix of Pearson correlations demonstrating

Discussion

The first aim of the current study was to determine agreement between parents and adolescents regarding psychosis risk symptoms. To this end, correlational data suggest that parent–youth agreement for the items surveyed within the Prime Screen is poor (r = .09, NS). Interestingly, however, parent–clinician agreement (as represented by correlations between CGPS-R scores and SOPS ratings) was substantially higher (r = .41, p < .01). Some items appeared to elicit relatively stronger agreement among

Role of funding source

This work was supported in part by funding from the Maryland Department of Health and Mental Hygiene, Mental Hygiene Administration through the 1915(c) Home and Community- Based Waiver Program Management, Workforce Development and Evaluation (OPASS# 13-10954G/M00B3400369); Baltimore Mental Health Systems; a Research Seed Funding Initiative (RSFI) grant from the University of Maryland, Baltimore County; and the Passano Foundation. The funding bodies had no further role in study design; in the

Contributors

Jason Schiffman and Gloria Reeves were the primary investigators for this study. Emily Kline conducted analyses and prepared the manuscript for publication. Caroline Schimunek, Elizabeth Thompson, and Kristin Bussell oversaw protocol implementation and assisted in preparing the manuscript. Steven Pitts served as statistical consultant.

Conflict of interest

The authors have no actual or potential conflicts of interest to disclose.

Acknowledgments

This work was supported in part by funding from the Maryland Department of Health and Mental Hygiene, Mental Hygiene Administration, and Baltimore Mental Health Systems; a Research Seed Funding Initiative (RSFI) grant from the University of Maryland, Baltimore County; and by the Division of Child and Adolescent Psychiatry within the University of Maryland.

References (28)

  • L.S. Aiken et al.

    Multiple Regression: Testing and Interpreting Interactions

    (1991)
  • T.D. Cannon et al.

    Prediction of psychosis in youth at high clinical risk: a multisite longitudinal study in North America

    Arch. Gen. Psychiatry

    (2008)
  • J. Cohen

    A power primer

    Psychol. Bull.

    (1992)
  • M.T. Compton

    Barriers to initial outpatient treatment engagement following first hospitalization for a first episode of nonaffective psychosis: a descriptive case series

    J. Psychiatr. Pract.

    (2005)
  • Cited by (16)

    • Using parent and youth reports from the Behavior Assessment System for Children, Second Edition to identify individuals at clinical high-risk for psychosis

      2014, Schizophrenia Research
      Citation Excerpt :

      Thus, including caregiver perspectives in screening may prove incrementally useful for identifying high-risk youth. Though parent–child agreement concerning psychosis-risk symptoms tends to be rather modest (Kline et al., 2013; Nugent et al., 2013), initial research investigating the utility of parent report for predicting clinician-rated psychosis-risk is promising (Kline et al., 2013; Golembo-Smith et al., in press). Especially when parent and youth accounts diverge, caregivers provide vital information about adolescents' histories, behaviors, daily activities, and functioning.

    • Identifying youth at risk for psychosis using the Behavior Assessment System for Children, Second Edition

      2013, Schizophrenia Research
      Citation Excerpt :

      The current study does not yet address the utility of the BASC-2 in identifying those at risk within broader populations; however, findings from this study, along with the broad-based nature of the BASC-2 and its relatively brief self-report format, offer a compelling rationale for testing the accuracy of the instrument for predicting CHR status beyond psychosis-specific settings. Furthermore, given that caregiver input into psychosis-risk symptoms has been shown to add incremental validity to prediction of risk (Kline et al., 2013), future studies should investigate the potential utility of adding the caregiver BASC-2 atypicality scale to predict risk. Finally, the current study reflects a cross-sectional study design.

    View all citing articles on Scopus
    View full text