Semi-structured Interview Measure of Stigma (SIMS) in psychosis: Assessment of psychometric properties

https://doi.org/10.1016/j.schres.2016.06.008Get rights and content

Abstract

Stigma is a significant difficulty for people who experience psychosis. To date, there have been no outcome measures developed to examine stigma exclusively in people with psychosis. The aim of this study was develop and validate a semi-structured interview measure of stigma (SIMS) in psychosis. The SIMS is an eleven item measure of stigma developed in consultation with service users who have experienced psychosis. 79 participants with experience of psychosis were recruited for the purposes of this study. They were administered the SIMS alongside a battery of other relevant outcome measures to examine reliability and validity. A one-factor solution was identified for the SIMS which encompassed all ten rateable items. The measure met all reliability and validity criteria and illustrated good internal consistency, inter-rater reliability, test retest reliability, criterion validity, construct validity, sensitivity to change and had no floor or ceiling effects. The SIMS is a reliable and valid measure of stigma in psychosis. It may be more engaging and acceptable than other stigma measures due to its semi-structured interview format.

Introduction

Many outcome measures have been developed to assess the impacts of stigma on service users diagnosed with a serious mental illness (SMI). However, a recent systematic review of individual outcome measures of stigma identified that all of the available measures are self-report measures and not specific to psychosis (Brohan et al., 2010). Brohan et al. (2010) identified that the three most widely-used self-report measures of stigma were; the Perceived Devaluation and Discrimination Scale (PDD; Link, 1987), the Internalised Stigma of Mental Illness Scale (ISMI; Ritsher et al., 2003), and the Self-Stigma of Mental Illness Scale (SSMIS; Corrigan et al., 2006). Brohan et al. (2010) identified that these outlined measures each lacked some form of reliability and validity; for example, none met requirements for floor and ceiling effects. Furthermore, as stated, these measures were developed for use with individuals experiencing SMI. Arguably not all SMI's are comparable in terms of their experiences of stigma which will also hinder reliability and validity of stigma measures. For example, those with a schizophrenia spectrum disorder are viewed most negatively by the public (Crisp et al., 2005, Wood et al., 2014), are most discriminated against (Dinos et al., 2004, Thornicroft et al., 2009), have the most intense internalised stigma beliefs, experience the worst social exclusion and have significantly lower levels of functioning, compared to those with a diagnosis of bipolar disorder and depression (Karidi et al., 2015, Oliveria et al., 2015).

The aim of this study was to develop a reliable and valid semi-structured interview measure of stigma in psychosis, in consultation with service users, which can be used to assess and monitor change in the impacts of stigma in psychosis. A semi-structured interview measure also provides diversity in a saturated pool of self-report measures. Furthermore, the semi-structured format of the interview measure offers the flexibility in questioning to identify culturally specific aspects of stigma, the lack of which has been a criticism of existing self-report measures (Semrau et al., 2015). Outcomes on the semi-structured interview measure of stigma (referred to henceforth as the SIMS) were compared to the ISMI (Ritsher et al., 2003) and Stigma Scale (King et al., 2007) to examine its ability to measure stigma. Furthermore, it was also compared to outcome measures of self-esteem, depression, hopelessness, shame and recovery, since research indicates that these psychological variables are also related to stigma and thus assist with validation (Birchwood et al., 2007, Corrigan et al., 2006, Link et al., 2001, Livingston and Boyd, 2010, Michail and Birchwood, 2013, Rüsch et al., 2014). The psychometric properties of the SIMS were examined and it was hypothesised that there will be good validity in comparison to other relevant measures. Specifically, it was hypothesised that the SIMS will be positively correlated with existing measures of stigma, and with measures of depression, hopelessness and shame, and negatively correlated with measures of self-esteem and recovery.

Section snippets

Literature review and initial development

Item generation for the SIMS was derived from a systematic review of qualitative literature examining service user perspectives of stigma in psychosis, as described in Wood et al. (2015). Eight studies were included in this review and were analysed using thematic synthesis (Thomas and Harden, 2008). A total of 96 initial codes were identified in the data (coding for the SIMS was conducted separately from analysis published in the systematic review due to differing aims). Codes were reviewed by

Participant demographics

A total of 79 participants took part in the study. Demographics can be seen in Table 1.

Initial data scrutiny

Individual items from the SIMS were initially screened for their relationship with one another (Table 2). If items were either high or low item correlations (< 0.200 or > 0.900) they would be removed, but none met this criteria. Items 8 (0.142 to 0.417) and 9 (− 0.175 to − 0.296) had the lowest item correlations. Items 8 and 9 also had the lowest endorsements (Table 2) but all ten items were included in the factor

Discussion

The aim of this study was to develop and examine the psychometric properties of the SIMS. Analysis demonstrated that it is a reliable and valid tool to assess change in stigma in psychosis. The SIMS was relatively quick to administer compared to other semi-structured tools and appeared to have high content validity. The SIMS is the first stigma measure specifically developed for people who experience psychosis. Having a specific target population increases the validity of the measure (Terwee et

Contributors

Dr. Lisa Wood conducted the research and wrote this manuscript as part of her PhD supervised by Dr. Rory Byrne and Professor Tony Morrison. Eilish Burke and Gabriela Enache contributed to data collection and the write up of the manuscript.

Conflict of interests

None.

Role of funding sources

No funding was given for the undertaking of this review.

References (41)

  • L. Wood et al.

    Public perceptions of stigma towards people with schizophrenia, depression, and anxiety

    Psychiatry Res.

    (2014)
  • A. Beck et al.

    The measurement of pessimism: the Hopelessness Scale

    J. Consult. Clin. Psychol.

    (1974)
  • E. Brohan et al.

    Experience of mental illness stigma, prejudice and discrimination: a review of measures

    BMC Health Serv. Res.

    (2010)
  • M. Caveleti et al.

    Is living with psychosis demoralizing? Insight, self-stigma and clinical outcomes among people with schizophrenia across 1 year

    J. Nerv. Ment. Dis.

    (2014)
  • D.R. Cook

    Measuring shame: the internalized shame scale

    Alcohol. Treat. Q.

    (1987)
  • I.B.M. Corp

    IBM SPSS Statistics for Windows, Version 20.0.

    (2011)
  • P.W. Corrigan et al.

    Reducing self-stigma by coming out proud

    Am. J. Public Health

    (2013)
  • P.W. Corrigan et al.

    The self-stigma of mental illness: implications for self-esteem and self-efficacy

    Journal of Social & Clinical Psychology

    (2006)
  • A.H. Crisp et al.

    Stigmatization of people with mental illnesses: a follow-up study within the Changing Minds Campaign of the Royal College of Psychiatrists

    World Psychiatry

    (2005)
  • S. Dinos et al.

    Stigma: the feelings and experiences of 46 people with mental illness

    Br. J. Psychiatry

    (2004)
  • Cited by (0)

    View full text