Schizophrenia Research
Volume 92, Issue 1 , Pages 63-67 , May 2007

PANSS rater training using Internet and videoconference: Results from a pilot study

  • Kenneth A. Kobak

      Affiliations

    • MedAvante, Inc., 7601 Ganser Way, Madison, WI 53719, United States
    • Corresponding Author InformationCorresponding author. Tel.: +1 608 239 3919; fax: +1 608 829 1965.
    • ,
  • Mark G.A. Opler

      Affiliations

    • Columbia University and the PANSS Institute, LLC, 320 W. 37th Street, Floor 12A, Suite 13B, New York, NY 10018, United States
    • ,
  • Nina Engelhardt

      Affiliations

    • MedAvante, Inc., 7601 Ganser Way, Madison, WI 53719, United States

Received 30 October 2006 ,Revised 29 December 2006 ,Accepted 4 January 2007.

References 

  1. Badger LW, deGruy F, et al. Stability of standardized patients' performance in a study of clinical decision making. Fam. Med. 1995;27(2):126–131
  2. Bell V, Halligan PW, et al. Diagnosing delusions: a review of inter-rater reliability. Schizophr. Res. 2006;86(1–3):76–79
  3. Bullinger A, Targum SD. Rater experience in CNS clinical trials. In: National Institute of Mental Health, New Clinical Drug Evaluation Unit, 44th Annual Meeting, Phoenix, AZ. 2004;
  4. Colliver JA, Swartz MH. Assessing clinical performance with standardized patients. JAMA. 1997;278(9):790–791
  5. De Champlain AF, Margolis MJ, et al. Standardized patients' accuracy in recording examinees' behaviors using checklists. Acad. Med. 1997;72(10 Suppl 1):S85–S87
  6. DeBrota D, Demitrack M, et al. A comparison between interactive voice response system-administered HAM-D and clinician-administered HAM-D in patients with major depressive episode. In: National Institute of Mental Health, New Clinical Drug Evaluation Unit, 39th Annual Meeting, Boca Raton, FL. 1999;
  7. Glaudin V, Smith W, et al. Discriminating placebo and drug in generalized anxiety disorder (GAD) trials: single vs. multiple raters. Psychopharmacol. Bull. 1994;32(2):175–178
  8. Jeglic, E., Kobak, K.A., in press. “A novel approach to rater training and certification in multi-national clinical trials”. Int. Clin. Psychopharmacol.
  9. Kalali A, West MD, et al. Multi-national qualification of raters on the PANSS rating scale. In: International Congress on Schizophrenia Research, Colorado Springs, CO. 2003;
  10. Kay SR, Fiszbein A, et al. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr. Bull. 1987;13(2):261–276
  11. Kay SR, Opler LA, et al. The positive and negative syndrome scale (PANSS): rationale and standardisation. Br. J. Psychiatr., Suppl. 1989;(7):59–67
  12. Kay SR, Opler LA, et al. SCID-PANSS: two-tier diagnostic system for psychotic disorders. Compr. Psychiatry. 1991;32(4):355–361
  13. Kobak KA, Engelhardt N, et al. Enriched rater training using Internet based technologies: a comparison to traditional rater training in a multi-site depression trial. J. Psychiatr. Res. 2006;40(3):192–199
  14. Kobak KA, Engelhardt N, et al. Rater training in multicenter clinical trials: issues and recommendations. J. Clin. Psychopharmacol. 2004;24:113–117
  15. Kobak KA, Feiger AD, et al. Interview quality and signal detection in clinical trials. Am. J. Psychiatry. 2005;162(3):628
  16. Kobak KA, Lipsitz JD, et al. A new approach to rater training and certification in a multicenter clinical trial. J. Clin. Psychopharmacol. 2005;25(5):407–412
  17. Leon AC, Marzak PM. More reliable outcome measures can reduce sample size requirements. Arch. Gen. Psychiatry. 1995;52(10):867–871
  18. Lipsitz J, Kobak KA, et al. The Rater Applied Performance Scale (RAPS): development and reliability. Psychiatry Res. 2004;127:147–155
  19. Londborg P, Bielski RJ, et al. Is the single-rater design superior in clinical trials of anxiety?. In: National Institute of Mental Health, New Clinical Drug Evaluation Unit, 45th Annual Meeting, Boca Raton, FL. 2005;
  20. Muller MJ, Rossbach W, et al. Evaluation of standardized rater training for the Positive and Negative Syndrome Scale (PANSS). Schizophr. Res. 1998;32(3):151–160
  21. Muller MJ, Wetzel H. Improvement of inter-rater reliability of PANSS items and subscales by a standardized rater training. Acta Psychiatr. Scand. 1998;98(2):135–139
  22. Peabody JW, Luck J, et al. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13):1715–1722
  23. Peralta V, Cuesta MJ. Psychometric properties of the positive and negative syndrome scale (PANSS) in schizophrenia. Psychiatry Res. 1994;53(1):31–40
  24. Pieters HM, Touw-Otten FW, et al. Simulated patients in assessing consultation skills of trainees in general practice vocational training: a validity study. Med. Educ. 1994;28(3):226–233
  25. Porter R, Frampton C, et al. Randomized controlled trials in psychiatry. Part 1: methodology and critical evaluation. Aust. N. Z. J. Psychiatry. 2003;37(3):257–264
  26. Smith W, Londborg P, et al. Multiple raters in clinical trials: a better research design?. In: NCDEU, 44th Annual Meeting, Phoenix, AZ. 2004;
  27. Targum SD. The importance of rater experience on ratings competence in CNS trials. In: 158th Annual Meeting, American Psychiatric Association, Atlanta, GA. 2005;
  28. Thase ME. Studying new antidepressants: if there were a light at the end of the tunnel, could we see it?. J. Clin. Psychiatry. 2002;63(Suppl 2):24–28
  29. White L, Harvey PD, et al. Empirical assessment of the factorial structure of clinical symptoms in schizophrenia. A multisite, multimodel evaluation of the factorial structure of the Positive and Negative Syndrome Scale. The PANSS Study Group. Psychopathology. 1997;30(5):263–274
  30. Yoshino A, Shigemura J, et al. Telepsychiatry: assessment of televideo psychiatric interview reliability with present- and next-generation Internet infrastructures. Acta Psychiatr. Scand. 2001;104(3):223–226
  31. Zarate CA, Weinstock L, et al. Applicability of telemedicine for assessing patients with schizophrenia: acceptance and reliability. J. Clin. Psychiatry. 1997;58(1):22–25

PII: S0920-9964(07)00063-1

doi: 10.1016/j.schres.2007.01.011

Schizophrenia Research
Volume 92, Issue 1 , Pages 63-67 , May 2007

Article Tools