EMR-integrated CDSS improves diagnostic concordance for mood disorders among psychiatrists

A randomized controlled trial investigated the impact of an EMR-integrated clinical decision support system (CDSS) on diagnostic concordance among 72 psychiatrists. Psychiatrists were randomly assigned to either use the CDSS or serve as non-assisted controls, with stratification by seniority level. The primary outcome was interrater reliability assessed using Gwet's AC1.

The CDSS intervention significantly improved diagnostic concordance overall. This improvement was driven by dramatic gains for mood disorders (Major Depressive Disorder and Bipolar Disorder), while the system's impact was negligible for Schizophrenia, which showed high baseline agreement regardless of intervention. Seniority was identified as a critical factor: mid-level psychiatrists demonstrated higher reliability than low-seniority counterparts, and the CDSS impact was negligible among high-seniority psychiatrists who achieved perfect concordance with or without the system.

Safety and tolerability data were not reported. Key limitations include the absence of reported effect sizes, absolute numbers, confidence intervals, and details about the study setting and follow-up period. The findings underscore the potential of EMR-integrated CDSS to enhance diagnostic consistency, particularly by standardizing evaluation processes for less-experienced clinicians facing complex mood disorder differentials. However, the system's negligible impact on Schizophrenia diagnosis and among highly experienced clinicians suggests its utility may be condition- and experience-specific.