Development and validation of multivariable prediction models of remission, recovery, and quality of life outcomes in people with first episode psychosis: a machine learning approach (original) (raw)
Related papers
Schizophrenia Bulletin, 2021
Background Validated clinical prediction models of short-term remission in psychosis are lacking. Our aim was to develop a clinical prediction model aimed at predicting 4−6-week remission following a first episode of psychosis. Method Baseline clinical data from the Athens First Episode Research Study was used to develop a Support Vector Machine prediction model of 4-week symptom remission in first-episode psychosis patients using repeated nested cross-validation. This model was further tested to predict 6-week remission in a sample of two independent, consecutive Danish first-episode cohorts. Results Of the 179 participants in Athens, 120 were male with an average age of 25.8 years and average duration of untreated psychosis of 32.8 weeks. 62.9% were antipsychotic-naïve. Fifty-seven percent attained remission after 4 weeks. In the Danish cohort, 31% attained remission. Eleven clinical scale items were selected in the Athens 4-week remission cohort. These included the Duration of Un...
npj Schizophrenia
Schizophrenia and related disorders have heterogeneous outcomes. Individualized prediction of long-term outcomes may be helpful in improving treatment decisions. Utilizing extensive baseline data of 523 patients with a psychotic disorder and variable illness duration, we predicted symptomatic and global outcomes at 3-year and 6-year follow-ups. We classified outcomes as (1) symptomatic: in remission or not in remission, and (2) global outcome, using the Global Assessment of Functioning (GAF) scale, divided into good (GAF ≥ 65) and poor (GAF
Schizophrenia
While research focus remains mainly on psychotic symptoms, it is questionable whether we are placing enough emphasis on improving the quality of life (QoL) of schizophrenia patients. To date, the predictive power of QoL remained limited. Therefore, this study aimed to accurately predict the QoL within schizophrenia using supervised learning methods. The authors report findings from participants of a large randomized, double-blind clinical trial for schizophrenia treatment. Potential predictors of QoL included all available and non-redundant variables from the dataset. By optimizing parameters, three linear LASSO regressions were calculated (N = 697, 692, and 786), including 44, 47, and 41 variables, with adjusted R-squares ranging from 0.31 to 0.36. Best predictors included social and emotion-related symptoms, neurocognition (processing speed), education, female gender, treatment attitudes, and mental, emotional, and physical health. These results demonstrate that machine learning i...
JAMA psychiatry, 2018
Social and occupational impairments contribute to the burden of psychosis and depression. There is a need for risk stratification tools to inform personalized functional-disability preventive strategies for individuals in at-risk and early phases of these illnesses. To determine whether predictors associated with social and role functioning can be identified in patients in clinical high-risk (CHR) states for psychosis or with recent-onset depression (ROD) using clinical, imaging-based, and combined machine learning; assess the geographic, transdiagnostic, and prognostic generalizability of machine learning and compare it with human prognostication; and explore sequential prognosis encompassing clinical and combined machine learning. This multisite naturalistic study followed up patients in CHR states, with ROD, and with recent-onset psychosis, and healthy control participants for 18 months in 7 academic early-recognition services in 5 European countries. Participants were recruited ...
The promise of machine learning in predicting treatment outcomes in psychiatry
World Psychiatry, 2021
For many years, psychiatrists have tried to understand factors involved in response to medications or psychotherapies, in order to personalize their treatment choices. There is now a broad and growing interest in the idea that we can develop models to personalize treatment decisions using new statistical approaches from the field of machine learning and applying them to larger volumes of data. In this pursuit, there has been a paradigm shift away from experimental studies to confirm or refute specific hypotheses towards a focus on the overall explanatory power of a predictive model when tested on new, unseen datasets. In this paper, we review key studies using machine learning to predict treatment outcomes in psychiatry, ranging from medications and psychotherapies to digital interventions and neurobiological treatments. Next, we focus on some new sources of data that are being used for the development of predictive models based on machine learning, such as electronic health records, smartphone and social media data, and on the potential utility of data from genetics, electrophysiology, neuroimaging and cognitive testing. Finally, we discuss how far the field has come towards implementing prediction tools in real-world clinical practice. Relatively few retrospective studies to-date include appropriate external validation procedures, and there are even fewer prospective studies testing the clinical feasibility and effectiveness of predictive models. Applications of machine learning in psychiatry face some of the same ethical challenges posed by these techniques in other areas of medicine or computer science, which we discuss here. In short, machine learning is a nascent but important approach to improve the effectiveness of mental health care, and several prospective clinical studies suggest that it may be working already.
Models to predict relapse in psychosis: A systematic review
PLOS ONE, 2017
Background There is little evidence on the accuracy of psychosis relapse prediction models. Our objective was to undertake a systematic review of relapse prediction models in psychosis. Method We conducted a literature search including studies that developed and/or validated psychosis relapse prediction models, with or without external model validation. Models had to target people with psychosis and predict relapse. The key databases searched were; Embase, Medline, Medline In-Process Citations & Daily Update, PsychINFO, BIOSIS Citation Index, CINAHL, and Science Citation Index, from inception to September 2016. Prediction modelling studies were assessed for risk of bias and applicability using the PROBAST tool. Results There were two eligible studies, which included 33,088 participants. One developed a model using prodromal symptoms and illness-related variables, which explained 14% of relapse variance but was at high risk of bias. The second developed a model using administrative data which was moderately discriminative (C = 0.631) and associated with relapse (OR 1.11 95% CI 1.10, 1.12) and achieved moderately discriminative capacity when validated (C = 0.630). The risk of bias was low. Conclusions Due to a lack of high quality evidence it is not possible to make any specific recommendations about the predictors that should be included in a prognostic model for relapse. For instance, it is unclear whether prodromal symptoms are useful for predicting relapse. The use of routine data to develop prediction models may be a more promising approach, although we could not empirically compare the two included studies.
Prediction of psychosis: model development and internal validation of a personalized risk calculator
Psychological Medicine
Background Over the past two decades, early detection and early intervention in psychosis have become essential goals of psychiatry. However, clinical impressions are insufficient for predicting psychosis outcomes in clinical high-risk (CHR) individuals; a more rigorous and objective model is needed. This study aims to develop and internally validate a model for predicting the transition to psychosis within 10 years. Methods Two hundred and eight help-seeking individuals who fulfilled the CHR criteria were enrolled from the prospective, naturalistic cohort program for CHR at the Seoul Youth Clinic (SYC). The least absolute shrinkage and selection operator (LASSO)-penalized Cox regression was used to develop a predictive model for a psychotic transition. We performed k-means clustering and survival analysis to stratify the risk of psychosis. Results The predictive model, which includes clinical and cognitive variables, identified the following six baseline variables as important pred...
Schizophrenia Bulletin Open, 2021
Psychosis is a major mental illness with first onset in young adults. The prognosis is poor in around half of the people affected, and difficult to predict. The few tools available to predict prognosis have major weaknesses which limit their use in clinical practice. We aimed to develop and validate a risk prediction model of symptom nonremission in first-episode psychosis. Our development cohort consisted of 1027 patients with first-episode psychosis recruited between 2005 and 2010 from 14 early intervention services across the National Health Service in England. Our validation cohort consisted of 399 patients with first-episode psychosis recruited between 2006 and 2009 from a further 11 English early intervention services. The one-year nonremission rate was 52% and 54% in the development and validation cohorts, respectively. Multivariable logistic regression was used to develop a risk prediction model for nonremission, which was externally validated. The prediction model showed go...
Schizophrenia research, 2017
There has been much recent debate concerning the relative clinical utility of symptom dimensions versus conventional diagnostic categories in patients with psychosis. We investigated whether symptom dimensions rated at presentation for first-episode psychosis (FEP) better predicted time to first remission than categorical diagnosis over a four-year follow-up. The sample comprised 193 FEP patients aged 18-65years who presented to psychiatric services in South London, UK, between 2006 and 2010. Psychopathology was assessed at baseline with the Positive and Negative Syndrome Scale and five symptom dimensions were derived using Wallwork/Fortgang's model; baseline diagnoses were grouped using DSM-IV codes. Time to start of first remission was ascertained from clinical records. The Bayesian Information Criterion (BIC) was used to find the best fitting accelerated failure time model of dimensions, diagnoses and time to first remission. Sixty percent of patients remitted over the four y...
Exploring specific predictors of psychosis onset over a 2‐year period: A decision‐tree model
Early Intervention in Psychiatry, 2021
Aim: The fluctuating symptoms of clinical high risk for psychosis hamper conversion prediction models. Exploring specific symptoms using machine-learning has proven fruitful in accommodating this challenge. The aim of this study is to explore specific predictors and generate atheoretical hypotheses of onset using a close-monitoring, machine-learning approach. Methods: Study participants, N = 96, mean age 16.55 years, male to female ratio 46:54%, were recruited from the Prevention of Psychosis Study in Rogaland, Norway. Participants were assessed using the Structured Interview for Psychosis Risk Syndromes (SIPS) at 13 separate assessment time points across 2 years, yielding 247 specific scores. A machine-learning decision-tree analysis (i) examined potential SIPS predictors of psychosis conversion and (ii) hierarchically ranked predictors of psychosis conversion. Results: Four out of 247 specific SIPS symptom scores were significant: (i) reduced expression of emotion at baseline, (ii) experience of emotions and self at 5 months, (iii) perceptual abnormalities/hallucinations at 3 months and (iv) ideational richness at 6 months. No SIPS symptom scores obtained after 6 months of follow-up predicted psychosis. Conclusions: Study findings suggest that early negative symptoms, particularly those observable by peers and arguably a risk factor for social exclusion, were predictive of psychosis. Self-expression and social behaviour might prove relevant entry points for early intervention in psychosis and psychosis risk. Testing study results in larger samples and at other sites is warranted.