A Double-blind Randomized Controlled Trial of Olanzapine Plus Sertraline vs Olanzapine Plus Placebo for Psychotic Depression (original) (raw)

Context Evidence for the efficacy of combination pharmacotherapy has been limited and without positive trials in geriatric patients with major depression (MD) with psychotic features.

Objectives To compare remission rates of MD with psychotic features in those treated with a combination of atypical antipsychotic medication plus a serotonin reuptake inhibitor with those treated with antipsychotic monotherapy; and to compare response by age.

Design Twelve-week, double-blind, randomized, controlled trial.

Setting Clinical services of 4 academic sites.

Patients Two hundred fifty-nine subjects with MD with psychotic features randomized by age (<60 or ≥60 years) (mean [standard deviation (SD)], 41.3 [10.8] years in 117 younger adults vs 71.7 [7.8] years in 142 geriatric participants).

Intervention Target doses of 15 to 20 mg of olanzapine per day plus masked sertraline or placebo at 150 to 200 mg per day.

Main Outcome Measure Remission rates of MD with psychotic features.

Results Treatment with olanzapine/sertraline was associated with higher remission rates during the trial than olanzapine/placebo (odds ratio [OR], 1.28; 95% confidence interval [CI], 1.12-1.47; P < .001); 41.9% of subjects who underwent combination therapy were in remission at their last assessment compared with 23.9% of subjects treated with monotherapy (χ21 = 9.53, P = .002). Combination therapy was comparably superior in both younger (OR, 1.25; 95% CI, 1.05-1.50; P = .02) and older (OR, 1.34; 95% CI, 1.09-1.66; P = .01) adults. Overall, tolerability was comparable across age groups. Both age groups had significant increases in cholesterol and triglyceride concentrations, but statistically significant increases in glucose occurred only in younger adults. Younger adults gained significantly more weight than older subjects (mean [SD], 6.5 [6.6] kg vs 3.3 [4.9] kg, P = .001).

Conclusions Combination pharmacotherapy is efficacious for the treatment of MD with psychotic features. Future research must determine the benefits vs risks of continuing atypical antipsychotic medications beyond 12 weeks.

Trial Registration clinicaltrials.gov Identifier: NCT00056472

Major depression (MD) with psychotic features is a severe but potentially treatable disorder.1 Epidemiological studies2,3 and studies of large samples of psychiatric patients4,5 indicate that 15% to 20% of individuals with major depression have psychotic features. Higher prevalence rates approximating 45% have been reported among elderly inpatients with depression.6,7 Major depression with psychotic features is associated with poorer short-term outcomes, a longer time to recovery, greater residual disability, and greater mortality than MD without psychosis.2,4,5,8,9

Expert guidelines10,11 recommend treatment of MD with psychotic features with either electroconvulsive therapy (ECT) or pharmacotherapy that combines an antidepressant with an antipsychotic medication. The guidelines were based on studies demonstrating low response rates of MD with psychotic features to tricyclic antidepressant (TCA) monotherapy12-16 and results from both a small controlled trial16 and pooled analyses17-20 favoring combination treatment or ECT.

A recent meta-analysis demonstrating that combination therapy was superior to antipsychotic monotherapy included the only 3 controlled trials available.21 The limited evidence for the efficacy of combination treatment for MD with psychotic features may contribute to the underrecognition of delusions in patients with MD22 and the low use of antipsychotic medications to treat MD with psychotic features in community settings.23,24 In contrast to trials in young adults,16 geriatric trials have not demonstrated greater efficacy for combined TCA/conventional antipsychotic therapy compared with TCA/placebo for either acute25 or post-ECT continuation treatment26 but did demonstrate poorer tolerability of combination therapy.

The present study investigated the efficacy of combination treatment in patients with systematically diagnosed MD with psychotic features across a broad spectrum of illness severity and compared the efficacy and tolerability between persons aged 18 to 59 years and those aged 60 years and older. We compared olanzapine (an atypical antipsychotic medication reported to have acute antidepressant effects in placebo-controlled trials27,28) combined with placebo relative to olanzapine combined with sertraline hydrochloride, a selective serotonin reuptake inhibitor antidepressant reported to be effective for MD with psychotic features.29 The design encouraged aggressive dosing of both medications during a 12-week trial to maximize remission rates that could be compared with the high remission rates associated with ECT.14,17,18,30,31 The following hypotheses were tested: whether (1) combination therapy would be more effective than atypical antipsychotic monotherapy; (2) younger adults would achieve higher remission rates than older adults; and (3) younger adults would tolerate treatment better than older adults.

Patients aged 18 years or older who were admitted to the inpatient or ambulatory services of the 4 participating academic sites between December 2002 and June 2007 were eligible for recruitment. The institutional review boards of the participating institutions and a data safety monitoring board at the National Institute of Mental Health approved study consent forms and monitored the study's progress. Informed consent was obtained from all subjects, either directly or through locally approved surrogate consent procedures. Strategies to identify eligible patients varied by institution and included review of new admissions, advertisements, and direct referrals by community psychiatrists.

Potentially eligible consenting subjects were assessed with the Structured Interview for Clinical Diagnosis32 to assure that DSM-IV-TR1 criteria for unipolar MD with psychotic features were met. Inclusion required the presence of at least 1 delusional belief (a fixed idea that was held contrary to the laws of logic), a score of 2 or higher on 1 of the conviction items of the Delusional Assessment Scale,33 and a score of 3 or higher on the delusion severity rating item of the Schedule of Affective Disorders and Schizophrenia (SADS).34 A SADS delusion severity score of 3 is assigned when there is no more than a transient ability to consider the implausibility of an irrational belief. The presence of at least 1 clearly defined delusion was required, with or without hallucinations, as studies of MD with psychotic features have generally considered delusional depression and MD with psychotic features to be synonymous.35-37 The presence of moderately severe to severe depression was assured by requiring scores of 21 or higher on the 17-item Hamilton Depression Scale (HAM-D),38 which was administered using the GRID-HAM-D method.39

This study focused on the treatment of MD with psychotic features rather than syndromes in which psychotic and depressive symptoms accompany dementia. Therefore, patients with dementia or histories of impaired cognition prior to the current depressive episode were excluded. Patients were excluded if they met criteria for another Axis I psychotic or mood disorder; current body dysmorphic disorder or obsessive-compulsive disorder; or substance abuse during the preceding 3 months. Additional exclusion criteria were the presence of an unstable medical condition that might interfere with completion of the 12-week trial; a neurological disease that might affect neuromuscular functioning, such as Parkinson disease; and ongoing need for medications known to cause depression or psychosis. Patients with known hyperlipidemia or diabetes mellitus, including insulin-dependent diabetes, were allowed to enroll if their metabolic conditions were stable. Patients were excluded if immediate ECT was indicated because of their refusal to eat or drink or imminent risk for suicide. Patients who demonstrated current suicidal ideation without immediate intent and those who had made a suicide attempt during the current episode were allowed to begin the study on an inpatient basis. Screening also involved baseline laboratory assessments, including measurement of thyroid-stimulating hormone, folate, and B12 concentrations; an electrocardiogram; and a toxicology screen to detect undisclosed illicit drug use. Finally, patients were excluded if they had received 15 mg or more of olanzapine per day for a minimum of 4 weeks during the current episode or if they were benefiting from their current psychotropic medications regimen.

Eligible subjects were randomized to sertraline plus olanzapine or olanzapine plus placebo using computer-generated lists, with investigators and raters blind to treatment assignments. Randomization was stratified by site and age, with a block size of 4. Subjects taking antidepressant or antipsychotic medications at entry had these tapered prior to randomization, though a washout period was not enforced because of the severity of illness anticipated in study participants. Subjects began taking 5 mg of olanzapine per day and 50 mg of sertraline hydrochloride or matching placebo per day, with dose increases permitted every 3 days as tolerated. Frail elderly subjects initially received 2.5 mg of olanzapine and 25 mg of sertraline or placebo (one-half of a 50-mg or placebo tablet). Olanzapine was administered openly, sertraline and placebo under double-blind conditions. An attempt was made to reach minimum doses of 10 mg of olanzapine per day and 100 mg of sertraline or placebo per day before the end of week 1. Doses were increased to 15 mg of olanzapine per day and 150 mg of sertraline or placebo per day during week 2, with further increases allowed to a maximum of 20 mg of olanzapine per day and 200 mg of sertraline per day, as tolerated, beginning in week 3. Slower titration or temporary dose reductions of 1 or both medications was allowed if adverse effects were suspected; however, subsequent dose increases were required to attempt to achieve minimum daily target doses of 15 mg of olanzapine per day and 150 mg of sertraline or placebo per day. For data analytic purposes, the subject's dose was considered the last one taken for a minimum of 7 days. Adjunctive lorazepam of up to 4 mg per day was allowed to control anxiety or agitation, and up to 2 mg of benztropine per day to control extrapyramidal symptoms. No other psychotropic drugs were allowed.

Baseline assessments were completed within 7 days of obtaining consent. Follow-up research assessments were conducted weekly for the first 6 weeks and then every other week until week 12 or termination. Research assessments included overall symptom severity using the Clinical Global Impressions, Severity of Illness Scale (CGI-S),40 HAM-D, assessments for delusional ideation using the Delusional Assessment Scale and the SADS delusional item, the Brief Psychiatric Rating Scale,41 and the Scale for Positive Symptoms.42 At baseline, the Cumulative Illness Burden Scale43 was used to assess general medical burden, and the Mini-Mental State Examination44 was used to assess global cognitive functioning. Raters were trained to achieve adequate reliability prior to conducting study assessments and interrater reliability reassessed annually thereafter.

Remission was defined as a HAM-D score of 10 or lower at 2 consecutive assessments. This criterion was applied to assure that remission from mood symptoms was sustained and to allow for comparability with ECT studies that typically use a 2-week HAM-D criterion.31 Remission also required the absence of delusions (SADS delusional item score of 1) at the second remission of depression assessment. A 1-week remission of delusions criterion was applied to make the remission of psychosis outcome compatible with the standard duration criterion used in MD with psychotic features pharmacotherapy trials.21 Subjects who were not delusional at both of 2 consecutive HAM-D assessments were considered remitted at both points; subjects who had been delusional at the first of the HAM-D assessments were considered to be remitted at the second assessment only, and subjects who were not delusional at the first assessment but had SADS scores higher than 1 at the second were classified as not remitted at either assessment. A HAM-D cutoff of 10 or lower was used because this has been a standard in geriatric antidepressant trials45,46 and ECT studies.31 Subjects who achieved a HAM-D score of 10 or lower without delusions for the first time at week 12 were assessed again at week 13 to determine whether the 2-week duration criterion was met.

Investigators were allowed to withdraw subjects for either clinically significant worsening or insufficient clinical improvement after 5 weeks of randomized treatment. Insufficient clinical response was operationally predefined as having both a CGI-Improvement scale score of 2 or less (no or minimal improvement) and a CGI-S score of 4 or more (moderately or more severely ill). Discontinuations initiated by subjects were categorized as perceived poor response, poor tolerability, or withdrawal of consent.

Safety and tolerability assessments considered the incidence of adverse events and evaluations conducted by the investigators. Adverse events were identified at each visit using research assistant interviews and subject reports. Increases of 2 points on a Udvalg for Kliniske Undersogelser (UKU) scale item47 or scores of 3 on an item were classified as adverse events. Research psychiatrists quantified extrapyramidal symptoms using the Simpson Angus Scale48 and incident akathisia using the Barnes Akathisia Scale.49 Tardive dyskinesia was assessed using the Abnormal Involuntary Movement Scale,50 applying modified Schooler-Kane criteria51 without requiring a 2-week duration.

Comparisons of baseline variables between the 2 treatment groups were made using χ2 and t tests. Baseline factors that differed significantly between the 2 treatment conditions were identified to be used in sensitivity analyses of the efficacy results. We applied intent-to-treat principles to include all randomized subjects in the primary and secondary efficacy analyses. The primary analyses of treatment efficacy examined the longitudinal binary outcome of remission using mixed-effects logistic regression52 with a random intercept that included treatment and time (ie, weeks from baseline) as fixed effects and a treatment × time interaction effect. The hypothesized difference in remission rates between the 2 treatment conditions over time was assessed by testing for the significance of an interaction between treatment assignment and time in the trial. The hypothesized age effect on treatment efficacy was tested by assessing the significance of a 3-way interaction between treatment, age, and time in a full model. The model used in the efficacy analysis was applied subsequently in each age group to assess the consistency of the efficacy results across the age groups. Also, site × treatment interactions were tested to evaluate site differences in efficacy.

Tolerability comparisons examined the incidence of adverse events and discontinuation rates due to poor tolerability in the 2 treatment arms and the 2 age groups. The young and old subgroups were compared for changes in metabolic parameters and for mean and maximum extrapyramidal symptoms scores during the trial. Secondary analyses compared remission rates between the 2 groups among subjects who completed the 12-week trial using the χ2 test and changes in CGI-S score using mixed-effects linear regression models. Exploratory analyses for group differences in changes on HAM-D scores and SADS delusional rating item scores used mixed-effects linear regression.

We assessed data distribution for normality prior to conducting analyses. When necessary, data transformation or nonparametric tests were applied. Each statistical test used a 2-tailed α level of .05. Data are expressed as mean (standard deviation [SD]) except where noted.

Sample size and power calculations

Based on predicted remission rates of 40% in subjects who underwent combination therapy and 20% in subjects who underwent monotherapy, 260 subjects randomized into the 2 treatment groups would provide more than 80% power at a 2-tailed α level of .05. This power analysis was based on a simulation study using the mixed-effects model under an anticipated total attrition rate of 45% and a within-subject outcome correlation of 0.5 or less.

Of the 375 patients who consented to participation, 65 (17.3%) were found not to meet criteria for unipolar MD with psychotic features. As illustrated in Figure 1, 51 of the 310 subjects who met psychiatric inclusion criteria either withdrew consent, met an exclusion criterion, or were excluded for other reasons prior to randomization. The intent-to-treat sample consisted of 259 subjects, of whom 129 were randomized to combination treatment and 130 to olanzapine plus placebo.

Clinical and sociodemographic characteristics of the randomized sample are presented in Table 1. The 2 groups were comparable for most major baseline variables, but differed by race and inpatient status at study entry. Among subjects in the olanzapine/sertraline group, 85.3% were white, 13.2% were African American, and 1.6% were Asian, compared with 83.1%, 9.2%, and 7.7%, respectively, in the olanzapine/placebo group (χ21 = 6.21, P = .05). Frequencies of inpatient status at study entry were 75.2% in the olanzapine/sertraline group and 63.1% in the olanzapine/placebo group (χ23 = 7.8, P = .05). The high baseline HAM-D and Brief Psychiatric Rating Scale scores and 18.5% frequency of suicide attempts during the current episode document the severity of illness in study participants. The mean ages of the 117 younger and 142 older subjects were 41.3 years (10.8 years) and 71.7 years (7.8 years), respectively.

At the end of the study, mean daily doses of sertraline or placebo (168.9 mg [44.1 mg] vs 169.7 mg [35.0 mg]; _t_229 = 0.15; P = .88) and olanzapine (14.3 mg [5.3 mg] vs 14.7 mg [4.7 mg]; _t_234 = 0.55; P = .59) were comparable between the olanzapine/placebo and olanzapine/sertraline treatment groups, respectively. However, younger subjects received significantly higher mean daily doses of olanzapine compared with older subjects (15.7 mg [4.7 mg] vs 13.4 mg [5.1 mg]; _t_237 = 3.53; P < .001). Younger subjects also tended to receive higher mean daily sertraline/placebo doses (174.3 mg [34.1 mg] vs 165.7 mg [43.4 mg]; _t_237 = 1.72; P = .08), but the difference was not statistically significant.

Primary efficacy analysis

Olanzapine/Sertraline vs Olanzapine/Placebo

The treatment × time effect was statistically significant (odds ratio [OR], 1.28; 95% confidence interval [CI], 1.12-1.47; P < .001), demonstrating that the increase in rates of remission over the course of the trial was greater in the olanzapine/sertraline group than in the olanzapine monotherapy group. The significantly greater efficacy of combination therapy was apparent between weeks 8 and 12 (Figure 2). Fifty-four of the 129 participants (41.9%) assigned to combination therapy were in remission at their last assessment compared with 31 of the 130 (23.9%) who received olanzapine monotherapy (χ21 = 9.53, _P_ = .002). Expressed as number needed to treat, 1 additional patient achieved remission with combination treatment than with olanzapine monotherapy for every 5.5 patients treated. The effect of treatment × site interactions on efficacy were not significant (log-likelihood ratio = 4.1, _df_ = 3, _P_ = .25). Treatment interactions with the hypothesized confounding variables of race (log-likelihood ratio = 0.0, _df_ = 1, _P_ > .99) and inpatient status (log-likelihood ratio = 0.1, df = 1, P > .75) were not significant either.

The nonsignificant 3-way interaction between age, treatment, and time (OR, 1.05; 95% CI, 0.80-1.37; P = .75) indicated that the treatment × time effect was comparable across age groups. Subgroup analyses showed that the treatment × time effect was statistically significant and comparable in the younger (OR, 1.25; 95% CI, 1.05-1.50; P = .02) and older subgroups (OR, 1.34; 95% CI, 1.09-1.66; P < .01).

Secondary efficacy analyses

Differences in CGI-S scores in the intent-to-treat sample significantly favored the olanzapine/sertraline group (_F_1,1460 = 5.63; P = .02). Subjects allocated to olanzapine/sertraline in the intent-to-treat sample also had significantly lower HAM-D scores than those randomized to olanzapine/placebo at most points and during the trial overall (_F_1,1722 = 14.32; P < .001) (Figure 3). However, decreases in the score for the SADS delusional item were comparable in the 2 treatment groups without significant differences at any point (_F_9,1720 = 1.25; P = .26).

The planned analysis of study completers demonstrated that the remission rate was significantly greater in the subjects randomized to olanzapine/sertraline who continued to week 12 than in those randomized to olanzapine/placebo (66.7% vs 49.2%; χ21 = 4.40; P = .04).

Attrition and tolerability

The overall attrition rate was 45.2% (Figure 1), with 88 of 117 noncompleters (75.2%) exiting the trial at or before the midpoint at week 6. Attrition was significantly lower in the olanzapine/sertraline than in olanzapine/placebo group (37.2% vs 53.1%; χ21 = 6.58; P = .01). The frequencies of reasons for attrition in the 2 treatment groups were statistically comparable. Fourteen percent of subjects randomized to olanzapine/sertraline compared with 21.5% of subjects randomized to olanzapine/placebo withdrew themselves from the study (χ21 = 2.55, P = .11); 12.4% vs 10.0% of subjects in the combination therapy vs the monotherapy group, respectively, were withdrawn because of significant clinical worsening (χ21 = 0.38, P = .54); 4.7% vs 10.0% were withdrawn because of insufficient response (χ21 = 2.73, P = .1); and 3.1% vs 6.9% discontinued treatment because of intolerable adverse effects (χ21 = 1.98, P = .16). Similarly, there were no significant treatment group differences in rates of adverse events that occurred in more than 10% of study subjects, with 54.3% of subjects treated with olanzapine/sertraline meeting the UKU for significant weight gain (defined as an increase of ≥2.70 kg during the previous month) compared with 53.4% of subjects randomized to receive olanzapine/placebo (χ21 = 0.005, P = .95); 28.7% vs 30.8% of subjects in the combination therapy vs the monotherapy group, respectively, experienced somnolence/sedation (χ21 = 0.14, P = .72); 15.5% vs 12.3% experienced at least 1 fall (χ21 = 0.55, P = .46); and 15.5% vs 10.0% had orthostatic light-headedness (χ21 = 1.76, P = .84).

Serious adverse events involving increased suicidal thinking or behavior occurred in 5 subjects (2%), 4 of whom had been treated with olanzapine/sertraline, including a completed suicide at week 4 (3.1% vs 0.7%; Fisher exact, P = .21).

Table 2 summarizes the comparisons between younger and older subjects for the most common and clinically significant adverse events. Younger subjects were significantly more likely than older subjects to meet UKU criteria for significant weight gain (65.0% vs 45.1%, χ21 = 10.21, P = .001) but less likely to experience pedal edema (4.3% vs 13.4%, χ21 = 6.33, P = .01). There were no differences in incident akathisia or tardive dyskinesia by age group. Although older subjects had higher extrapyramidal symptom scores during the trial, the interaction between age group and extrapyramidal symptom severity was not significant (_F_3,498 = 1.89, P = .21). Two younger subjects and 3 older subjects were prescribed adjunctive benztropine (Fisher exact test, P > .99). Rates of attrition due to poor tolerability in younger and older subjects were statistically comparable (4.3% vs 5.6%, respectively, χ21 = 0.25, P = .62).

Changes in metabolic parameters in the younger and older subjects from baseline to week 12 or termination are shown in Figure 4. Cholesterol and triglyceride concentrations increased significantly over time in both age groups (_F_1,205 = 34.85, P < .001; and _F_1,201 = 22.11, P < .001, respectively) without significant interactions with age (_F_1,205 = 0.89, P = .35; and _F_1,201 = 0.74, P = .39, respectively). Although a statistically significant increase in glucose concentrations was observed only in the younger adults, the interaction between age group and glucose increases was not significant (_F_1,205 = 1.97, P = .16). Consistent with the UKU analysis, both age groups experienced significant increases in weight, with subjects younger than 60 years having significantly greater weight gain (6.5 kg [6.6 kg] vs 3.3 kg [4.9 kg], _F_1,221 = 11.10, P = .001).

Combination treatment with olanzapine plus sertraline was associated with a greater remission rate than with olanzapine monotherapy among patients with MD with psychotic features. The benefits of the combination therapy became more apparent as the 12-week trial progressed, with separation favoring olanzapine/sertraline from week 8 to the end of the trial. The higher categorical remission rate observed with olanzapine/sertraline compared with olanzapine/placebo was consistent with the significantly greater decreases in HAM-D scores observed with combination therapy.

Our hypothesis that pharmacotherapy would be more efficacious in the younger group was not supported. The greater efficacy of olanzapine/sertraline was comparable in both age groups; furthermore, the subgroup analyses demonstrated the efficacy of combination treatment compared with olanzapine alone in both the younger adults and geriatric subjects.

The rates and severity of adverse effects were similar in the 2 treatment groups. Older subjects did not demonstrate poorer overall tolerability. With the exception of a greater frequency of pedal edema, older subjects were not more likely to experience falls or sedation/somnolence or to have greater extrapyramidal symptoms.

Both age groups experienced significant increases in weight and both triglyceride and cholesterol levels. Fasting glucose levels increased significantly among younger adults only. The observed metabolic changes are consistent with those reported during olanzapine treatment among younger adults with schizophrenia.55 In the absence of reliable measures of premorbid weight, we cannot estimate how much of the weight gained during the trial was due to the recovery of weight lost during the depressive episode. Our finding that older age was associated with less weight gain is consistent with other reports with atypical antipsychotic medications56 and with olanzapine specifically.57,58 In an analysis of data from a subgroup of subjects from this trial, we have shown that the lower weight gain experienced by older subjects is partially explained by their lower cumulative olanzapine dose.59

The positive findings must be considered in relation to the absence of an antidepressant monotherapy arm and previous combination pharmacotherapy trials for MD with psychotic features. Although most studies12-14,16,60-62 report poor response rates of MD with psychotic features to TCA monotherapy, positive trials exist in patients with delusions that are congruent with depressed mood treated with high doses of amitriptyline63 or imipramine.64,65 The generally poor responsiveness to TCA monotherapy has contributed to the conceptualization of MD with psychotic features as a distinct entity15,35,61 and the recommendation for combination therapy,10,11 including in geriatric patients.66 Nevertheless, a meta-analysis of the only 2 trials comparing combination therapy with antidepressant monotherapy did not demonstrate the superiority of combination treatment. Although this meta-analysis did demonstrate greater efficacy for combination therapy compared with antipsychotic monotherapy,21 only 1 of the 2 trials that used an atypical antipsychotic medication19 had positive results. Therefore, these results confirm and extend those of the meta-analysis.

The TCA studies cited previously12-16 were shorter than the 12-week duration of our Study of Pharmacotherapy of Psychotic Depression (STOP-PD). It is possible that longer antidepressant monotherapy trials would result in higher remission rates. Our trial also differed in applying a criterion of 2 consecutive assessments to assure that remission was sustained, which may have contributed to the absence of separation between olanzapine/sertraline and olanzapine/placebo before week 8. Nevertheless, the HAM-D analysis demonstrated that combination treatment was statistically superior on HAM-D scores from week 2 to week 12 without differences between the treatment arms in changes of SADS delusional scores at any point. Therefore, the benefit of adding sertraline to olanzapine was specific for the rate of improvement of depressive symptoms.

The possible efficacy of selective serotonin reuptake inhibitor monotherapy for unipolar delusional depression was suggested by a reported intent-to-treat remission rate of 72% with 150 mg of sertraline per day compared with only 27% for 40 mg of paroxetine per day.29 Methodological limitations in the trial design67 and a separate report that patients with MD with psychotic features had a markedly lower response rate to 200 mg of sertraline per day than patients with nonpsychotic depression68 highlight the need for additional trials to compare the efficacy of antidepressant monotherapy and combination treatment.

We have reported that prestudy antidepressant therapy was common among the first 100 study participants but that combination therapy was not.24 Without accounting for prestudy treatment, we cannot assess whether resistance to prior antidepressant therapy influenced response to either treatment.

Illness severity of participants, with most recruited as inpatients, rendered randomization to placebo only and use of a placebo lead-in impractical. The low placebo response rates in previous trials of MD with psychotic features (0%69 to 24.5%19) supported not including a placebo arm. Furthermore, the low early remission rate (<10% at week 2) decreases the likelihood that residual effects from pretrial treatment contributed to these results.

Although patients with major depression associated with hallucinations but not delusions meet DSM-IV criteria for MD with psychotic features, STOP-PD required the presence of delusions. Therefore, we cannot assess the efficacy of combination therapy for MD with psychotic features associated with hallucinations only. Also, the study focused on patients with unipolar MD with psychotic features and systematically excluded patients with histories that indicated periods of either mania or hypomania. Therefore, the results cannot be generalized to bipolar psychotic depression.

The 45.2% rate of attrition is a limitation. Attrition was comparable with the 48.1% rate reported in placebo-controlled antipsychotic trials70 but higher than the approximately 35% overall rate estimated for antidepressant studies of nonpsychotic depression.71 Although the severity of illness among study participants, with 69.1% entering as inpatients, presumably contributed to the high rate of attrition, the lack of systematic follow-up data from subjects who prematurely discontinued the study limits both generalizeability and our ability to apply the results to inform clinical practice.71,72 Mixed-effects logistic regression was applied as the primary analytic strategy to allow for the use of all available data under the assumption of ignorable missingness.71

The significantly higher attrition rate among patients treated with olanzapine than those treated with olanzapine/sertraline may be attributable to both more frequent discontinuations by investigators owing to insufficient response and earlier self-withdrawal by individuals who were responding poorly to monotherapy. Also, considering symptoms to be caused by study medications rather than MD with psychotic features may have contributed to the numerically greater frequency of discontinuation attributed to intolerable adverse effects in subjects treated with olanzapine/placebo. The observation that 75.2% of instances of attrition occurred during the first 6 weeks indicates that the 12-week trial length does not explain the high attrition rate

This trial applied an innovative and rigorous approach to defining remission in MD with psychotic features. The remission criterion of 2 consecutive assessments has been used in a previous trial of MD with psychotic features19 and a 2-week remission HAM-D cutoff of 10 points or lower has been used in ECT studies that included subjects with MD with psychotic features.31,73 The current study added a systematic assessment to assure delusions were resolved as a criterion for remission. In the absence of studies that assessed for the absence of delusions at more than 1 assessment, determination that delusions were not present at the second HAM-D remission assessment was considered an appropriately stringent remission criterion.

This study's remission rates, greater than 30% at week 8 and rising to 41.9% at week 12, are comparable with those in studies summarized in recent meta-analyses comparing duloxetine54 and venlafaxine74 with selective serotonin reuptake inhibitors for nonpsychotic depression. The potential benefit of acute combination pharmacotherapy relative to ECT, which is generally considered the treatment of choice for MD with psychotic features, warrants consideration. The efficacy of ECT has been well established, with a response rate of 87% when bilateral ECT is administered in academic centers.31 The public health significance of the acute efficacy of ECT is tempered by the rapid increase in depressive symptoms that occurs within days of completing a course of ECT73,75 and the markedly lower ECT remission rates (30%-47%) reported in community settings.76 Therefore, evidence that a pharmacological treatment is efficacious offers physicians an alternative to ECT that may be preferred by some patients for reasons of stigma and practicality. Nevertheless, the adverse metabolic effects of atypical antipsychotic medications are problematic. Further study of the optimal duration of continued combination therapy is needed to balance the high risk of early relapse of MD with psychotic features77,78 against the metabolic abnormalities and significant weight gain associated with atypical antipsychotic medications.

Correspondence: Barnett S. Meyers, MD, New York Presbyterian Hospital–Westchester, 21 Bloomingdale Rd, White Plains, NY 10605 (bmeyers@med.cornell.edu).

Submitted for Publication: October 3, 2008; final revision received December 22, 2008; accepted January 6, 2009.

Author Contributions: Dr Meyers had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Financial Disclosures: All of the authors received salary contributions from the National Institute of Mental Health grants that supported this study. Dr Meyers has provided legal consultation for AstraZeneca and has received research support or honoraria from Cyberonics, Eli Lilly, Forest Laboratories, Organon, and Pfizer. Dr Flint has received research support or honoraria from Janssen-Ortho, Lundbeck Canada, Organon, and Pfizer Canada. Dr Rothschild has received research support or honoraria from AstraZeneca, Bristol-Myers, Cephalon, Cyberonics, Forest Laboratories, Eli Lilly, Merck, Pfizer, Takeda, Novartis, and Wyeth; has provided expert testimony for Pfizer, GlaxoSmithKline, Forest Laboratories, and Eli Lilly; and has received royalties for the Rothschild Scale for Antidepressant Tachyphylaxis. Dr Mulsant has received research support or honoraria from AstraZeneca, Corcept, Eisai, Eli Lilly, Lundbeck, Forest Laboratories, GlaxoSmithKline, Janssen, and Pfizer. Dr Mulsant owns stock valued at less than $10 000 in Akzo-Nobel, Alkermes, AstraZeneca, Biogen Idec, Ceslsion, Elan, Eli Lilly, Forest, General Electric, and Orchestra Therapeutics. Dr Whyte has received research support or honoraria from Pfizer, Forest Laboratories, and Ortho-McNeil and research support from the National Institute of Mental Health and National Institute of Child Health and Human Development/National Center for Medical Rehabilitation Research. Dr Leon has served as a consultant for the National Institute of Mental Health and the Food and Drug Administration; has served on data safety monitoring boards for AstraZeneca, Dainippon Sumitomo Pharma America, Neurognetics, Organon, Pfizer, and Vanda; and has served as a consultant to Avera, Best Practices, Cadence, Concordant Raters, Cortex Pharmaceuticals, Cyberonics, Eli Lilly, MedAvante, and Noven. Drs Peasley-Miklus and Heo, and Mr Papademetriou do not have financial disclosures to report. Eli Lilly donated olanzapine for this trial and Pfizer donated sertraline and placebo/sertraline.

Funding/Support: This project was supported by grants MH 62446, MH 62518, MH 62565, and MH 62624 from the US Public Health Service; grants MH069430, MH067710, and P30 MH068368 from the National Institute of Mental Health; and grants M01-RR024153, RR000056, and CTSC UL1RR024996 from the National Center for Research Resources.

Role of the Sponsor: The National Institute of Mental Health supported this study and participated in its implementation through the UO1 mechanism. They did not participate in the collection, analysis, or interpretation of study data or in the preparation, review, or approval of this manuscript. A data safety monitoring board at the National Institute of Mental Health provided data and safety monitoring. Neither Eli Lilly nor Pfizer participated in the design, implementation, collection, analysis, or interpretation of data or in the preparation, review, or approval of this manuscript

Additional Contributions: We thank the members of the STOP-PD group for their contributions.

Box Section Ref ID

STOP-PD Group Members

Weill Cornell Medical Center, White Plains, New York

G. S. Alexopoulos, MD; M. L. Bruce, PhD; S. Klimstra, MD; J. English, MA; M. Gabriele, MSW; F. Santana, MSW; G. Addonizio, MD; J. de Asis, MD; X. Y. Baran, MD; and B. Kalyam, MD.

University of Pittsburgh, Pittsburgh, Pennsylvania

D. J. Kupfer, MD; M. E. Thase, MD; D. J. Cohen, BS; J. E. Emanuel, BS; T. S. Kamara, MPH; B. Kephart, BA; E. R. Mathis, BS; N. M. McLaughlin, RN, BSN; M. McShea, MS; A. G. Gildengers, MD; R. H. Howland, MD; M. D. Miller, MD; and J. Rosen, MD.

University of Massachusetts Medical School, Worcester

P. Appelbaum, MD; P. J. Candilis, MD; D. Guerin, MS; C. Wood, MS; A. Rohrbaugh, MS; S. Fratoni; C. Calkins; J. Grogan; M. Martin; J. Patel, MD; E. Smith, MD; R. Reni, MD; D. Sit, MD; E. Kayatekin, MD; D. Morin, MD; C. Cimpeanu, MD; T. Shteinlukht, MD; M. Vemuri, MD; M. Bell, MD; P. Burke, MD; N. Byatt, MD; R. Cook, MD; K. Deligiannidis, MD; I. Guryanova, MD; A. Jastiniah, MD; and A. Mathur, MD.

University of Toronto–Affiliated Hospitals, Toronto, Ontario, Canada

S. Kasapinovic, MSc; C. Andrade, BA; P. Zuker, BA; S. Rizvi, BSc; A. Schaffer, MD; N. Herrmann, MD; S. Brook, MD; and J. Silveira, MD.

National Institutes of Mental Health, Bethesda, Maryland

J. Olin, PhD (currently at Novartis); E. Zachariah, PhD; and J. Evans, PhD.

American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders. 4th ed, text revision. Washington, DC American Psychiatric Association2000;

Johnson JHorwath EWeissman MM The validity of major depression with psychotic features based on a community study. Arch Gen Psychiatry 1991;48 (12) 1075- 1081PubMedGoogle ScholarCrossref

Ohayon MMSchatzberg AF Prevalence of depressive episodes with psychotic features in the general population. Am J Psychiatry 2002;159 (11) 1855- 1861PubMedGoogle ScholarCrossref

Coryell WLeon AWinokur GEndicott JKeller MAkiskal HSolomon D Importance of psychotic features to long-term course in major depressive disorder. Am J Psychiatry 1996;153 (4) 483- 489PubMedGoogle Scholar

Maj MPirozzi RMagliano LFiorillo ABartoli L Phenomenology and prognostic significance of delusions in major depressive disorder: a 10-year prospective follow-up study. J Clin Psychiatry 2007;68 (9) 1411- 1417PubMedGoogle ScholarCrossref

Post F The Significance of Affective Symptoms in Old Age: A Follow-up Study of One Hundred Patients. New York, NY Oxford University Press1962;

Rothschild AJSamson JABond TCLuciana MMSchildkraut JJSchatzberg AF Hypothalamic-pituitary-adrenal axis activity and 1-year outcome in depression. Biol Psychiatry 1993;34 (6) 392- 400PubMedGoogle ScholarCrossref

Vythilingam MChen JBremner JDMazure CMMaciejewski PKNelson JC Psychotic depression and mortality. Am J Psychiatry 2003;160 (3) 574- 576PubMedGoogle ScholarCrossref

American Psychiatric Association, Practice guideline for the treatment of patients with major depressive disorder (revision). Am J Psychiatry 2000;157 (4) ((suppl)) 1- 45PubMedGoogle Scholar

National Institute for Clinical Excellence, Depression: management of depression in primary and secondary care [NICE Clinical Guideline 23]. London, England National Institute for Health and Clinical Excellence2004;

Friedman CDe Mowbray MSHamilton V Imipramine (Tofranil) in depressive states: a controlled trial with inpatients. J Ment Sci 1961;107948- 953PubMedGoogle Scholar

Hordern AHolt NFBurt CGGordon WF Amitriptyline in depressive states: phenomenology and prognostic considerations. Br J Psychiatry 1963;109815- 825PubMedGoogle ScholarCrossref

Avery DLubrano A Depression treated with imipramine and ECT: the DeCarolis study reconsidered. Am J Psychiatry 1979;136 (4B) 559- 562PubMedGoogle Scholar

Spiker DGWeiss JCDealy RSGriffin SJHanin INeil JFPerel JMRossi AJSoloff PH The pharmacological treatment of delusional depression. Am J Psychiatry 1985;142 (4) 430- 436PubMedGoogle Scholar

Kroessler D Relative efficacy rates for therapies of delusional depression. Convuls Ther 1985;1 (3) 173- 182PubMedGoogle Scholar

Parker GRoy KHadzi-Pavlovic DPedic F Psychotic (delusional) depression: a meta-analysis of physical treatments. J Affect Disord 1992;24 (1) 17- 24PubMedGoogle ScholarCrossref

Rothschild AJWilliamson DJTohen MFSchatzberg AAndersen SWVan Campen LESanger TMTollefson GD A double-blind, randomized study of olanzapine and olanzapine/fluoxetine combination for major depression with psychotic features. J Clin Psychopharmacol 2004;24 (4) 365- 373PubMedGoogle ScholarCrossref

Andreescu CMulsant BHRothschild AJFlint AJMeyers BSWhyte E Pharmacotherapy of major depression with psychotic features: what is the evidence? Psychiatr Ann 2006;36 (1) 31- 38Google Scholar

Wijkstra JLijmer JBalk FJGeddes JRNolen WA Pharmacological treatment for unipolar psychotic depression: systematic review and meta-analysis. Br J Psychiatry 2006;188410- 415PubMedGoogle ScholarCrossref

Rothschild AJWiner JFlint AJMulsant BHWhyte EMHeo MFratoni SGabriele MKasapinovic SMeyers BSStudy of Pharmacotherapy of Psychotic Depression (STOP-PD) Collaborative Study Group, Missed diagnosis of psychotic depression at 4 academic medical centers. J Clin Psychiatry 2008;69 (8) 1293- 1296PubMedGoogle ScholarCrossref

Mulsant BHHaskett RFPrudic JThase MEMalone KMMann JJPettinati HMSackeim HA Low use of neuroleptic drugs in the treatment of psychotic major depression. Am J Psychiatry 1997;154 (4) 559- 561PubMedGoogle Scholar

Andreescu CMulsant BHPeasley-Miklus CRothschild AJFlint AJHeo MCaswell MWhyte EMMeyers BSSTOP-PD Study Group, Persisting low use of antipsychotics in the treatment of major depressive disorder with psychotic features. J Clin Psychiatry 2007;68 (2) 194- 200PubMedGoogle ScholarCrossref

Mulsant BHSweet RARosen JPollock BGZubenko GSFlynn TBegley AEMazumdar SReynolds CF III A double-blind randomized comparison of nortriptyline plus perphenazine versus nortriptyline plus placebo in the treatment of psychotic depression in late life. J Clin Psychiatry 2001;62 (8) 597- 604PubMedGoogle ScholarCrossref

Meyers BSKlimstra SAGabriele MHamilton MKakuma TTirumalasetti FAlexopoulos GS Continuation treatment of delusional depression in older adults. Am J Geriatr Psychiatry 2001;9 (4) 415- 422PubMedGoogle ScholarCrossref

Tohen MVieta ECalabrese JKetter TASachs GBowden CMitchell PBCentorrino FRisser RBaker RWEvans ARBeymer KDube STollefson GDBreier A Efficacy of olanzapine and olanzapine-fluoxetine combination in the treatment of bipolar I depression. Arch Gen Psychiatry 2003;60 (11) 1079- 1088PubMedGoogle ScholarCrossref

Shelton RCTollefson GDTohen MStahl SGannon KSJacobs TGBuras WRBymaster FPZhang WSpencer KAFeldman PDMeltzer HY A novel augmentation strategy for treating resistant major depression. Am J Psychiatry 2001;158 (1) 131- 134PubMedGoogle ScholarCrossref

Zanardi RFranchini LGasperini MPerez JSmeraldi E Double-blind controlled trial of sertraline versus paroxetine in the treatment of delusional depression. Am J Psychiatry 1996;153 (12) 1631- 1633PubMedGoogle Scholar

Flint AJRifat SL The treatment of psychotic depression in later life: a comparison of pharmacotherapy and ECT. Int J Geriatr Psychiatry 1998;13 (1) 23- 28PubMedGoogle ScholarCrossref

Petrides GFink MHusain MMKnapp RGRush AJMueller MRummans TAO’Connor KMRasmussen KG JrBernstein HJBiggs MBailine SHKellner CH ECT remission rates in psychotic versus nonpsychotic depressed patients: a report from CORE. J ECT 2001;17 (4) 244- 253PubMedGoogle ScholarCrossref

First MSpitzer RGibbon MWilliams J Structured Clinical Interview for DSM-IV-TR Axis I Disorders–Patient Edition (SCID-I/P). New York, NY Biometrics Research Dept, New York State Psychiatric Institute2001;

Meyers BSEnglish JGabriele MPeasley-Miklus CHeo MFlint AJMulsant BHRothschild AJSTOP-PD Study Group, A delusion assessment scale for psychotic major depression: reliability, validity, and utility. Biol Psychiatry 2006;60 (12) 1336- 1342PubMedGoogle ScholarCrossref

Spitzer REndicott J Schedule for Affective Disorders and Schizophrenia. 3rd ed. New York, NY Biometrics Research Dept, New York State Psychiatric Institute1979;

Nelson JCBowers MB Jr Delusional unipolar depression: description and drug response. Arch Gen Psychiatry 1978;35 (11) 1321- 1328PubMedGoogle ScholarCrossref

Parker GHadzi-Pavlovic DHickie IMitchell PWilhelm KBrodaty HBoyce PEyers KPedic F Psychotic depression: a review and clinical experience. Aust N Z J Psychiatry 1991;25 (2) 169- 180PubMedGoogle ScholarCrossref

Schatzberg AFRothschild AJ Psychotic (delusional) major depression: should it be included as a distinct syndrome in DSM-IV? Am J Psychiatry 1992;149 (6) 733- 745PubMedGoogle Scholar

Williams JBKobak KABech PEngelhardt NEvans KLipsitz JOlin JPearson JKalali A The GRID-HAM-D standardization of the Hamilton Depression Rating Scale. Int Clin Psychopharmacol 2008;23 (3) 120- 129PubMedGoogle ScholarCrossref

Guy W Clinical Global Impressions: ECDEU Assessment Manual for Psychopharmacology. Washington, DC US Dept of Health, Education, and Welfare1976;217- 222

Overall JEGorham DR The Brief Psychiatric Rating Scale (BPRS): recent developments in ascertainment and scaling. Psychopharmacol Bull 1988;2497- 99Google Scholar

Andreasen N The Scale for the Assessment of Positive Symptoms (SADS). Iowa City, IA Department of Psychiatry, University of Iowa1984;

Miller MDParadis CFHouck PRMazumdar SStack JARifai AHMulsant BReynolds CF III Rating chronic medical illness burden in geropsychiatric practice and research: application of the Cumulative Illness Rating Scale. Psychiatry Res 1992;41 (3) 237- 248PubMedGoogle ScholarCrossref

Folstein MFFolstein SEMcHugh PR “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975;12 (3) 189- 198PubMedGoogle ScholarCrossref

Georgotas AMcCue REHapworth WFriedman EKim OMWelkowitz JChang ICooper TB Comparative efficacy and safety of MAOIs versus TCAs in treating depression in the elderly. Biol Psychiatry 1986;21 (12) 1155- 1166PubMedGoogle ScholarCrossref

Reynolds CF IIIFrank EKupfer DJThase MEPerel JMMazumdar SHouck PR Treatment outcome in recurrent major depression: a post hoc comparison of elderly (“young old”) and midlife patients. Am J Psychiatry 1996;153 (10) 1288- 1292PubMedGoogle Scholar

Lingjaerde OAhlfors UGBech PDencker SJElgen K The UKU side effect rating scale: a new comprehensive rating scale for psychotropic drugs and a cross-sectional study of side effects in neuroleptic-treated patients. Acta Psychiatr Scand Suppl 1987;3341- 100PubMedGoogle ScholarCrossref

Guy W Abnormal Involuntary Movement Scale (AIMS): ECDEU Assessment Manual for Psychopharmacology. Washington, DC US Dept of Health, Education, and Welfare1976;534- 537

Schooler NRKane JM Research diagnoses for tardive dyskinesia. Arch Gen Psychiatry 1982;39 (4) 486- 487PubMedGoogle Scholar

Hochberg Y A sharper Bonferroni procedure for multiple tests of significance. Biometrika 1988;75 (4) 800- 802Google ScholarCrossref

Thase MEPritchett YIOssanna MJSwindle RWXu JDetke MJ Efficacy of duloxetine and selective serotonin reuptake inhibitors: comparisons as assessed by remission rates in patients with major depressive disorder. J Clin Psychopharmacol 2007;27 (6) 672- 676PubMedGoogle ScholarCrossref

Lieberman JAStroup TSMcEvoy JPSwartz MSRosenheck RAPerkins DOKeefe RSDavis SMDavis CELebowitz BDSevere JHsiao JKClinical Antipsychotic Trials of Intervention Effectiveness (CATIE) Investigators, Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N Engl J Med 2005;353 (12) 1209- 1223PubMedGoogle ScholarCrossref

Meyer JM A retrospective comparison of weight, lipid, and glucose changes between risperidone- and olanzapine-treated inpatients: metabolic outcomes after 1 year. J Clin Psychiatry 2002;63 (5) 425- 433PubMedGoogle ScholarCrossref

Kinon BJKaiser CJAhmed SRotelli MDKollack-Walker S Association between early and rapid weight gain and change in weight over one year of olanzapine therapy in patients with schizophrenia and related disorders. J Clin Psychopharmacol 2005;25 (3) 255- 258PubMedGoogle ScholarCrossref

Lipkovich ICitrome LPerlis RDeberdt WHouston JPAhl JHardy T Early predictors of substantial weight gain in bipolar patients treated with olanzapine. J Clin Psychopharmacol 2006;26 (3) 316- 320PubMedGoogle ScholarCrossref

Smith ERothschild AJHeo MPeasley-Miklus CCaswell MPapademetriou EFlint AJMulsant BHMeyers BSSTOP-PD Collaborative Study Group, Weight gain during olanzapine treatment for psychotic depression: effects of dose and age. Int Clin Psychopharmacol 2008;23 (3) 130- 137PubMedGoogle ScholarCrossref

Glassman AHPerel JMShostak MKantor SJFleiss JL Clinical implications of imipramine plasma levels for depressive illness. Arch Gen Psychiatry 1977;34 (2) 197- 204PubMedGoogle ScholarCrossref

Charney DSNelson JC Delusional and nondelusional unipolar depression: further evidence for distinct subtypes. Am J Psychiatry 1981;138 (3) 328- 333PubMedGoogle Scholar

Kocsis JHCroughan JLKatz MMButler TPSecunda SBowden CLDavis JM Response to treatment with antidepressants of patients with severe or moderate nonpsychotic depression and of patients with psychotic depression. Am J Psychiatry 1990;147 (5) 621- 624PubMedGoogle Scholar

Spiker DGDealy RSHanin IWeiss JCKupfer DJ Treating delusional depressives with amitriptyline. J Clin Psychiatry 1986;47 (5) 243- 246PubMedGoogle Scholar

Bruijn JAMoleman PMulder PGHvan den Broek WW Treatment of mood-congruent psychotic depression with imipramine. J Affect Disord 2001;66 (2-3) 165- 174PubMedGoogle ScholarCrossref

Birkenhager TKvan den Broek WWMulder PGMoleman PBruijn JA Efficacy of imipramine in psychotic versus nonpsychotic depression. J Clin Psychopharmacol 2008;28 (2) 166- 170PubMedGoogle ScholarCrossref

Alexopoulos GSKatz IRReynolds CF IIICarpenter DDocherty JPRoss RW Pharmacotherapy of depression in older patients: a summary of the expert consensus guidelines. J Psychiatr Pract 2001;7 (6) 361- 376PubMedGoogle ScholarCrossref

Rothschild AJPhillips KA Selective serotonin reuptake inhibitors and delusional depression. Am J Psychiatry 1999;156 (6) 977- 978PubMedGoogle Scholar

Simpson GMEl Sheshai ARady AKingsbury SJFayek M Sertraline as monotherapy in the treatment of psychotic and nonpsychotic depression. J Clin Psychiatry 2003;64 (8) 959- 965PubMedGoogle ScholarCrossref

Kemmler GHummer MWidschwendter CFleischhacker WW Dropout rates in placebo-controlled and active-controlled clinical trials of antipsychotic drugs: a meta-analysis. Arch Gen Psychiatry 2005;62 (12) 1305- 1312PubMedGoogle ScholarCrossref

Leon ACMallinckrodt CHChuang-Stein CArchibald DGArcher GEChartier K Attrition in randomized controlled clinical trials: methodological issues in psychopharmacology. Biol Psychiatry 2006;59 (11) 1001- 1005PubMedGoogle ScholarCrossref

Lavori PW Clinical trials in psychiatry: should protocol deviation censor patient data? Neuropsychopharmacology 1992;6 (1) 39- 63PubMedGoogle Scholar

Sackeim HAHaskett RFMulsant BHThase MEMann JJPettinati HMGreenberg RMCrowe RRCooper TBPrudic J Continuation pharmacotherapy in the prevention of relapse following electroconvulsive therapy: a randomized controlled trial. JAMA 2001;285 (10) 1299- 1307PubMedGoogle ScholarCrossref

Nemeroff CBEntsuah RBenattia IDemitrack MSloan DMThase ME Comprehensive Analysis of Remission (COMPARE) with venlafaxine versus SSRIs. Biol Psychiatry 2008;63 (4) 424- 434PubMedGoogle ScholarCrossref

Sackeim HAPrudic JDevanand DPKiersky JEFitzsimons LMoody BJMcElhiney MCColeman EASettembrino JM Effects of stimulus intensity and electrode placement on the efficacy and cognitive effects of electroconvulsive therapy. N Engl J Med 1993;328 (12) 839- 846PubMedGoogle ScholarCrossref

Prudic JOlfson MMarcus SCFuller RBSackeim HA Effectiveness of electroconvulsive therapy in community settings. Biol Psychiatry 2004;55 (3) 301- 312PubMedGoogle ScholarCrossref

Flint AJRifat SL Two-year outcome of psychotic depression in late life. Am J Psychiatry 1998;155 (2) 178- 183PubMedGoogle Scholar