Reliability, Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV (original) (raw)

Abstract

The DSM-5 was published in 2013 and it included two substantive revisions for gambling disorder (GD). These changes are the reduction in the threshold from five to four criteria and elimination of the illegal activities criterion. The purpose of this study was to twofold. First, to assess the reliability, validity and classification accuracy of the DSM-5 diagnostic criteria for GD. Second, to compare the DSM-5–DSM-IV on reliability, validity, and classification accuracy, including an examination of the effect of the elimination of the illegal acts criterion on diagnostic accuracy. To compare DSM-5 and DSM-IV, eight datasets from three different countries (Canada, USA, and Spain; total N = 3247) were used. All datasets were based on similar research methods. Participants were recruited from outpatient gambling treatment services to represent the group with a GD and from the community to represent the group without a GD. All participants were administered a standardized measure of diagnostic criteria. The DSM-5 yielded satisfactory reliability, validity and classification accuracy. In comparing the DSM-5 to the DSM-IV, most comparisons of reliability, validity and classification accuracy showed more similarities than differences. There was evidence of modest improvements in classification accuracy for DSM-5 over DSM-IV, particularly in reduction of false negative errors. This reduction in false negative errors was largely a function of lowering the cut score from five to four and this revision is an improvement over DSM-IV. From a statistical standpoint, eliminating the illegal acts criterion did not make a significant impact on diagnostic accuracy. From a clinical standpoint, illegal acts can still be addressed in the context of the DSM-5 criterion of lying to others.

Similar content being viewed by others

Introduction

Accurate diagnosis of gambling disorder (GD) is important in order to measure the prevalence of GD in the general population, manage public health efforts, diagnose patients in clinical settings, and measure treatment outcome. A concise list of cardinal symptoms of GD is also important as a tool to make the general public aware of the warning signs of GD.

Diagnostic criteria for GD were first introduced in 1980, under the diagnosis of pathological gambling (PG) in DSM-III (American Psychiatric Association 1980) and were revised in 1987 for DSM-III-R (American Psychiatric Association 1987; Lesieur 1988), and again in 1994 for DSM-IV (American Psychiatric Association 1994), and most recently in 2013 for DSM-5 (American Psychiatric Association 2013). The original criteria and subsequent revisions were written by committees of experts based upon a number of factors including a review of the literature and their clinical experience and expertise. Lesieur and Rosenthal’s (1991) literature review for the DSM-IV committee found little data regarding the diagnostic criteria other than clinician opinions and anecdotal reports. While the DSM-IV is not an exhaustive list of PG symptoms, it is thought to include symptoms that are sufficient to provide accurate diagnosis (Gebauer et al. 2010). Subsequent to the publication of DSM-IV, there were only a small number of empirical studies on the reliability, validity, and classification accuracy of diagnostic criteria for PG (National Research Council 1999; Petry et al. 2013; Zimmerman et al. 2006).

Research to date on the classification accuracy of DSM-IV diagnostic criteria for PG has shown that most diagnostic errors are false negatives (i.e., concluding that the person does not have the disorder, when in fact they do), and these classification errors occur just below the standard threshold of five criteria (Jimenez-Murcia et al. 2009; Lesieur and Rosenthal 1991; Stinchfield 2003; Stinchfield et al. 2005; Zimmerman et al. 2006). As a result of these diagnostic errors, some investigators have suggested lowering the cut score from five to four (Jimenez-Murcia et al. 2009; Stinchfield 2003; Stinchfield et al. 2005) while others have suggested eliminating one or more criteria (Strong and Kahler 2007; Zimmerman et al. 2006).

The DSM-5 includes the following revisions: (a) renaming the disorder from PG to GD; (b) reclassifying from impulse control disorders to substance-related and addictive disorders; (c) elimination of the criterion “has committed illegal acts such as forgery, fraud, theft, or embezzlement to finance gambling”; (d) reducing the threshold for diagnosis from five criteria to four criteria; and (e) specifying that symptoms occur within a 12 month time period. The decision to eliminate one of the ten criteria and reduce the threshold from five to four criteria was based on empirical data. The reduction in threshold from five to four criteria was based on three studies in three different countries, USA (Stinchfield 2003), Canada (Stinchfield et al. 2005), and Spain (Jimenez-Murcia et al. 2009). All three studies found a modest improvement in classification accuracy using a cut score of four, and most importantly, a reduction in false negatives. Six of the nine DSM-5 diagnostic criteria are unchanged from DSM-IV and three criteria have minor revisions to the wording, such as inserting the word “often” in the preoccupation criterion, but the content and meaning of these criteria remain unchanged.

The empirical rationale for the elimination of the illegal acts criterion was based primarily on two studies which found low prevalence rates for this criterion (Strong and Kahler 2007; Zimmerman et al. 2006). These two studies note that the illegal acts criterion is rarely endorsed in the absence of other criteria and thus does not add to diagnostic accuracy. Research has demonstrated that illegal activity secondary to gambling is associated with more severe gambling symptomatology (Ledgerwood et al. 2007). A similar conclusion was reached in a more recent study in Spain (Granero et al. [2014](/article/10.1007/s10899-015-9573-7#ref-CR19 "Granero, R., Penelo, E., Stinchfield, R., Fernandez-Aranda, F., Aymami, N., Gomez-Pena, M., et al. (2014). Contribution of illegal acts to pathological gambling diagnosis: DSM-5 implications. Journal of Addictive Diseases. doi: 10.1080/10550887.2014.882730

              .")). Illegal acts (i.e., arrests) were included as diagnostic criteria when PG was first introduced in 1980 in DSM-III and has been present in DSM-III-R and DSM-IV. However, the illegal acts criterion is not without its problems. The illegal acts criterion can be misunderstood by interviewees and therefore may also be the most underreported criterion. For example, many problem gamblers write bad checks, but they may not consider that act to be “illegal”, particularly if they plan to put money in the checking account later to cover the bad check and if they did not suffer any adverse consequences from it, such as being arrested. This criterion, more than any other criteria, requires clarification and probing questions during the diagnostic interview to establish whether an act, such as writing a bad check, satisfies the criterion of illegal acts. Some individuals may not report illegal behavior in a clinical assessment for fear of the implications of admitting to an illegal act. Anecdotally, clinicians report that some individuals who do not report illegal activity at the initial diagnostic assessment will later in the course of treatment disclose illegal activity that they engaged in to fund their gambling or pay gambling debts. This underreporting may also contribute to low prevalence rates for this criterion, which is partly why it was eliminated as a stand-alone criterion in DSM-5.

Temcheff et al. (2011) compared DSM-IV and DSM-5 in a large sample (n = 19,942) of US college athletes and found a statistically significant increase in the proportion of male participants diagnosed with GD using DSM-5 (3.4 % DSM-IV vs. 4.3 % DSM-5). The authors did not compare classification accuracy between DSM-IV and DSM-5. In France, Denis et al. (2012) compared DSM-IV to DSM-5 in a small sample of clients (n = 161) presenting for addictions treatment. They found that DSM-IV and DSM-5 yielded similar prevalence rates that were not statistically significantly different and exhibited a high degree of agreement (kappa = .94). They also found that some criteria were better at discriminating between pathological and non-pathological gamblers than others, namely “repeated unsuccessful efforts to stop”, “chasing losses”, “lying”, and “jeopardized or lost a significant relationship or job”. Like the Temcheff et al. (2011) study above, this study also did not provide classification accuracy estimates.

In another evaluation of DSM-5 criteria for GD, Petry et al. (2013) examined the proposed criteria in five US samples drawn from a general population, gambling patrons, and treatment studies, totaling 3710 participants. Internal consistency of the nine criteria yielded a Cronbach’s alpha = .95. The illegal acts criterion loaded adequately in the principal components analysis, however, it had the lowest factor loading of the ten criteria, rarely was present in the absence of other criteria, and its absence did not significantly diminish diagnostic accuracy. Classification accuracy of the DSM-5 criteria, using the DSM-IV criteria as the reference standard, resulted in sensitivity = 100 %, specificity = 98 %, and hit rate = 98 %. The cut score of four performed as well or better than a cut score of five in all samples. The authors acknowledge that a limitation of this study was that the reference standard (a measure of DSM-IV) was not independent of the test (a measure of DSM-5); in fact, it was from the same instrument (NODS), and therefore accuracy results may have been inflated due to this non-independence. The reference standard against which the test is evaluated must be independent of the test itself (Gambino 2012). The methodological limitations of these studies along with the fact that diagnostic test results can vary as a function of small sample characteristics suggests that additional testing of DSM-5 is warranted. This current study improves on the studies reviewed above in two ways: (1) the current study uses a reference standard (group membership) that is largely independent from the test (DSM-5); and (2) this study draws on larger and more diverse samples from the USA, Canada and Spain.

The following three questions will be addressed in the present study: (1) What is the reliability, validity, and classification accuracy of the DSM-5 diagnostic criteria for GD? (2) Is the DSM-5 revision an improvement over DSM-IV in terms of reliability, validity and classification accuracy? and (3) How many individuals will not be diagnosed with GD with the illegal acts criterion removed from DSM-5?

Methods

Participants

This study analyzed eight existing datasets. These eight datasets were selected based upon the following two inclusion criteria: (a) DSM-IV diagnostic criteria were assessed; and (b) the reference standard for classification accuracy was group membership, that is, participants were recruited from clinical and community settings. Participants in each dataset are described in Table 1 and further details can be found in the original source cited. The datasets included adults recruited from clinical and community populations in Canada, USA, and Spain. Inclusion criteria for participants in the clinical samples were that they were admitted to a gambling treatment; and were 18 years of age or older. Inclusion criteria for participants in the community samples were that they were 18 years of age or older and had gambled at least once in past year. For the Canadian and USA datasets, the participants had to understand the English language, and for the Spanish samples, the participants had to understand the Spanish language. In total, across all eight datasets, the combined sample was 3247; and there were 1871 males and 1350 females and 26 with unknown gender. There were 1431 clinical participants and 1816 community participants. Each dataset was obtained from the principal investigator by permission and each study had received prior human subjects’ approval.

Table 1 Source, demographics and group membership sample size for each dataset

Full size table

Instrument

As the DSM-5 revision includes elimination of one criterion and lowering the cut score from five to four, the DSM-5 can be evaluated with existing DSM-IV datasets. All eight datasets identified above used Stinchfield’s measure of DSM-IV diagnostic criteria for PG which is part of the Gambling Behavior Interview (GBI; Stinchfield 2001, 2003; Stinchfield et al. 2005) and the Gambling Treatment Outcome Monitoring System (GAMTOMS; Stinchfield et al. 2007). The GBI is a 106-item structured interview that measures gambling frequency, time and money spent gambling, South Oaks Gambling Screen (SOGS; Lesieur and Blume 1987, 1993), DSM-IV diagnostic criteria, research diagnostic criteria, and demographics (Stinchfield et al. 2005; Stinchfield 2014). The GBI was developed as a research diagnostic interview and therefore it includes other measures of PG, such as the SOGS, Problem Gambling Severity Index (PGSI) from the Canadian Problem Gambling Inventory (CPGI; Ferris and Wynne 2001) and Gamblers Anonymous 20 questions (GA-20). The GAMTOMS is a multi-instrument and multidimensional gambling treatment outcome assessment battery (Stinchfield et al. 2007; Stinchfield 2014).

DSM-IV diagnostic criteria for PG are measured with ten items, one for each criterion, paraphrased from the ten DSM-IV diagnostic criteria for PG. See “Appendix” for a copy of Stinchfield’s measure of DSM-IV diagnostic criteria of PG. This measure has demonstrated satisfactory reliability with internal consistency estimates of Cronbach’s alpha = .92 for a combined community and gambling treatment sample (Stinchfield et al. 2005), and temporal stability as measured by 1-week test–retest was intraclass correlation (ICC) = .78 (Stinchfield et al. 2007). In terms of convergent validity, the DSM-IV PG scale was correlated with the SOGS r = .90 (Stinchfield et al. 2005). In terms of classification accuracy, using the standard DSM-IV cut score of five to indicate a diagnosis of PG (APA 1994), using a reference standard of group membership (clinical vs. community), yielded a hit rate = .91, sensitivity = .83, and specificity = .98, all of which are satisfactory (Stinchfield et al. 2005). The two datasets from Spain used a Spanish translation of the Stinchfield DSM-IV measure and it showed similar evidence of satisfactory reliability, validity and classification accuracy (Jimenez-Murcia et al. 2009).

In order to measure convergent validity, the DSM-5 was correlated with other measures of gambling problem severity included in these eight datasets. These convergent validity measures include the SOGS, PGSI, gambling participation, and gambling-related financial problems (see Table 3 for convergent validity measures in each dataset) that are included in the GBI (Stinchfield et al. 2005). Discriminant validity was measured by correlations of DSM-5 with demographic variables that have exhibited low or no correlation with PG.

Procedures

This study draws on eight existing datasets and procedures were similar but not identical across all eight studies and reports from each study can be consulted for descriptions of procedures. In general, for clinical samples, clients of outpatient gambling treatment services were recruited via flyers and then in-person interviews were conducted by research staff within the first few days following admission to treatment. For community samples, a number of methods were used to recruit participants, such as flyers and notices on community bulletin boards, and participants contacted research staff to set up an in-person interview. In-person interviews were conducted with the standardized measure of DSM-IV described above that was part of a longer assessment, either the GBI or GAMTOMS. In two studies the community sample was administered the DSM-IV measure via telephone interview (Stinchfield 2003; Stinchfield et al. 2005). Participants were offered a gift card as remuneration for their time.

Data Analyses

Data analyses were conducted on each of the eight datasets. The eight datasets were not merged due to the data coming from different countries and at different times. First, reliability, validity, and classification accuracy of the DSM-5 diagnostic criteria were computed. Second, the DSM-5 psychometric properties were compared to the DSM-IV psychometric properties. Third, the number of participants not diagnosed with GD when the illegal acts criterion was removed (keeping the cut score constant at four) was computed.

Reliability was examined by measuring internal consistency (Cronbach’s alpha) and temporal stability (1-week test–retest) of DSM-IV and DSM-5 diagnostic criteria. Internal consistency is evident if Cronbach’s coefficient alpha is >.70. Two of the eight datasets included a 1-week test–retest procedure and ICC coefficients were computed to measure temporal stability. Temporal stability is evident if the test–retest ICC coefficient is >.70 (Cichetti 1994).

Validity was examined using measures of convergent and discriminant validity. Convergent validity was examined by measuring the correlations between the total DSM-5 score and other measures of gambling problem severity, including SOGS, GA-20, PGSI, time spent gambling, money spent gambling, and gambling frequency. Convergent validity is evident if correlation coefficients are r > .30 (Cichetti 1994). Discriminant validity was examined by measuring the relationship between the DSM-5 total score and variables that have been shown to have low or no correlation with PG, including gender, age, marital status, educational level, income, and employment status. Discriminant validity is evident if correlation coefficients are r < .10 (Cichetti 1994).

Classification accuracy was measured by computing diagnostic statistics of sensitivity, specificity, false negative rate, false positive rate, positive predictive power, negative predictive power, hit rate, and base rate (Baldessarini et al. 1983; Fleiss 1981; Friedman and Cacciola 1998). In order to demonstrate satisfactory classification accuracy the hit rate, sensitivity, and specificity must all be .80 or greater (DiStefano and Morgan 2011; Glascoe 2005). In order to demonstrate superiority over DSM-IV, classification accuracy indices for the DSM-5 must be higher than those for DSM-IV.

To compute classification accuracy a reference or “gold” standard is used against which to compare the test. There is no consensus among investigators about what to use for a reference standard for diagnosing GD, so investigators have used alternate measures, such as the SOGS or a standardized diagnostic interview, however, neither of these are independent of DSM-IV diagnostic criteria. In the current study, to create a reference standard to serve as a proxy for a “gold” reference standard, group membership in either a clinical or community sample served as the reference standard (Faraone and Tsuang 1994; Gambino 2006, 2012). The clinical group was comprised of patients in gambling treatment and the community group was comprised of adults from the general population. It was assumed that patients in gambling treatment have the disorder and adults from the general population are free of the disorder. While this is a fairly safe assumption, there may be a small number of patients in treatment who do not satisfy the DSM criteria for GD, and likewise, there may be a small number of members of the general population who meet DSM criteria for GD. Nevertheless, this method has proven to be useful in previous research on the classification accuracy of DSM-IV (Jimenez-Murcia et al. 2009; Stinchfield 2003; Stinchfield et al. 2005, 2007). The use of group membership as the reference standard is the main difference between this study and prior evaluations of DSM-5 (Denis et al. 2012; Petry et al. 2013; Temcheff et al. 2011) and this group membership as reference standard is considered an improvement in methodology because it has greater independence from the test (DSM-5 measure) than the reference standard used in the prior evaluations (DSM-IV measure).

Results

Reliability

Reliability results are shown in Table 2. All eight datasets yielded Cronbach alphas that were >.70, and six out of eight datasets yielded Cronbach alphas >.90, indicating excellent internal consistency. For comparison purposes, the same analyses were computed for the DSM-IV, and the results indicate that the DSM-5 is slightly more internally consistent than DSM-IV. Two datasets (#5 and #6 in Table 1) included a 1-week test–retest and the ICC for DSM-IV was ICC = .74 and .76 and for DSM-5 the ICC was .71 for both datasets. Both DSM-IV and DSM-5 exhibited ICCs above the criterion of .70.

Table 2 Reliability of DSM-IV and DSM-5

Full size table

Validity

Convergent and discriminant validity coefficients for DSM-IV and DSM-5 are shown in Table 3. Results show moderate to high correlations with concurrent gambling problem severity measures, ranging from r = .21 to r = .97. The majority of these correlations are above the criterion of r > .30 and are identical between DSM-5 and DSM-IV. Evidence of discriminant validity of DSM-5 was exhibited by low correlations with variables purported to be unrelated to problem gambling, such as age and gender, ranging from r = .00 to r = .40. The majority of these correlations are at or below the criterion of r < .10 and are identical between DSM-5 and DSM-IV.

Table 3 Convergent and discriminant validity of DSM-IV and DSM-5

Full size table

Classification Accuracy

Standard indices of classification accuracy of DSM-5 are shown in Table 4. Both DSM-5 and DSM-IV show evidence of accuracy using the reference standard of group membership (gambling treatment vs. community). All of the DSM-5 classification accuracy coefficients for hit rate, sensitivity, and specificity are above the criterion of .80 and six of the eight datasets exhibited coefficients above .90 indicating excellent classification accuracy.

Table 4 Classification accuracy of DSM-IV and DSM-5

Full size table

A comparison of prevalence rates of DSM-5 and DSM-IV is presented in Table 5. In all eight datasets the prevalence rate for GD was slightly higher for DSM-5 as compared to DSM-IV, but none of the datasets showed a statistically significant difference at alpha = .01.

Table 5 Comparison of GD prevalence rates between DSM-IV and DSM-5

Full size table

Endorsement rates for illegal acts criterion and the effect on diagnosis of GD based upon the absence or presence of the illegal acts criterion is shown in Table 6. The endorsement rate of illegal acts is zero or near zero for all eight community samples, and in the eight clinical samples the endorsement rate ranges from 19 to 67 %. When illegal acts criterion is removed, the number of individuals diagnosed with GD does not change in four of the eight datasets, and three datasets show one individual in each dataset no longer diagnosed with GD and one dataset has two individuals who lose their GD diagnosis. The removal of the illegal acts criterion changed the diagnosis of 5 out of 3247 individuals (.15 %).

Table 6 Endorsement rates for illegal acts criterion in clinical and community samples and effect of absence/presence of illegal acts criterion for diagnosis of GD

Full size table

Discussion

The first research question was answered by computing reliability, validity and classification accuracy of the DSM-5 which found that the DSM-5 exhibited evidence of satisfactory reliability, validity and classification accuracy. The second question was answered by comparing DSM-5–DSM-IV on psychometric properties and the DSM-5 was similar to, and in some analyses better than, the DSM-IV. In terms of classification, the DSM-5 was slightly more accurate than DSM-IV, and the more significant error of false negatives, was reduced in the DSM-5, primarily due to the lowered threshold. The third question was answered by comparing the number of GD diagnoses without the illegal acts criterion to the number of GD diagnoses with the illegal acts criterion and it was found that five individuals, out of 3247, were no longer diagnosed with GD.

These results have three important diagnostic implications. First, lowering the threshold from five to four criteria had a modest improvement in diagnostic accuracy. Second, elimination of the illegal acts criterion had very little impact on diagnosis because most individuals who endorsed the illegal acts criterion had endorsed four or more of the other criteria and, therefore, had reached the DSM-5 threshold for diagnosis without the illegal acts criterion. Nevertheless, there were five individuals (out of 3247) who endorsed illegal acts but did not endorse four or more other criteria. Third, DSM-5 yields slightly higher GD prevalence rates than DSM-IV. This is largely due to the lower threshold from five to four criteria. Therefore, studies using DSM-IV diagnostic criteria are not directly comparable to studies using DSM-5 because of the lower cut score, the elimination of the illegal acts criterion, and the time frame of past 12 months in DSM-5.

In this study, the illegal acts criterion had the lowest endorsement rate of all ten diagnostic criteria in the clinical samples. Data from this study shows that a small number of individuals (5 out of 3247) lost their diagnosis of GD when the illegal acts criterion was eliminated. From a statistical standpoint, the elimination of illegal acts criterion has a very small impact on diagnostic accuracy because so few individuals are affected by it. From a clinical standpoint, it could be argued that this criterion should not be eliminated because it is known to be a symptom of GD. In recognition of these issues, the DSM-5 acknowledges illegal acts under the lying to others criterion where it states, “these instances of deceit may also include, but are not limited to, covering up illegal behaviors such as forgery, fraud, theft or embezzlement to obtain money with which to gamble (Criterion A7)” (APA 2013, p. 586). Thus, if clinicians and researchers inquire about illegal acts, and especially low threshold illegal acts such as “taking or borrowing” money from others to gamble without telling them, as examples of lying to others, then the effect of eliminating illegal acts as a stand-alone criterion will be attenuated.

These results indicate that, from a statistical standpoint, the illegal acts criterion can be eliminated with very little impact on diagnosis. There appears to be very few individuals who have engaged in illegal activity associated with their gambling and who have not already endorsed four or more other criteria.

While the DSM-5 showed modest improvements in diagnostic accuracy over the DSM-IV, the most important improvement is the lower false negative rate. From a clinical standpoint, false negatives are a more serious error than false positives. If someone who has GD is told that they do not have GD, this has the potential to result in serious consequences, such as continued gambling with adverse consequences. Lowering the threshold in DSM-5 reduced the false negative rate in all eight datasets, significantly in some datasets. In fact, reduction in the false negative rate could be justified even if the overall diagnostic accuracy was reduced, but in these datasets the false negative rate was reduced while maintaining high overall diagnostic accuracy that was as good as, or better than, the DSM-IV.

Limitations

This study has some limitations. First, the clinical sample was made up of individuals in treatment and there are many individuals with a GD who are not represented in this sample. A significant number of problem gamblers who have committed crimes are in prison rather than in treatment (Turner et al. 2009, [2013](/article/10.1007/s10899-015-9573-7#ref-CR40 "Turner, N. E., Preston, D. L., McAvoy, S., & Gillam, L. (2013). Problem gambling inside and out: The assessment of community and institutional problem gambling in the Canadian correctional system. Journal of Gambling Studies, 29(3), 435–451. doi: 10.1007/s10899-012-9321-1

              .")). Therefore, these results need to be cross-validated in other samples and in different settings. Second, the reference standard used in these datasets of group membership in either gambling treatment or from the local community was devised to obtain a comparison between a group with and without PG. This method is imperfect and is only a proxy for a reference standard, given that there is no biological marker for the identification of a GD. The limitation is that there may be some individuals in the gambling treatment sample who do not have a GD and there may be some individuals in the community sample who do have a GD. Third, three of the DSM-5 criteria have minor revisions to the wording, such as inserting the word “often” in the preoccupation criterion, but the content and meaning of these criteria remain unchanged. These minor wording revisions could possibly influence whether a person endorses the criterion or not, but it is unlikely to substantively change the results of this study. These minor wording revisions in DSM-5 need to be included in diagnostic instruments from this point forward.

Future Research Directions

Diagnostic criteria need to be further tested and cross-validated on larger and more diverse samples in a variety of settings (Gambino 2012). There is also the need to continue to generate additional diagnostic criteria. There may be other signs and symptoms that are better indicators of GD and therefore should be included in future revisions of the DSM. Also, some of the existing criteria are stronger indicators of GD than others and more research needs to be conducted on giving these items greater importance (weight) in the diagnostic process.

In summary, of the two revisions, the reduction of the cut score from five to four yields an improvement in diagnostic precision, particularly because it reduces the false negative rate, the more significant diagnostic error from a clinical standpoint. The elimination of the illegal acts criterion did not have much impact on diagnostic precision from a statistical standpoint due to the small number of persons who endorse this criterion and the even smaller number of persons who endorse this criterion who have not already endorsed four or more of the other criteria. By ensuring that illegal acts are addressed in the context of the lying to others criterion the effect of eliminating illegal acts as a stand-alone criterion can be minimized.

References

• American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
  Google Scholar
• American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., revised). Washington, DC: Author.
• American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
  Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
  Google Scholar
• Baldessarini, R. J., Finklestein, S., & Arana, G. W. (1983). The predictive power of diagnostic tests and the effect of prevalence of illness. Archives of General Psychiatry, 40, 569–573.
  Article CAS PubMed Google Scholar
• Cichetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.
  Article Google Scholar
• Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
  Article Google Scholar
• Denis, C., Fatseas, M., & Auriacombe, M. (2012). Analyses related to the development of DSM-5 criteria for substance use related disorders: 3. An assessment of Pathological Gambling criteria. Drug and Alcohol Dependence, 122, 22–27.
  Article PubMed Google Scholar
• DiStefano, C., & Morgan, G. (2011). Examining classification criteria: A comparison of three cut score methods. Psychological Assessment, 23(2), 354–363.
  Article PubMed Google Scholar
• Faraone, S. V., & Tsuang, M. T. (1994). Measuring diagnostic accuracy in the absence of a “Gold Standard”. American Journal of Psychiatry, 151, 650–657.
  Article CAS PubMed Google Scholar
• Ferris, J., & Wynne, H. (2001). The Canadian problem gambling index: Final report. Ottawa, ON: Canadian Centre on Substance Abuse.
  Google Scholar
• Fisher, S. (2000). Developing the DSM-IV-MR-J criteria to identify adolescent problem gambling in non-clinical populations. Journal of Gambling Studies, 16, 253–273.
  Article CAS PubMed Google Scholar
• Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). New York: Wiley.
  Google Scholar
• Friedman, A. S., & Cacciola, J. (1998). Validation of the criteria for DSM diagnoses of cocaine abuse and cocaine dependence. American Journal of Drug and Alcohol Abuse, 24, 169–177.
  Article CAS PubMed Google Scholar
• Gambino, B. (2006). Reflections on accuracy. Journal of Gambling Studies, 22, 393–404.
  Article PubMed Google Scholar
• Gambino, B. (2012). The validation of screening tests: Meet the new screen same as the old screen? Journal of Gambling Studies, 28, 573–605.
  Article PubMed Google Scholar
• Gebauer, L., LaBrie, R., & Shaffer, H. J. (2010). Optimizing DSM-IV-TR classification accuracy: A brief biosocial screen for detecting current gambling disorders among gamblers in the general household population. Canadian Journal of Psychiatry, 55(2), 82–90.
  PubMed Google Scholar
• Glascoe, F. P. (2005). Screening for developmental and behavioural problems. Mental Retardation and Developmental Disabilities Research Reviews, 11, 173–179.
  Article PubMed Google Scholar
• Granero, R., Penelo, E., Stinchfield, R., Fernandez-Aranda, F., Aymami, N., Gomez-Pena, M., et al. (2014). Contribution of illegal acts to pathological gambling diagnosis: DSM-5 implications. Journal of Addictive Diseases. doi:10.1080/10550887.2014.882730.
• Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2012). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling [Data file].
• Jimenez-Murcia, S., Stinchfield, R., Alvarez-Moya, E., Jaurrieta, N., Bueno, B., Granero, R., et al. (2009). Reliability, validity and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling. Journal of Gambling Studies, 25(1), 93–104.
  Article CAS PubMed Google Scholar
• Ledgerwood, D. M., Weinstock, J., Morasco, B. J., & Petry, N. M. (2007). Clinical features and treatment prognosis of pathological gamblers with and without recent gambling-related illegal behavior. Journal of the American Academy of Psychiatry and the Law, 35(3), 294–301.
  PubMed Google Scholar
• Lesieur, H. R. (1988). Altering the DSM-III criteria for pathological gambling. Journal of Gambling Behavior, 4, 38–47.
  Article Google Scholar
• Lesieur, H. R., & Blume, S. B. (1987). The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184–1188.
  Article CAS PubMed Google Scholar
• Lesieur, H. R., & Blume, S. B. (1993). Revising the South Oaks Gambling Screen in different settings. Journal of Gambling Studies, 9(3), 213–223.
  Article Google Scholar
• Lesieur, H. R., & Rosenthal, R. J. (1991). Pathological gambling: A review of the literature (prepared for the American Psychiatric Association Task Force on DSM-IV Committee on Disorders of Impulse Control Not Elsewhere Specified). Journal of Gambling Studies, 7, 5–39.
  Article CAS PubMed Google Scholar
• National Research Council. (1999). Pathological gambling: A critical review. Washington, DC: National Academy Press.
  Google Scholar
• Nunnally, J. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
  Google Scholar
• Petry, N. M. (2006). Should the scope of addictive behaviors be broadened to include pathological gambling? Addiction, 101(Suppl. 1), 152–160.
  Article PubMed Google Scholar
• Petry, N. M., Blanco, C., Stinchfield, R., & Volberg, R. (2013). An empirical evaluation of proposed changes for gambling diagnosis in the DSM-5. Addiction, 108, 575–581.
  Article PubMed Google Scholar
• Rosenthal, R. J. (1989). Pathological gambling and problem gambling: Problems of definitions and diagnosis. In H. J. Shaffer, S. A. Stein, B. Gambino, & T. N. Cummings (Eds.), Compulsive gambling: Theory, research, and practice (pp. 101–125). Lexington, MA: Lexington Books.
  Google Scholar
• Stinchfield, R. (2001). Reliability, validity, and classification accuracy of the South Oaks Gambling Screen (SOGS). Addictive Behaviors, 27, 1–19.
  Article Google Scholar
• Stinchfield, R. (2003). Reliability, validity, and classification accuracy of a measure of DSM-IV diagnostic criteria for pathological gambling. American Journal of Psychiatry, 160, 180–182.
  Article PubMed Google Scholar
• Stinchfield, R. (2014). A review of problem gambling assessment instruments and brief screens. In D. Richards, A. Blaszczynski, & L. Nower (Eds.), Wiley-Blackwell handbook of disordered gambling (pp. 165–203). Oxford: Wiley.
  Google Scholar
• Stinchfield, R., Govoni, R., & Frisch, R. G. (2005). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy. American Journal on Addictions, 14, 73–82.
  Article PubMed Google Scholar
• Stinchfield, R., McCready, J., & Govoni, R. (2012). DSM-IV diagnostic criteria for pathological gambling: Reliability, validity, and classification accuracy [Data file].
• Stinchfield, R., Winters, K. C., Botzet, A., Jerstad, S., & Breyer, J. (2007). Development and psychometric evaluation of the gambling treatment outcome monitoring system (GAMTOMS). Psychology of Addictive Behaviors, 21(2), 174–184.
  Article PubMed Google Scholar
• Strong, D. R., & Kahler, C. W. (2007). Evaluation of the continuum of gambling problems using the DSM-IV. Addiction, 102, 713–721.
  Article PubMed Google Scholar
• Temcheff, C. E., Derevensky, J. L., & Paskus, T. S. (2011). Pathological and disordered gambling: A comparison of DSM-IV and DSM-V criteria. International Gambling Studies, 11(2), 213–220.
  Article Google Scholar
• Turner, N. E., Preston, D. L., McAvoy, S., & Gillam, L. (2013). Problem gambling inside and out: The assessment of community and institutional problem gambling in the Canadian correctional system. Journal of Gambling Studies, 29(3), 435–451. doi:10.1007/s10899-012-9321-1.
  Article PubMed Google Scholar
• Turner, N. E., Preston, D. L., Saunders, C., McAvoy, S., & Jain, U. (2009). The relationship of problem gambling to criminal behaviour in a sample of Canadian male federal offenders. Journal of Gambling Studies, 25, 153–169.
  Article PubMed Google Scholar
• Zimmerman, M., Chelminski, I., & Young, D. (2006). A psychometric evaluation of the DSM-IV pathological gambling diagnostic criteria. Journal of Gambling Studies, 22, 329–337.
  Article PubMed Google Scholar

Download references

Author information

Authors and Affiliations

1. Department of Psychiatry, University of Minnesota Medical School, Minneapolis, MN, USA
   Randy Stinchfield & Ken C. Winters
2. Healthy Horizons Consulting, Toronto, ON, Canada
   John McCready
3. Centre for Addiction and Mental Health, University of Toronto, Toronto, ON, Canada
   Nigel E. Turner
4. Department of Psychiatry, University Hospital of Bellvitge-IDIBELL, Barcelona, Spain
   Susana Jimenez-Murcia
5. CIBEROBN, Barcelona, Spain
   Susana Jimenez-Murcia
6. University of Connecticut Health Center, Farmington, CT, USA
   Nancy M. Petry
7. Department of Psychiatry and Behavioral Neuroscience, University of Chicago, Chicago, IL, USA
   Jon Grant
8. Research Institute on Addictions, Buffalo, NY, USA
   John Welte
9. Louis Stokes Cleveland VA Medical Center, Cleveland, OH, USA
   Heather Chapman

Authors

1. Randy Stinchfield
   You can also search for this author inPubMed Google Scholar
2. John McCready
   You can also search for this author inPubMed Google Scholar
3. Nigel E. Turner
   You can also search for this author inPubMed Google Scholar
4. Susana Jimenez-Murcia
   You can also search for this author inPubMed Google Scholar
5. Nancy M. Petry
   You can also search for this author inPubMed Google Scholar
6. Jon Grant
   You can also search for this author inPubMed Google Scholar
7. John Welte
   You can also search for this author inPubMed Google Scholar
8. Heather Chapman
   You can also search for this author inPubMed Google Scholar
9. Ken C. Winters
   You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toRandy Stinchfield.

Ethics declarations

Ethical standard

All procedures performed in studies involving human participants were in accordance with the ethical standards of the University of Minnesota Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Appendix: Stinchfield’s Measure of DSM-IV Diagnostic Criteria for Pathological Gambling

Appendix: Stinchfield’s Measure of DSM-IV Diagnostic Criteria for Pathological Gambling

Preface to all questions: in the past 12 months…

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Cite this article

Stinchfield, R., McCready, J., Turner, N.E. et al. Reliability, Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV.J Gambl Stud 32, 905–922 (2016). https://doi.org/10.1007/s10899-015-9573-7

Download citation

• Published: 25 September 2015
• Issue Date: September 2016
• DOI: https://doi.org/10.1007/s10899-015-9573-7

Keywords