A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery – Part II: an illustrative example (original) (raw)

Abstract

Background: Different methods have recently been proposed for predicting morbidity in intensive care units (ICU). The aim of the present study was to critically review a number of approaches for developing models capable of estimating the probability of morbidity in ICU after heart surgery. The study is divided into two parts. In this first part, popular models used to estimate the probability of class membership are grouped into distinct categories according to their underlying mathematical principles. Modelling techniques and intrinsic strengths and weaknesses of each model are analysed and discussed from a theoretical point of view, in consideration of clinical applications.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (71)

  1. de Keizer NF, de Jonge E: Performance of prognostic models in critically ill cancer patients -a review. Critical Care 2005, 9:R458-R463.
  2. Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform 2002, 35:352-359.
  3. Jaimes F, Fabiarz J, Alvarez D, Martinez C: Comparison between logistic regression and neural networks to predict death in patients with suspected sepsis in the emergency room. Crit Care 2005, 9:R150-156.
  4. Shahian DM, Blackstone EH, Edwards FH, Grover FL, Grunkemeier GL, Naftel DC, Nashef SA, Nugent WC, Peterson ED: Cardiac sur- gery risk models: a position article. Ann Thorac Surg 2004, 78:1868-1877.
  5. Biagioli B, Scolletta S, Cevenini G, Barbini E, Giomarelli P, Barbini P: A multivariate Bayesian model for assessing morbidity after coronary artery surgery. Crit Care 2006, 10:R94.
  6. Petros AJ, Marshall JC, Van Saene HKF: Should morbidity replace mortality as an end-point for clinical trials in intensive care? Lancet 1995, 345:369-371.
  7. Higgins TL, Estafanous FG, Loop FD, Beck GJ, Lee JC, Starr NJ, Knaus WA, Cosgrove DM III: ICU admission score for predicting mor- bidity and mortality risk after coronary artery bypass graft- ing. Ann Thorac Surg 1997, 64:1050-1058.
  8. Higgins TL, Estafanous FG, Loop FD, Beck GJ, Blum JM, Paranandi L: Stratification of morbidity and mortality outcome by preop- erative risk factors in coronary artery bypass patients. Jama 1992, 267:2344-2348.
  9. 9. van Wermeskerken GK, Lardenoye JW, Hill SE, Grocott HP, Phillips- Bute B, Smith PK, Reves JG, Newman MF: Intraoperative physio- logic variables and outcome in cardiac surgery: Part I. In- Hospital Mortality. Ann Thorac Surg 2000, 69:1070-1076.
  10. Reich DL, Bodian CA, Krol M, Kuroda M, Osinski T, Thys DM: Intra- operative hemodynamic predictors of mortality, stroke, and myocardial infarction after coronary artery bypass surgery. Anesth Analg 1999, 89:814-822.
  11. Higgins TL: Quantifying risk and assessing outcome in cardiac surgery. J Cardiothor Vasc Anesth 1998, 12:330-340.
  12. Murphy-Filkins R, Teres D, Lemeshow S, Hosmer DW: Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: How to distinguish a gen- eral from a specialty intensive care unit. Crit Care Med 1996, 24:1968-1973.
  13. Schafer JH, Maurer A, Jochimsen F, Emde C, Wegscheider K, Arntz HR, Heitz J, Krell-Schroeder B, Distler A: Outcome prediction models on admission in a medical intensive care unit: Do they predict individual outcome? Crit Care Med 1990, 18:1111-1117.
  14. Ryan TA, Rady MY, Bashour CA, Leventhal M, Lytle M, Starr NJ: Pre- dictors of outcome in cardiac surgical patients with pro- longed intensive care stay. Chest 1997, 112:1035-1042.
  15. Hosmer DW, Lemeshow S: Applied Logistic Regression New York: Wiley; 2000.
  16. O'Connor GT, Plume SK, Olmstead EM, Coffin LH, Morton JR, Maloney CT, Nowicki ER, Levy DG, Tryzelaar JF, Hernandez F, Adrian L, Casey KJ, Bundy D, Soule DN, Marrin CAS, Nugent WC, Charles- worth DC, Clough R, Katz S, Leavitt BJ, Wennberg JE: Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Circulation 1992, 85:2110-2118.
  17. Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985, 13:818-829.
  18. Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bas- tos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalised adults. Chest 1991, 100:1619-1636.
  19. Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Phys- iology score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270:2957-2963.
  20. Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPMII) based on an interna- tional cohort of intensive care unit patients. JAMA 1993, 270:2478-2486.
  21. Edwards FH, Peterson RF, Bridges C, Ceithaml EL: Use of a Baye- sian statistical model for risk assessment in coronary artery surgery. Ann Thorac Surg 1995, 59:1611-1612.
  22. Marshall G, Shroyer ALW, Grover FL, Hammermeister KE: Baye- sian-logit model for risk assessment in coronary artery bypass grafting. Ann Thorac Surg 1994, 57:1492-1500.
  23. Asimakopoulos G, Al-Ruzzeh S, Ambler G, Omar RZ, Punjabi P, Amrani M, Taylor KM: An evaluation of existing risk stratifica- tion models as a tool for comparison of surgical perform- ances for coronary artery bypass grafting between institutions. Eur J Cardiothorac Surg 2003, 23:935-941.
  24. Bridgewater B, Neve H, Moat N, Hooper T, Jones M: Predicting operative risk for coronary artery surgery in the United Kingdom: a comparison of various risk prediction algo- rithms. Heart 1998, 79:350-355.
  25. Tu JV, Weinstein MC, McNeil BJ, Naylor CD: Predicting mortality after coronary artery bypass surgery: what do artificial neu- ral networks learn? The Steering Committee of the Cardiac Care Network of Ontario. Med Decis Making 1998, 18:229-235.
  26. Lippmann RP, Shahian DM: Coronary artery bypass risk predic- tion using neural networks. Ann Thorac Surg 1997, 63:1635-1643.
  27. Knuiman MW, Vu HT, Segal MR: An empirical comparison of multivariable methods for estimating risk of death from cor- onary heart disease. J Cardiovasc Risk 1997, 4:127-134.
  28. Marshall G, Grover FL, Henderson WG, Hammermeister KE: Assessment of predictive models for binary outcomes: an empirical approach using operative death from cardiac sur- gery. Stat Med 1994, 13:1501-1511.
  29. Krumholz HM: Mathematical models and the assessment of performance in cardiology. Circulation 1999, 99:2067-2069.
  30. Omar RZ, Ambler G, Royston P, Eliahoo J, Taylor KM: Cardiac sur- gery risk modeling for mortality: a review of current practice and suggestions for improvement. Ann Thorac Surg 2004, 77:2232-2237.
  31. Geisser HJ, Holzl P, Marohl S, Kuhn-Regnier F, Mehlhorn U, Sudkamp M, De Vivie ER: Risk stratification in heart surgery: compari- son of six score systems. Eur J Cardiothorac Surg 2000, 17:400-406.
  32. Pitkanen O, Niskanen M, Rehnberg S, Hippelainen M, Hynynen M: Intra-institutional prediction of outcome after cardiac sur- gery: comparison between a locally derived model and the EuroSCORE. Eur J Cardiothorac Surg 2000, 18:703-710.
  33. Fukunaga K: Introduction to Statistical Pattern Recognition Boston: Aca- demic Press; 1990.
  34. Bishop CM: Neural Networks for Pattern Recognition New York: Oxford University Press Inc; 1995.
  35. Sivia DS, Skilling J: Data Analysis: A Bayesian Tutorial Oxford: Oxford University Press; 2006.
  36. Lee PM: Bayesian Statistics -An Introduction London: Arnold; 2004.
  37. Itskowitz P, Tropsha A: kappa Nearest neighbors QSAR mode- ling as a variational problem: theory and applications. J Chem Inf Model 2005, 45:777-785.
  38. Statnikov A, Aliferis CF, Tsamardinos I, Hardin D, Levy S: A compre- hensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformat- ics 2005, 21:631-643.
  39. Krzanowski WJ: Principles of Multivariate Analysis: A User's Perspective Oxford: Clarendon Press; 1988.
  40. Diamond GA: What price perfection? Calibration and discrim- ination of clinical prediction models. J Clin Epidemiol 1992, 45:85-89.
  41. Vapnik VN: The Nature of Statistical Learning Theory New York: Springer-Verlag; 1999.
  42. Ivanov J, Tu JV, Naylor CD: Ready-made, recalibrated, or remodeled? Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circula- tion 1999, 99:2098-2104.
  43. DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, Mark DB: Comparing risk-adjustment methods for provider profiling. Stat Med 1997, 16:2645-2664.
  44. Steyerberg EW, Borsboom GJ, van Houwelingen HC, Eijkemans MJ, Habbema JD: Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med 2004, 23:2567-2586.
  45. Ellenius J, Groth T: Methods for selection of adequate neural network structures with application to early assessment of chest pain patients by biochemical monitoring. Int J Med Inform 2000, 57:181-202.
  46. Jain AK, Chandrasekaran B: Dimensionality and Sample Size Considerations in Pattern Recognition Practice. Handbook of Statistics. Amsterdam 1982.
  47. Jennrich RI: Stepwise discriminant analysis. Statistical methods for digital computers. New York 1977:76-95.
  48. Armitage P, Berry G: Statistical methods in medical research Oxford: Blackwell Scientific Publications; 1987.
  49. Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristics (ROC) curve. Radiology 1982, 143:29-36.
  50. Mason SJ, Graham NE: Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quarterly Journal of the Royal Meteorological Society 2002, 128:2145-2166.
  51. Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L: The use of receiver operating characteristic curves in biomedical infor- matics. J Biomed Inform 2005, 38:404-415.
  52. Bamber DC: The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology 1975, 12:387-415.
  53. Obuchowski NA, Lieber ML, Wians FH Jr: ROC curves in clinical chemistry: uses, misuses, and possible solutions. Clin Chem 2004, 50:1118-25.
  54. Murphy AH: A new vector partition of the probability score. J Appl Meteor 1973, 12:595-600.
  55. Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K: Recali- bration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 2006, 34:1378-1388.
  56. Moran JL, Solomon PJ: Mortality and other event rates: what do they tell us about performance? Crit Care Resusc 2003, 5:292-304.
  57. Harrell FE Jr, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996, 15:361-387.
  58. Schulman P: Bayes' theorem -a review. Cardiol Clin 1984, 2:319-327.
  59. Artioli E, Avanzolini G, Barbini P, Cevenini G, Gnudi G: Classifica- tion of postoperative cardiac patients: comparative evalua- tion of four algorithms. Int J Biomed Comput 1991, 29:257-270.
  60. Duda RO, Hart PE, Stork DG: Pattern Classification New York: John Wiley and Sons; 2001.
  61. Campbell MK, Donner A: Classification efficiency of multino- mial logistic regression relative to ordinal logistic regression. J Am Stat Assoc 1989, 84:587-591.
  62. Tabachnick BG, Fidell LS: Using Multivariate Statistics New York: Harper Collins; 1996.
  63. Friedman GD: Primer of Epidemiology New York: McGraw Hill; 2004.
  64. Agresti A: On logit confidence intervals for the odds ratio with small samples. Biometrics 1999, 55:597-602.
  65. Silverman BW: Density Estimation for Statistics and Data Analysis Lon- don: Chapman and Hall; 1986.
  66. Gangopadhyay S, Clark M, Rajagopalan B: Statistical downscaling using K-nearest neighbors. Water Resources Research 2005, 41:W02024, 1-23.
  67. Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY: An opti- mal algorithm for approximate nearest neighbor searching in fixed dimensions. Journal of the ACM 1998, 45:891-923.
  68. Azzalini A: Logistic regression for autocorrelated data with application to repeated measures. Biometrika 1994, 81:767-775.
  69. Le Cessie S, Van Houwelingen JC: Logistic regression for corre- lated binary data. Appl Statist 1994, 43:95-108.
  70. Liang K-Y, Zeger SL: Regression analysis for correlated data. Annu Rev Pub Health 1993, 14:43-68.
  71. Cevenini G, Barbini E, Scoletta S, Biagioli B, Giomarelli P, Barbini P: A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery -Part II: an illustra- tive example. BMC Med Inf Dec Mak 2007, 7:36.