Ensemble Conditional Variance Estimator for Sufficient Dimension Reduction (original) (raw)

Abstract

Ensemble Conditional Variance Estimation (ECVE) is a novel sufficient dimension reduction (SDR) method in regressions with continuous response and predictors. ECVE applies to general non-additive error regression models. It operates under the assumption that the predictors can be replaced by a lower dimensional projection without loss of information.It is a semiparametric forward regression model based exhaustive sufficient dimension reduction estimation method that is shown to be consistent under mild assumptions. It is shown to outperform central subspace mean average variance estimation (csMAVE), its main competitor, under several simulation settings and in a benchmark data set analysis.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (29)

  1. Kofi P. Adragni and R. Dennis Cook. Sufficient dimension reduction and prediction in regression. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 367(1906):4385-4405, 11 2009.
  2. Takeshi Amemiya. Advanced econometrics. Harvard university press, 1985.
  3. W. M. Boothby. An Introduction to Differentiable Manifolds and Riemannian Geometry. Academic Press, 2002.
  4. William S. Cleveland and Susan J. Devlin. Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83(403):596-610, 1988.
  5. R.Dennis Cook and Bing Li. Dimension reduction for conditional mean in regression. Ann. Statist., 30(2):455-474, 04 2002.
  6. Dennis R. Cook. Regression Graphics: Ideas for studying regressions through graphics. Wiley, New York, 1998.
  7. R. Dennis Cook. Fisher lecture: Dimension reduction in regression. Statist. Sci., 22(1):1-26, 02 2007.
  8. Arnold M. Faden. The existence of regular conditional probabilities: Necessary and sufficient conditions. The Annals of Probability, 13(1):288-298, 1985.
  9. Lukas Fertl and Efstathia Bura. Conditional variance estimator for sufficient dimension reduction, 2021.
  10. Jerome H. Friedman. Multivariate adaptive regression splines. The Annals of Statistics, 19(1):1-67, 1991.
  11. Phillip Griffiths and Joseph Harris. Principles of algebraic geometry. Wiley Classics Library. John Wiley & Sons, Inc., New York, 1994. Reprint of the 1978 original.
  12. Bruce E. Hansen. Uniform convergence rates for kernel estimation with dependent data. Econometric Theory, 24:726-748, 2008.
  13. H. Heuser. Analysis 2, 9 Auflage. Teubner, 1995.
  14. Robert I. Jennrich. Asymptotic properties of non-linear least squares estimators. Ann. Math. Statist., 40(2):633-643, 04 1969.
  15. Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. An Introduction to Statistical Learning: with Applications in R. Springer, 2013.
  16. Alan F. Karr. Probability. Springer Texts in Statistics. Springer-Verlag New York, 1993.
  17. K. C. Li. Sliced inverse regression for dimension reduction. Journal of the American Statistical Association, 86(414):316-327, 1991.
  18. Bing Li. Sufficient dimension reduction: methods and applications with R. CRC Press, Taylor & Francis Group, 2018.
  19. D. Leao Jr., M. Fragoso, and P. Ruffino. Regular conditional probability, disintegration of probability and radon spaces. Proyecciones (Antofagasta), 23:15 -29, 05 2004.
  20. MMW + 63] M.R. Mickey, P.B. Mundle, D.N. Walker, A.M. Glinski, Inc C-E-I-R, and Aerospace Research Labora- tories (U.S.). Test Criteria for Pearson Type III Distributions. ARL (Aerospace Research Laboratories (U.S.
  21. Yanyuan Ma and Liping Zhu. A review on dimension reduction. International Statistical Review, 81(1):134-150, 4 2013.
  22. S.N27] S.N.Bernstein. Theory of Probability. 1927.
  23. Hemant D. Tagare. Notes on optimization on stiefel manifolds, January 2011.
  24. Hansheng Wang and Yingcun Xia. Sliced regression for dimension reduction. Journal of the American Statistical Association, 103(482):811-821, 2008.
  25. Hang Weiqiang and Xia Yingcun. MAVE: Methods for Dimension Reduction, 2019. R package version 1.3.10.
  26. Yingcun Xia, Howell Tong, W. K. Li, and Li-Xing Zhu. An adaptive estimation of dimension reduction space. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(3):363-410, 2002.
  27. Xiangrong Yin and Bing Li. Sufficient dimension reduction based on an ensemble of minimum average variance estimators. Ann. Statist., 39(6):3392-3416, 12 2011.
  28. Xiangrong Yin, Bing Li, and R. Cook. Successive direction extraction for estimating the central subspace in a multiple-index regression. Journal of Multivariate Analysis, 99:1733-1757, 09 2008.
  29. Peng Zeng and Yu Zhu. An integral transform method for estimating the central mean and central subspaces. Journal of Multivariate Analysis, 101(1):271 -290, 2010.