Ranked sparsity: a cogent regularization framework for selecting and estimating feature interactions and polynomials (original) (raw)

References

• Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control 1(9), 716–723 (1974)
  Article MathSciNet Google Scholar
• Bien, J., Taylor, J., Tibshirani, R.: A lasso for hierarchical interactions. Ann. Stat. 4(1), 1111–1141 (2013)
  MathSciNet MATH Google Scholar
• Bogdan, M., Frommlet, F., Biecek, P., Cheng, R., Ghosh, J.K., Doerge, R.: Extending the modified Bayesian information criterion (mBIC) to dense markers and multiple interval mapping. Biometrics 6(4), 1162–1169 (2008)
  Article MathSciNet Google Scholar
• Boulesteix, A.-L., De Bin, R., Jiang, X., Fuchs, M.: IPF-lasso: integrative-penalized regression with penalty factors for prediction based on multi-omics data. Comput. Math. Methods Med. 2017, 7691937 (2017)
  Article Google Scholar
• Breheny, P.J.: Marginal false discovery rates for penalized regression models. Biostatistics 2, 299–314 (2018)
  MathSciNet Google Scholar
• Breheny, P., Huang, J.: Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection. Ann. Appl. Stat. 5, 232–253 (2011)
  Article MathSciNet Google Scholar
• Chen, J., Chen, Z.: Extended Bayesian information criteria for model selection with large model spaces. Biometrika 9(5), 759–771 (2008)
  Article MathSciNet Google Scholar
• Chipman, H.: Bayesian variable selection with related predictors. Can. J. Stat. La Revue Canadienne de Statistique 2(4), 17–36 (1996)
  Article MathSciNet Google Scholar
• Choi, N.H., Li, W., Zhu, J.: Variable selection with the strong heredity constraint and its oracle property. J. Am. Stat. Assoc. 105, 354–364 (2010)
  Article MathSciNet Google Scholar
• Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 9(6), 1348–1360 (2001)
  Article MathSciNet Google Scholar
• Friedman, J., Hastie, T., Tibshirani, R.: A note on the group lasso and a sparse group lasso. Preprint arXiv:1001.0736 (2010)
• Hao, N., Feng, Y., Zhang, H.H.: Model selection for high-dimensional quadratic regression via regularization. J. Am. Stat. Assoc. 113, 615–625 (2018)
  Article MathSciNet Google Scholar
• Hurvich, C.M., Tsai, C.-L.: Regression and time series model selection in small samples. Biometrika 7(6), 297–307 (1989)
  Article MathSciNet Google Scholar
• Klau, S., Jurinovic, V., Hornung, R., Herold, T., Boulesteix, A.-L.: Priority-lasso: a simple hierarchical approach to the prediction of clinical outcome using multi-omics data. BMC Bioinform. 1(9), 322 (2018)
  Article Google Scholar
• Kuhn, M., Wickham, H.: recipes: preprocessing tools to create design matrices. R package, available at https://CRAN.R-project.org/package=recipes (2019)
• Lim, M., Hastie, T.: Learning interactions via hierarchical group-lasso regularization. J. Comput. Graph. Stat. 2(4), 627–654 (2015)
  Article MathSciNet Google Scholar
• Mallows, C.L.: Some comments on Cp. Technometrics 1(5), 661–675 (1973)
  MATH Google Scholar
• Miller, R.E., Breheny, P.: Marginal false discovery rate control for likelihood-based penalized regression models. Biometr. J. 6(1), 889–901 (2019)
  Article MathSciNet Google Scholar
• Miller, A.C., Peterson, R.A., Singh, I., Pilewski, S., Polgreen, P.M.: Improving state-level influenza surveillance by incorporating real-time smartphone-connected thermometer readings across different geographic domains. Open Forum Infect. Dis. 6, ofz455 (2019)
  Article Google Scholar
• Peterson, R.A.: Ranked Sparsity: A Regularization Framework for Selecting Features in the Presence of Prior Informational Asymmetry. PhD thesis, Department of Biostatistics, University of Iowa (2019)
• Peterson, R.A.: Finding optimal normalizing transformations via bestNormalize. R J. 1(3), 310–329 (2021)
  Article Google Scholar
• Peterson, R.A., Cavanaugh, J.E.: Ordered quantile normalization: a semiparametric transformation built for the cross-validation era. J. Appl. Stat. 4(7), 2312–2327 (2020)
  Article MathSciNet Google Scholar
• R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2020)
  Google Scholar
• Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978)
  Article MathSciNet Google Scholar
• Shedden, K., Taylor, J., Enkemann, S., Tsao, M., Yeatman, T., Gerald, W., et al.: Gene expression-based survival prediction in lung adenocarcinoma: a multi-site, blinded validation study. Nat. Med. 1(4), 822–827 (2008)
  Google Scholar
• Ternès, N., Rotolo, F., Heinze, G., Michiels, S.: Identification of biomarker-by-treatment interactions in randomized clinical trials with survival outcomes and high-dimensional spaces. Biometr. J. 5(9), 685–701 (2017)
  Article MathSciNet Google Scholar
• Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 5(8), 267–288 (1996)
  MathSciNet MATH Google Scholar
• Wang, M., Wang, X.: Adaptive lasso estimators for ultrahigh dimensional generalized linear models. Stat. Probab. Lett. 8(9), 41–50 (2014)
  MathSciNet MATH Google Scholar
• Wood, S.N.: Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J. R. Stat. Soc. (B) 7(3), 3–36 (2011)
  Article MathSciNet Google Scholar
• Zeng, Y., Breheny, P.: The biglasso package: a memory- and computation-efficient solver for lasso model fitting with big data in R. R J. 1(2), 6–19 (2021)
  Article Google Scholar
• Zhang, C.-H.: Nearly unbiased variable selection under minimax concave penalty. Ann. Stat. 3(8), 894–942 (2010)
  MathSciNet MATH Google Scholar
• Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101, 1418–1429 (2006)
  Article MathSciNet Google Scholar

Download references