Regularization Paths for Generalized Linear Models via Coordinate Descent - PubMed (original) (raw)
Regularization Paths for Generalized Linear Models via Coordinate Descent
Jerome Friedman et al. J Stat Softw. 2010.
Abstract
We develop fast algorithms for estimation of generalized linear models with convex penalties. The models include linear regression, two-class logistic regression, and multinomial regression problems while the penalties include ℓ(1) (the lasso), ℓ(2) (ridge regression) and mixtures of the two (the elastic net). The algorithms use cyclical coordinate descent, computed along a regularization path. The methods can handle large problems and can also deal efficiently with sparse features. In comparative timings we find that the new algorithms are considerably faster than competing methods.
Figures
Figure 1
Leukemia data: profiles of estimated coefficients for three methods, showing only first 10 steps (values for λ) in each case. For the elastic net, α = 0.2.
Similar articles
- Regularization Paths for Cox's Proportional Hazards Model via Coordinate Descent.
Simon N, Friedman J, Hastie T, Tibshirani R. Simon N, et al. J Stat Softw. 2011 Mar;39(5):1-13. doi: 10.18637/jss.v039.i05. J Stat Softw. 2011. PMID: 27065756 Free PMC article. - Elastic Net Regularization Paths for All Generalized Linear Models.
Tay JK, Narasimhan B, Hastie T. Tay JK, et al. J Stat Softw. 2023;106:1. doi: 10.18637/jss.v106.i01. Epub 2023 Mar 23. J Stat Softw. 2023. PMID: 37138589 Free PMC article. - Sparse conditional logistic regression for analyzing large-scale matched data from epidemiological studies: a simple algorithm.
Avalos M, Pouyes H, Grandvalet Y, Orriols L, Lagarde E. Avalos M, et al. BMC Bioinformatics. 2015;16 Suppl 6(Suppl 6):S1. doi: 10.1186/1471-2105-16-S6-S1. Epub 2015 Apr 17. BMC Bioinformatics. 2015. PMID: 25916593 Free PMC article. - Sparse Logistic Regression With L 1/2 Penalty for Emotion Recognition in Electroencephalography Classification.
Chen DW, Miao R, Deng ZY, Lu YY, Liang Y, Huang L. Chen DW, et al. Front Neuroinform. 2020 Aug 7;14:29. doi: 10.3389/fninf.2020.00029. eCollection 2020. Front Neuroinform. 2020. PMID: 32848688 Free PMC article. - Structured sparsity regularization for analyzing high-dimensional omics data.
Vinga S. Vinga S. Brief Bioinform. 2021 Jan 18;22(1):77-87. doi: 10.1093/bib/bbaa122. Brief Bioinform. 2021. PMID: 32597465 Review.
Cited by
- Integrative analysis of multiple cell death model for precise prognosis and drug response prediction in gastric cancer.
Su W, Shi X, Wen X, Li X, Zhou J, Zhou Y, Ren F, Kang K. Su W, et al. Discov Oncol. 2024 Oct 8;15(1):532. doi: 10.1007/s12672-024-01411-4. Discov Oncol. 2024. PMID: 39377861 - Identification of an immune-related genes signature in lung adenocarcinoma to predict survival and response to immune checkpoint inhibitors.
Davoodi-Moghaddam Z, Jafari-Raddani F, Kordasti S, Bashash D. Davoodi-Moghaddam Z, et al. J Egypt Natl Canc Inst. 2024 Oct 7;36(1):30. doi: 10.1186/s43046-024-00236-0. J Egypt Natl Canc Inst. 2024. PMID: 39370456 - Multiregional transcriptomic profiling provides improved prognostic insight in localized non-small cell lung cancer.
Li C, Nguyen TT, Li JR, Song X, Fujimoto J, Little L, Gumb C, Chow CB, Wistuba II, Futreal AP, Zhang J, Hubert SM, Heymach JV, Wu J, Amos CI, Zhang J, Cheng C. Li C, et al. NPJ Precis Oncol. 2024 Oct 5;8(1):225. doi: 10.1038/s41698-024-00680-0. NPJ Precis Oncol. 2024. PMID: 39369068 Free PMC article. - Using machine learning to understand social isolation and loneliness in schizophrenia, bipolar disorder, and the community.
Abplanalp SJ, Green MF, Wynn JK, Eisenberger NI, Horan WP, Lee J, McCleery A, Miklowitz DJ, Reddy LF, Reavis EA. Abplanalp SJ, et al. Schizophrenia (Heidelb). 2024 Oct 5;10(1):88. doi: 10.1038/s41537-024-00511-y. Schizophrenia (Heidelb). 2024. PMID: 39368972 Free PMC article. - Machine learning and Bayesian network analyses identifies associations with insomnia in a national sample of 31,285 treatment-seeking college students.
Calderon A, Baik SY, Ng MHS, Fitzsimmons-Craft EE, Eisenberg D, Wilfley DE, Taylor CB, Newman MG. Calderon A, et al. BMC Psychiatry. 2024 Oct 5;24(1):656. doi: 10.1186/s12888-024-06074-7. BMC Psychiatry. 2024. PMID: 39367432 Free PMC article.
References
- Candes E, Tao T. The Dantzig selector: statistical estimation when p is much larger than n. Annals of Statistics. 2007;35(6):2313–2351.
- Chen SS, Donoho D, Saunders M. Atomic decomposition by basis pursuit. SIAM Journal on Scientific Computing. 1998;20(1):33–61.
- Daubechies I, Defrise M, De Mol C. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communications on Pure and Applied Mathematics. 2004;57:1413–1457.
- Dettling M. Bagboosting for tumor classification with gene expression data. Bioinformatics. 2004:3583–3593. - PubMed
- Donoho DL, Johnstone IM. Ideal spatial adaptation by wavelet shrinkage. Biometrika. 1994;81:425–455.
LinkOut - more resources
Full Text Sources
Other Literature Sources