Basis pursuit denoising (original) (raw)
In applied mathematics and statistics, basis pursuit denoising (BPDN) refers to a mathematical optimization problem of the form where is a parameter that controls the trade-off between sparsity and reconstruction fidelity, is an solution vector, is an vector of observations, is an transform matrix and . This is an instance of convex optimization and also of quadratic programming. Some authors refer to basis pursuit denoising as the following closely related problem: When , this problem becomes basis pursuit.
| Property | Value |
|---|---|
| dbo:abstract | In applied mathematics and statistics, basis pursuit denoising (BPDN) refers to a mathematical optimization problem of the form where is a parameter that controls the trade-off between sparsity and reconstruction fidelity, is an solution vector, is an vector of observations, is an transform matrix and . This is an instance of convex optimization and also of quadratic programming. Some authors refer to basis pursuit denoising as the following closely related problem: which, for any given , is equivalent to the unconstrained formulation for some (usually unknown a priori) value of . The two problems are quite similar. In practice, the unconstrained formulation, for which most specialized and efficient computational algorithms are developed, is usually preferred. Either types of basis pursuit denoising solve a regularization problem with a trade-off between having a small residual (making close to in terms of the squared error) and making simple in the -norm sense. It can be thought of as a mathematical statement of Occam's razor, finding the simplest possible explanation (i.e. one that yields ) capable of accounting for the observations . Exact solutions to basis pursuit denoising are often the best computationally tractable approximation of an underdetermined system of equations. Basis pursuit denoising has potential applications in statistics (see the LASSO method of regularization), image compression and compressed sensing. When , this problem becomes basis pursuit. Basis pursuit denoising was introduced by Chen and Donoho in 1994, in the field of signal processing. In statistics, it is well known under the name LASSO, after being introduced by Tibshirani in 1996. (en) |
| dbo:wikiPageExternalLink | https://web.archive.org/web/20150502191143/http:/www.ugcs.caltech.edu/~srbecker/wiki/Category:Solvers https://web.archive.org/web/20150504060355/http:/ugcs.caltech.edu/~srbecker/wiki/Main_Page |
| dbo:wikiPageID | 29276362 (xsd:integer) |
| dbo:wikiPageLength | 4463 (xsd:nonNegativeInteger) |
| dbo:wikiPageRevisionID | 1123864063 (xsd:integer) |
| dbo:wikiPageWikiLink | dbr:Robert_Tibshirani dbr:David_Donoho dbr:Applied_mathematics dbr:Homotopy_continuation dbr:Interior-point_method dbr:Convex_optimization dbr:Mathematical_optimization dbr:Basis_pursuit dbr:Statistics dbr:Compressed_sensing dbr:Lasso_(statistics) dbr:Quadratic_programming dbr:Regularization_(mathematics) dbc:Mathematical_optimization dbr:Image_compression dbr:In-crowd_algorithm dbr:Occam's_razor dbr:Sparse_vector dbr:Fixed-point_continuation dbr:Spectral_projected_gradient_for_L1_minimization |
| dbp:wikiPageUsesTemplate | dbt:Citation_needed dbt:Reflist dbt:Short_description |
| dcterms:subject | dbc:Mathematical_optimization |
| rdfs:comment | In applied mathematics and statistics, basis pursuit denoising (BPDN) refers to a mathematical optimization problem of the form where is a parameter that controls the trade-off between sparsity and reconstruction fidelity, is an solution vector, is an vector of observations, is an transform matrix and . This is an instance of convex optimization and also of quadratic programming. Some authors refer to basis pursuit denoising as the following closely related problem: When , this problem becomes basis pursuit. (en) |
| rdfs:label | Basis pursuit denoising (en) |
| owl:sameAs | freebase:Basis pursuit denoising wikidata:Basis pursuit denoising https://global.dbpedia.org/id/4WXDb |
| prov:wasDerivedFrom | wikipedia-en:Basis_pursuit_denoising?oldid=1123864063&ns=0 |
| foaf:isPrimaryTopicOf | wikipedia-en:Basis_pursuit_denoising |
| is dbo:wikiPageRedirects of | dbr:BPDN |
| is dbo:wikiPageWikiLink of | dbr:List_of_numerical_analysis_topics dbr:Basis_pursuit dbr:Compressed_sensing dbr:Lasso_(statistics) dbr:Regularization_(mathematics) dbr:In-crowd_algorithm dbr:Total_variation_denoising dbr:Sparse_approximation dbr:BPDN |
| is foaf:primaryTopic of | wikipedia-en:Basis_pursuit_denoising |