Stochastic approximation (original) (raw)
Стохастическая аппроксимация — рекуррентный метод построения состоятельной последовательности оценок решений уравнений регрессии и экстремумов функций регрессии в задачах непараметрического оценивания. В биологии, химии, медицине используется для анализа результатов опытов. В теории автоматического управления применяется как средство решения задач распознавания, идентификации, обучения и адаптации.Основоположниками метода стохастической аппроксимации являются Кифер, Вольфовиц, Робинс, Монро .
| Property | Value |
|---|---|
| dbo:abstract | Stochastic approximation methods are a family of iterative methods typically used for root-finding problems or for optimization problems. The recursive update rules of stochastic approximation methods can be used, among other things, for solving linear systems when the collected data is corrupted by noise, or for approximating extreme values of functions which cannot be computed directly, but only estimated via noisy observations. In a nutshell, stochastic approximation algorithms deal with a function of the form which is the expected value of a function depending on a random variable . The goal is to recover properties of such a function without evaluating it directly. Instead, stochastic approximation algorithms use random samples of to efficiently approximate properties of such as zeros or extrema. Recently, stochastic approximations have found extensive applications in the fields of statistics and machine learning, especially in settings with big data. These applications range from stochastic optimization methods and algorithms, to online forms of the EM algorithm, reinforcement learning via temporal differences, and deep learning, and others.Stochastic approximation algorithms have also been used in the social sciences to describe collective dynamics: fictitious play in learning theory and consensus algorithms can be studied using their theory. The earliest, and prototypical, algorithms of this kind are the Robbins–Monro and Kiefer–Wolfowitz algorithms introduced respectively in 1951 and 1952. (en) Стохастическая аппроксимация — рекуррентный метод построения состоятельной последовательности оценок решений уравнений регрессии и экстремумов функций регрессии в задачах непараметрического оценивания. В биологии, химии, медицине используется для анализа результатов опытов. В теории автоматического управления применяется как средство решения задач распознавания, идентификации, обучения и адаптации.Основоположниками метода стохастической аппроксимации являются Кифер, Вольфовиц, Робинс, Монро . (ru) |
| dbo:wikiPageID | 8979437 (xsd:integer) |
| dbo:wikiPageLength | 26942 (xsd:nonNegativeInteger) |
| dbo:wikiPageRevisionID | 1113581937 (xsd:integer) |
| dbo:wikiPageWikiLink | dbr:John_U._Monro dbr:Deep_learning dbr:Iterative_methods dbr:Convergence_of_random_variables dbr:Estimation dbr:Control_theory dbr:Temporal_difference_learning dbc:Statistical_approximations dbr:Stochastic_gradient_descent dbr:Random_variable dbr:Herbert_Robbins dbr:Jack_Kiefer_(statistician) dbr:Jacob_Wolfowitz dbc:Stochastic_optimization dbr:Aryeh_Dvoretzky dbr:Big_data dbr:Optimization_problem dbr:Simultaneous_perturbation_stochastic_approximation dbr:Expectation–maximization_algorithm dbr:Robust_statistics dbr:Stochastic_optimization dbr:Stochastic_variance_reduction dbr:Extremum dbr:Root-finding dbr:C._Johan_Masreliez dbr:R._Douglas_Martin |
| dbp:wikiPageUsesTemplate | dbt:Reflist dbt:Short_description dbt:Statistics |
| dct:subject | dbc:Statistical_approximations dbc:Stochastic_optimization |
| rdf:type | yago:WikicatStatisticalApproximations yago:Abstraction100002137 yago:Calculation105802185 yago:Cognition100023271 yago:Estimate105803379 yago:HigherCognitiveProcess105770664 yago:ProblemSolving105796750 yago:Process105701363 yago:PsychologicalFeature100023100 yago:Thinking105770926 |
| rdfs:comment | Стохастическая аппроксимация — рекуррентный метод построения состоятельной последовательности оценок решений уравнений регрессии и экстремумов функций регрессии в задачах непараметрического оценивания. В биологии, химии, медицине используется для анализа результатов опытов. В теории автоматического управления применяется как средство решения задач распознавания, идентификации, обучения и адаптации.Основоположниками метода стохастической аппроксимации являются Кифер, Вольфовиц, Робинс, Монро . (ru) Stochastic approximation methods are a family of iterative methods typically used for root-finding problems or for optimization problems. The recursive update rules of stochastic approximation methods can be used, among other things, for solving linear systems when the collected data is corrupted by noise, or for approximating extreme values of functions which cannot be computed directly, but only estimated via noisy observations. The earliest, and prototypical, algorithms of this kind are the Robbins–Monro and Kiefer–Wolfowitz algorithms introduced respectively in 1951 and 1952. (en) |
| rdfs:label | Stochastic approximation (en) Стохастическая аппроксимация (ru) |
| owl:sameAs | freebase:Stochastic approximation yago-res:Stochastic approximation wikidata:Stochastic approximation dbpedia-ru:Stochastic approximation https://global.dbpedia.org/id/6RtY8 |
| prov:wasDerivedFrom | wikipedia-en:Stochastic_approximation?oldid=1113581937&ns=0 |
| foaf:isPrimaryTopicOf | wikipedia-en:Stochastic_approximation |
| is dbo:knownFor of | dbr:Aryeh_Dvoretzky |
| is dbo:wikiPageRedirects of | dbr:Kiefer-Wolfowitz_algorithm dbr:Kiefer-Wolfowitz_method dbr:Kiefer-Wolfowitz_procedure dbr:Kiefer-Wolfowitz_process dbr:Finite-difference_stochastic_approximation dbr:Robbins-Monro_algorithm dbr:Robbins-Monro_method dbr:Robbins-Monro_procedure dbr:Robbins-Monro_process dbr:Robbins–Monro_algorithm |
| is dbo:wikiPageWikiLink of | dbr:John_U._Monro dbr:List_of_numerical_analysis_topics dbr:Pál_Révész dbr:Elastix_(image_registration) dbr:Optimal_design dbr:Li_Cai_(psychometrician) dbr:B._D._Kulkarni dbr:Stochastic_gradient_descent dbr:Rademacher_distribution dbr:Herbert_Robbins dbr:Jack_Kiefer_(statistician) dbr:Aryeh_Dvoretzky dbr:Simultaneous_perturbation_stochastic_approximation dbr:List_of_statistics_articles dbr:Simulation-based_optimization dbr:Stochastic_optimization dbr:Stochastic_variance_reduction dbr:Kiefer-Wolfowitz_algorithm dbr:Kiefer-Wolfowitz_method dbr:Kiefer-Wolfowitz_procedure dbr:Kiefer-Wolfowitz_process dbr:Finite-difference_stochastic_approximation dbr:Robbins-Monro_algorithm dbr:Robbins-Monro_method dbr:Robbins-Monro_procedure dbr:Robbins-Monro_process dbr:Robbins–Monro_algorithm |
| is foaf:primaryTopic of | wikipedia-en:Stochastic_approximation |