ES-Based Jacobian Enables Faster Bilevel Optimization (original) (raw)
Related papers
A Novel Hessian-Free Bilevel Optimizer via Evolution Strategies
2021
ArXiv, 2021
Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems
arXiv (Cornell University), 2021
Penalty Method for Inversion-Free Deep Bilevel Optimization
2019
Amortized Implicit Differentiation for Stochastic Bilevel Optimization
ArXiv, 2021
Bilevel Optimization and Machine Learning
2008
A Gradient-based Bilevel Optimization Approach for Tuning Hyperparameters in Machine Learning
ArXiv, 2020
A Globally Convergent Gradient-based Bilevel Hyperparameter Optimization Method
2022
Bilevel Optimization with a Lower-level Contraction: Optimal Sample Complexity without Warm-Start
2022
A Constrained Optimization Approach to Bilevel Optimization with Multiple Inner Minima
ArXiv, 2022
Expectigrad: Fast Stochastic Optimization with Robust Convergence Properties
ArXiv, 2020
An overview of bilevel optimization
Annals of Operations Research, 2007
Second-Order Stochastic Optimization for Machine Learning in Linear Time
arXiv (Cornell University), 2016
arXiv (Cornell University), 2020
arXiv (Cornell University), 2023
Bilevel Learning of Deep Representations
2021
The Continuous Stochastic Gradient Method: Part I -- Convergence Theory
arXiv (Cornell University), 2022
Second Order Stochastic Optimization in Linear Time
2016
Stochastic Natural Gradient Descent by estimation of empirical covariances
2011 IEEE Congress of Evolutionary Computation (CEC), 2011
Pessimistic Bilevel Optimization
SIAM Journal on Optimization, 2013
SDNA: Stochastic Dual Newton Ascent for Empirical Risk Minimization
Proximal Gradient Method for Solving Bilevel Optimization Problems
Mathematical and Computational Applications, 2020
On Adaptive Stochastic Gradient and Subgradient Methods
netfiles.uiuc.edu
arXiv (Cornell University), 2021
Swarm and Evolutionary Computation, 2019
Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization
SIAM Journal on Optimization, 2017
Second-order stochastic non-convex optimization
2020
Solving Pessimistic Bilevel Optimisation Problems with Evolutionary Algorithms
2021
A gentle Hessian for efficient gradient descent
2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004
On the solution of convex bilevel optimization problems
Computational Optimization and Applications, 2015
Stochastic nonlinear bilevel programming
Laura Wynter, Michael Patriksson
1997
Convergence Properties of Stochastic Hypergradients
2021
2018 IEEE Conference on Decision and Control (CDC)
Efficient Natural Gradient Descent Methods for Large-Scale Optimization Problems
2022
Mathematics