Convergence theorems for a class of simulated annealing algorithms on ℝd | Journal of Applied Probability | Cambridge Core (original) (raw)

Abstract

We study a class of simulated annealing algorithms for global minimization of a continuous function defined on a subset of We consider the case where the selection Markov kernel is absolutely continuous and has a density which is uniformly bounded away from 0. This class includes certain simulated annealing algorithms recently introduced by various authors. We show that, under mild conditions, the sequence of states generated by these algorithms converges in probability to the global minimum of the function. Unlike most previous studies where the cooling schedule is deterministic, our cooling schedule is allowed to be adaptive. We also address the issue of almost sure convergence versus convergence in probability.

References

Aarts, E. H. L. and Laarhoven, P. J. M. van (1989) Simulated annealing: an introduction. Statist. Neerlandica 43, 31–52.CrossRefGoogle Scholar

Bélisle, C. J. P., Romeijn, H. E. and Smith, R. L. (1990) Hide-and seek: a simulated annealing algorithm for global optimization. , Department of Industrial and Operations Research, The University of Michigan.Google Scholar

Bélisle, C. J. P., Romeijn, H. E. and Smith, R. L. (1992) Hit-and-run algorithms for generating multivariate distributions. Math. Operat. Res. .Google Scholar

Berbee, H. C. P., Boender, C. G. E., Rinnooy Kan, A. H. G., Scheffer, C. L., Smith, R. L. and Telgen, J. (1987) Hit-and-run algorithms for the identification of nonredundant linear inequalities. Math. Prog. 37, 184–207.CrossRefGoogle Scholar

Dekkers, A. and Aarts, E. (1991) Global optimization and simulated annealing. Math. Prog. 50, 367–393.Google Scholar

Geman, S. and Geman, D. (1984) Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Int. 6, 721–741.CrossRefGoogle ScholarPubMed

Gidas, B. (1985) Non-stationary Markov chains and convergence of the annealing algorithm. J. Statist. Phys. 39, 73–131.Google Scholar

Hajek, B. (1985) A tutorial survey of theory and applications of simulated annealing. IEEE Conference on Decision and Control.CrossRefGoogle Scholar

Hajek, B. (1988) Cooling schedules for optimal annealing. Math. Operat. Res. 13, 311–329.CrossRefGoogle Scholar

Royden, H. L. (1968) Real Analysis, 2nd edn. Macmillan, New York.Google Scholar