Brain storm optimization using a slight relaxation selection and multi-population based creating ideas ensemble (original) (raw)

Abstract

Brain storm optimization is a swarm intelligence algorithm inspired by the brainstorming process in human beings. Many researchers have paid much more attention to it, and many attempts have been made to improve it’s performance. The search ability of brain storm optimization is maintained by the creating process of ideas, but it still suffers from sticking into stagnation during exploitation phase. This paper proposes a novel brain storm optimization variant, named RMBSO, in which a slight relaxation selection and multi-population based creating ideas ensemble are employed to improve the performance of brain storm optimization on global optimization problem with diverse landscapes. Firstly, the basic framework of original brain storm optimization is imbedded into multi-population based ensemble of heterogeneous but complementary creating ideas to make the algorithm jump out of stagnation with strong searching ability. Secondly, a new triangular mutation ruler and a simple partition of subpopulations are designed to better balance exploration and exploitation. Thirdly, a slight relaxation selection mechanism instead of greedy choice is first developed to keep the population’s diversity. Finally, extensive experiments on the suit of CEC 2015 benchmark functions and statistical comparisons are executed. Experimental results indicate that the proposed algorithm is significantly better than, or at least comparable to the state-of-the-art brain storm optimization variants and several improved differential evolution algorithms.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization KanGAL report, vol 2005005. IIT Kanpur, India
    Google Scholar
  2. Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading
    MATH Google Scholar
  3. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks. IEEE Press, New Jersey, pp 1942–1948
  4. Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics Part B (Cybernetics) 26(1):29–41
    Article Google Scholar
  5. Muzaffar E, Kevin L, Fayzul P (2006) Shuffled frog leaping algorithm: a memetic meta-heuristic for discrete optimization. Eng Optim 38(2):129–154
    Article MathSciNet Google Scholar
  6. Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471
    Article MathSciNet Google Scholar
  7. Bastos Filho CJ, de Lima Neto FB, Lins AJ, Nascimento AI, Lima MP (2008) A novel search algorithm based on fish school behavior. In: IEEE International conference on systems, man and cybernetics. IEEE, Los Alamitos, pp 2646–2651
  8. Shah-Hosseini H (2009) The intelligent water drops algorithm: a nature-inspired swarm-based optimization algorithm. Int J Bio-Inspir Com 1(2):71–79
    Article MathSciNet Google Scholar
  9. Yang XS, Press L (2010) Firefly algorithm. Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Bristol
    Google Scholar
  10. Shi Y (2015) An optimization algorithm based on brainstorming process. In: Emerging research on swarm intelligence and algorithm optimization. IGI global, pp. 1-35
  11. Zhang W, Zhang Y, Peng C (2019) Brain storm optimization for feature selection using new individual clustering and updating mechanism. Appl Intell. https://doi.org/10.1007/s10489-019-01513-5
  12. Pourpanah F, Shi Y, Lim C, Hao Q, Tan C (2019) Feature selection based on brain storm optimization for data classification. Appl Soft Comput 80:761–775
    Article Google Scholar
  13. Yadav P (2018) Cluster based-image descriptors and fractional hybrid optimization for medical image retrieval. Cluster Computing. https://doi.org/10.1007/s10586-017-1625-6
  14. Wu L, He Z, Chen Y, Wu D, Cui J (2019) Brainstorming-based ant colony optimization for vehicle routing with soft time windows. IEEE Access 7:19643–19652
    Article Google Scholar
  15. Sato M, Fukuyama Y, Iizaka T, Matsui T (2019) Total optimization of energy networks in a smart city by Multi-Population Global-Best modified brain storm optimization with migration. Algorithms 12:15
    Article MathSciNet Google Scholar
  16. Shi Y (2011) Brain storm optimization algorithm. In: International conference in swarm intelligence. Springer, Berlin, pp 303–309
  17. Zhan Z, Zhang J, Shi Y, Liu H (2012) A modified brain storm optimization. In: Evolutionary computation (CEC), IEEE congress on IEEE, 2012, pp. 1-8
  18. Cao Z, Shi Y, Rong X, Liu B, Du Z, Yang B (2015) Random grouping brain storm optimization algorithm with a new dynamically changing step size. In: Proc. international conference on swarm intelligence, pp. 387-364
  19. Chen J, Cheng S, Chen Y, Xie Y, Shi Y (2015) Enhanced brain storm optimization algorithm for wireless sensor networks deployment. In: Proc. international conference on swarm intelligence. Springer, Cham, pp 373–381
  20. Chen J, Wang J, Cheng S, Shi Y (2016) Brain storm optimization with agglomerative hierarchical clustering analysis. In: Proc. 7th international conference on swarm intelligence, ICSI, pp. 115-122
  21. Zhou D, Shi Y, Cheng S (2012) Brain storm optimization algorithm with modified step-size and individual generation. In: Proc. International conference on swarm intelligence, pp. 243–252
  22. Chu X, Chen J, Cai F, Li L, Qin Q (2018) Adaptive brainstorm optimisation with multiple strategies. Memetic Computing 10:383–396
    Article Google Scholar
  23. Cao Z, W L (2019) An active learning brain storm optimization algorithm with a dynamically changing cluster cycle for global optimization. Cluster Computing
  24. Cheng S, Shi Y, Qin Q, Zhang Q, Bai R (2014) Population diversity maintenance in brain storm optimization algorithm. J Artificial Intell Soft Comput Res 4(2):83–97
    Article Google Scholar
  25. Duan H, Li S, Shi Y (2013) Predator-prey brain storm optimization for DC brushless motor. IEEE Trans Magn 49(10):5336–5340
    Article Google Scholar
  26. Duan H, Li C (2015) Quantum-behaved brain storm optimization approach to solving loney’s solenoid problem. IEEE Trans Magn 51(1):1–7
    Article Google Scholar
  27. El-Abd M (2016) Brain storm optimization algorithm with re-initialized ideas and adaptive step size. In: Evolutionary computation (CEC), 2016 IEEE congress on IEEE, pp. 2682–2686
  28. Cheng S, Shi Y, Qin Q, Ting TO, Bai R (2014) Maintaining population diversity in brain storm optimization algorithm. In: Proc. of IEEE congress on evolutionary computation, pp. 3230–3237
  29. Cheng S., Qin Q., Chen J., Shi Y. (2016) Brain storm optimization algorithm: a review. Artif Intell Rev 46(4):445C458
    Article Google Scholar
  30. Wu G, Malipeddi R, Suganthan PN, Wang R, Chen H (2016) Differential evolution with multi-population based ensemble of mutation strategies. Inf Sci 329:329–345
    Article Google Scholar
  31. Chen Q, Liu B, Zhang Q, Liang J, Suganthan P, Qu B (2014) Problem definitions and evaluation criteria for CEC 2015 special session on bound constrained single-objective computationally expensive numerical optimization. Technical Report, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China and Technical Report, Nanyang Technological University
  32. El-Abd M (2017) Global-best brain storm optimization algorithm. Swarm Evol Comput 37:27–44
    Article Google Scholar
  33. Yu Y, Gao S, Cheng S, Wang Y, Song S, Yuan F (2018) CBSO: a memetic brain storm optimization with chaotic local search. Memetic Comput 10(4):353–367
    Article Google Scholar
  34. Peng H, Deng C, Wu Z (2019) SPBSO: self-adaptive brain storm optimization algorithm with pbest guided step-size. J Intell & Fuzzy Sys 36:5423–5434
    Article Google Scholar
  35. Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
    Article MathSciNet Google Scholar
  36. Cao Z, Wang L, Hei X, Shi Y, Rong X (2015) An improved brain storm optimization with differential evolution strategy for applications of ANNs. Math Probl Eng, pp. 1–18
  37. Mohamed AW, Suganthan PN (2018) Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation. Soft Comput 22(10):3215–3235
    Article Google Scholar
  38. Zhang J, Sanderson AC (2009) JADE: Adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
    Article Google Scholar
  39. Das S, Abraham A, Chakraborty UK, Konar A (2009) Differential evolution using a neighbourhood based mutation operator. IEEE Trans Evol Comput 13(3):526–553
    Article Google Scholar
  40. Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm and Evol Comput 24:11–24
    Article Google Scholar

Download references

Acknowledgments

This research is partly supported by the Natural Science Foundation of China (Grant No. 11371197 and 61971234), Humanity and Social Science Youth foundation of Ministry of Education of China (Grant No. 12YJCZH179), the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (Grant No. 16KJA110001). Thanks all authors for providing the source codes of all comparison algorithms.

Author information

Authors and Affiliations

  1. School of Mathematical Sciences, Nanjing Normal University, Nanjing, 210023, People’s Republic of China
    Yuehong Sun, Kelian Xiao, Jianyang Bao & Ye Jin
  2. Jiangsu Key Laboratory for Numerical Simulation of Large Scale Complex Systems, Nanjing, 210023, People’s Republic of China
    Yuehong Sun
  3. School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, 210003, People’s Republic of China
    Jianxiang Wei
  4. School of Science, Nanjing University of Posts and Telecommunications, Nanjing, 210023, People’s Republic of China
    Tingting Wu

Authors

  1. Yuehong Sun
  2. Jianxiang Wei
  3. Tingting Wu
  4. Kelian Xiao
  5. Jianyang Bao
  6. Ye Jin

Corresponding author

Correspondence toYuehong Sun.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Sun, Y., Wei, J., Wu, T. et al. Brain storm optimization using a slight relaxation selection and multi-population based creating ideas ensemble.Appl Intell 50, 3137–3161 (2020). https://doi.org/10.1007/s10489-020-01690-8

Download citation

Keywords