Introductory Review of Swarm Intelligence Techniques (original) (raw)

Abstract

With the rapid upliftment of technology, there has emerged a dire need to 'fine-tune' or 'optimize' certain processes, software, models or structures, with utmost accuracy and efficiency. Optimization algorithms are preferred over other methods of optimization through experimentation or simulation, for their generic problem-solving abilities and promising efficacy with the least human intervention. In recent times, the inducement of natural phenomena into algorithm design has immensely triggered the efficiency of optimization process for even complex multi-dimensional, non-continuous, non-differentiable and noisy problem search spaces. This chapter deals with the Swarm intelligence (SI) based algorithms or Swarm Optimization Algorithms, which are a subset of the greater Nature Inspired Optimization Algorithms (NIOAs). Swarm intelligence involves the collective study of individuals and their mutual interactions leading to intelligent behavior of the swarm. The chapter presents various population-based SI algorithms, their fundamental structures along with their mathematical models.

Key takeaways

sparkles

AI

  1. Swarm Intelligence (SI) techniques optimize complex, multi-dimensional problems more efficiently than traditional algorithms.
  2. Balancing exploration and exploitation is crucial for the success of SI algorithms in finding optimal solutions.
  3. Over 140 nature-inspired optimization algorithms exist, each tailored for specific problem types and requirements.
  4. SI techniques have diverse applications across fields such as machine learning, healthcare, and logistics.
  5. Prior analysis of SI techniques is essential for effective application and performance comparison.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (84)

  1. Christian Blum and Andrea Roli. Metaheuristics in combinatorial optimiza- tion: Overview and conceptual comparison. ACM computing surveys (CSUR), 35(3):268-308, 2003.
  2. James Kennedy and Russell Eberhart. Particle swarm optimization. In Proceedings of ICNN'95-international conference on neural networks, volume 4, pages 1942- 1948. IEEE, 1995.
  3. Xin-She Yang. Firefly algorithm, levy flights and global optimization. In Research and development in intelligent systems XXVI, pages 209-218. Springer, 2010.
  4. S Binitha, S Siva Sathya, et al. A survey of bio inspired optimization algorithms. International journal of soft computing and engineering, 2(2):137-151, 2012.
  5. Anupam Biswas, KK Mishra, Shailesh Tiwari, and AK Misra. Physics-inspired optimization algorithms: a survey. Journal of Optimization, 2013, 2013.
  6. Essam H Houssein, Mina Younan, and Aboul Ella Hassanien. Nature-inspired algorithms: A comprehensive review. Hybrid Computational Intelligence, pages 1-25, 2019.
  7. Wang Zhiheng and Liu Jianhua. Flamingo search algorithm: A new swarm intel- ligence optimization algorithm. IEEE Access, 9(1):88564-88582, 2021.
  8. Farid MiarNaeimi, Gholamreza Azizyan, and Mohsen Rashki. Horse herd opti- mization algorithm: A nature-inspired algorithm for high-dimensional optimization problems. Knowledge-Based Systems, 213:106711, 2021.
  9. M Khishe and Mohammad Reza Mosavi. Chimp optimization algorithm. Expert systems with applications, 149:113338, 2020.
  10. Vahideh Hayyolalam and Ali Asghar Pourhaji Kazem. Black widow optimization algorithm: a novel meta-heuristic approach for solving engineering optimization problems. Engineering Applications of Artificial Intelligence, 87:103249, 2020.
  11. Jiankai Xue and Bo Shen. A novel swarm intelligence optimization approach: sparrow search algorithm. Systems Science & Control Engineering, 8(1):22-34, 2020.
  12. Gaurav Dhiman, Meenakshi Garg, Atulya Nagar, Vijay Kumar, and Mohammad Dehghani. A novel algorithm for global optimization: Rat swarm optimizer. Journal of Ambient Intelligence and Humanized Computing, pages 1-26, 2020.
  13. S Shadravan, HR Naji, and Vahid Khatibi Bardsiri. The sailfish optimizer: A novel nature-inspired metaheuristic algorithm for solving constrained engineering optimization problems. Engineering Applications of Artificial Intelligence, 80:20- 34, 2019.
  14. Ahmed T Sadiq Al-Obaidi, Hasanen S Abdullah, and Zied O Ahmed. Meerkat clan algorithm: A new swarm intelligence algorithm. Indonesian Journal of Electrical Engineering and Computer Science, 10(1):354-360, 2018.
  15. Seyedeh Zahra Mirjalili, Seyedali Mirjalili, Shahrzad Saremi, Hossam Faris, and Ibrahim Aljarah. Grasshopper optimization algorithm for multi-objective opti- mization problems. Applied Intelligence, 48(4):805-820, 2018.
  16. Seyedali Mirjalili, Amir H Gandomi, Seyedeh Zahra Mirjalili, Shahrzad Saremi, Hossam Faris, and Seyed Mohammad Mirjalili. Salp swarm algorithm: A bio- inspired optimizer for engineering design problems. Advances in Engineering Soft- ware, 114:163-191, 2017.
  17. Ahmed T Sadiq Al-Obaidi, Hasanen S Abdullah, et al. Camel herds algorithm: A new swarm intelligent algorithm to solve optimization problems. International Journal on Perceptive and Cognitive Computing, 3(1), 2017.
  18. Weihong Wang, Sentang Wu, Ke Lu, et al. Duck pack algorithm-a new swarm intelligence algorithm for route planning based on imprinting behavior. In 2017 29th Chinese Control And Decision Conference (CCDC), pages 2392-2396. IEEE, 2017.
  19. Seyedali Mirjalili. Dragonfly algorithm: a new meta-heuristic optimization tech- nique for solving single-objective, discrete, and multi-objective problems. Neural Computing and Applications, 27(4):1053-1073, 2016.
  20. A Ebrahimi and E Khamehchi. Sperm whale algorithm: an effective metaheuristic algorithm for production optimization problems. Journal of Natural Gas Science and Engineering, 29:211-222, 2016.
  21. Tian-qi Wu, Min Yao, and Jian-hua Yang. Dolphin swarm algorithm. Frontiers of Information Technology & Electronic Engineering, 17(8):717-729, 2016.
  22. Alireza Askarzadeh. A novel metaheuristic method for solving constrained engi- neering optimization problems: crow search algorithm. Computers & Structures, 169:1-12, 2016.
  23. Seyedali Mirjalili. The ant lion optimizer. Advances in engineering software, 83:80- 98, 2015.
  24. Gai-Ge Wang, Suash Deb, and Leandro dos S Coelho. Elephant herding opti- mization. In 2015 3rd International Symposium on Computational and Business Intelligence (ISCBI), pages 1-5. IEEE, 2015.
  25. Seyedali Mirjalili. Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowledge-based systems, 89:228-249, 2015.
  26. Seyedali Mirjalili, Seyed Mohammad Mirjalili, and Andrew Lewis. Grey wolf op- timizer. Advances in engineering software, 69:46-61, 2014.
  27. Shruti Goel. Pigeon optimization algorithm: A novel approach for solving optimiza- tion problems. In 2014 International Conference on Data Mining and Intelligent Computing (ICDMIC), pages 1-5. IEEE, 2014.
  28. Jagdish Chand Bansal, Harish Sharma, Shimpi Singh Jadon, and Maurice Clerc. Spider monkey optimization algorithm for numerical optimization. Memetic com- puting, 6(1):31-47, 2014.
  29. Erik Cuevas, Miguel Cienfuegos, Daniel Zaldívar, and Marco Pérez-Cisneros. A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Systems with Applications, 40(16):6374-6384, 2013.
  30. Ben Niu and Hong Wang. Bacterial colony optimization. Discrete Dynamics in Nature and Society, 2012, 2012.
  31. Hoang Thanh Nguyen and Bir Bhanu. Zombie survival optimization: A swarm intelligence algorithm inspired by zombie foraging. In Proceedings of the 21st In- ternational Conference on Pattern Recognition (ICPR2012), pages 987-990. IEEE, 2012.
  32. Xin-She Yang. A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010), pages 65-74. Springer, 2010.
  33. Ying Tan and Yuanchun Zhu. Fireworks algorithm for optimization. In Interna- tional conference in swarm intelligence, pages 355-364. Springer, 2010.
  34. Xin-She Yang and Suash Deb. Cuckoo search via lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC), pages 210-214. Ieee, 2009.
  35. Esmat Rashedi, Hossein Nezamabadi-Pour, and Saeid Saryazdi. Gsa: a gravita- tional search algorithm. Information sciences, 179(13):2232-2248, 2009.
  36. KN Krishnanand and Debasish Ghose. Glowworm swarm optimisation: a new method for optimising multi-modal functions. International Journal of Computa- tional Intelligence Studies, 1(1):93-119, 2009.
  37. Ying Chu, Hua Mi, Huilian Liao, Zhen Ji, and QH Wu. A fast bacterial swarm- ing algorithm for high-dimensional function optimization. In 2008 IEEE congress on evolutionary computation (ieee world congress on computational intelligence), pages 3135-3140. IEEE, 2008.
  38. Shu-Chuan Chu, Pei-Wei Tsai, and Jeng-Shyang Pan. Cat swarm optimization. In Pacific Rim international conference on artificial intelligence, pages 854-858. Springer, 2006.
  39. Emrah Hancer, Celal Ozturk, and Dervis Karaboga. Artificial bee colony based image clustering method. In 2012 IEEE congress on evolutionary computation, pages 1-5. IEEE, 2012.
  40. Horst F Wedde, Muddassar Farooq, and Yue Zhang. Beehive: An efficient fault- tolerant routing algorithm inspired by honey bee behavior. In International Work- shop on Ant Colony Optimization and Swarm Intelligence, pages 83-94. Springer, 2004.
  41. Marco Dorigo, Mauro Birattari, and Thomas Stutzle. Ant colony optimization. IEEE computational intelligence magazine, 1(4):28-39, 2006.
  42. Sadiq M Sait, Ahmad T Sheikh, and Aiman H El-Maleh. Cell assignment in hybrid cmos/nanodevices architecture using a pso/sa hybrid algorithm. Journal of applied research and technology, 11(5):653-664, 2013.
  43. RJ Kuo and CW Hong. Integration of genetic algorithm and particle swarm opti- mization for investment portfolio optimization. Applied mathematics & informa- tion sciences, 7(6):2397, 2013.
  44. Shyi-Ming Chen and Chih-Yao Chien. Solving the traveling salesman problem based on the genetic simulated annealing ant colony system with particle swarm optimization techniques. Expert Systems with Applications, 38(12):14439-14450, 2011.
  45. You-Min Jau, Kuo-Lan Su, Chia-Ju Wu, and Jin-Tsong Jeng. Modified quantum- behaved particle swarm optimization for parameters estimation of generalized non- linear multi-regressions model based on choquet integral with outliers. Applied Mathematics and Computation, 221:282-295, 2013.
  46. Min Chen and Simone A Ludwig. Discrete particle swarm optimization with local search strategy for rule classification. In 2012 Fourth World Congress on Nature and Biologically Inspired Computing (NaBIC), pages 162-167. IEEE, 2012.
  47. Anupam Biswas, Bhaskar Biswas, Anoj Kumar, and KK Mishra. Particle swarm optimisation with time varying cognitive avoidance component. International Jour- nal of Computational Science and Engineering, 16(1):27-41, 2018.
  48. Anupam Biswas, Anoj Kumar, and KK Mishra. Particle swarm optimization with cognitive avoidance component. In 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pages 149-154. IEEE, 2013.
  49. Chenye Qiu, Chunlu Wang, and Xingquan Zuo. A novel multi-objective particle swarm optimization with k-means based global best selection strategy. Interna- tional Journal of Computational Intelligence Systems, 6(5):822-835, 2013.
  50. Anupam Biswas, AV Lakra, Sharad Kumar, and Avjeet Singh. An improved ran- dom inertia weighted particle swarm optimization. In 2013 International Sympo- sium on Computational and Business Intelligence, pages 96-99. IEEE, 2013.
  51. Li-Yeh Chuang, Sheng-Wei Tsai, and Cheng-Hong Yang. Chaotic catfish particle swarm optimization for solving global numerical optimization problems. Applied mathematics and computation, 217(16):6900-6916, 2011.
  52. Iztok Fister, Iztok Fister Jr, Xin-She Yang, and Janez Brest. A comprehensive review of firefly algorithms. Swarm and Evolutionary Computation, 13:34-46, 2013.
  53. Omkar Singh, Vinay Rishiwal, Rashmi Chaudhry, and Mano Yadav. Multi- objective optimization in wsn: Opportunities and challenges. Wireless Personal Communications, 121(1):127-152, 2021.
  54. Stephen J Wright, Dimitri Kanevsky, Li Deng, Xiaodong He, Georg Heigold, and Haizhou Li. Optimization algorithms and applications for speech and lan- guage processing. IEEE Transactions on Audio, Speech, and Language Processing, 21(11):2231-2243, 2013.
  55. SR Jino Ramson, K Lova Raju, S Vishnu, and Theodoros Anagnostopoulos. Nature inspired optimization techniques for image processing-a short review. Nature Inspired Optimization Techniques for Image Processing Applications, pages 113- 145, 2019.
  56. Julia Handl, Douglas B Kell, and Joshua Knowles. Multiobjective optimization in bioinformatics and computational biology. IEEE/ACM Transactions on computa- tional biology and bioinformatics, 4(2):279-292, 2007.
  57. Ashraf Darwish, Aboul Ella Hassanien, and Swagatam Das. A survey of swarm and evolutionary computing approaches for deep learning. Artificial Intelligence Review, 53(3):1767-1812, 2020.
  58. Anupam Biswas. Community detection in social networks using agglomerative and evalutionary techniques. PhD thesis, 2016.
  59. A Biswas, P Gupta, M Modi, and B Biswas. Community detection in multiple featured social network using swarm intelligence. In International Conference on Communication and Computing (ICC 2014), Bangalore, 2014.
  60. Anupam Biswas, Pawan Gupta, Mradul Modi, and Bhaskar Biswas. An empirical study of some particle swarm optimizer variants for community detection. In Advances in Intelligent Informatics, pages 511-520. Springer, 2015.
  61. Abhishek Garg, Anupam Biswas, and Bhaskar Biswas. Evolutionary computa- tion techniques for community detection in social network analysis. In Advanced Methods for Complex Network Analysis, pages 266-284. IGI Global, 2016.
  62. Rafael S Parpinelli, Fábio R Teodoro, and Heitor S Lopes. A comparison of swarm intelligence algorithms for structural engineering optimization. International Jour- nal for Numerical Methods in Engineering, 91(6):666-684, 2012.
  63. Anupam Biswas and Bhaskar Biswas. Swarm intelligence techniques and their adaptive nature with applications. In Complex System Modelling and Control Through Intelligent Soft Computations, pages 253-273. Springer, 2015.
  64. Anupam Biswas and Bhaskar Biswas. Regression line shifting mechanism for an- alyzing evolutionary optimization algorithms. Soft Computing, 21(21):6237-6252, 2017.
  65. Anupam Biswas and Bhaskar Biswas. Visual analysis of evolutionary optimization algorithms. In 2014 2nd International Symposium on Computational and Business Intelligence, pages 81-84. IEEE, 2014.
  66. Anupam Biswas and Bhaskar Biswas. Analyzing evolutionary optimization and community detection algorithms using regression line dominance. Information Sciences, 396:185-201, 2017.
  67. J. Revathi, V.P Eswaramurthy, and P. Padmavathi. Bacterial colony optimiza- tion for data clustering. In 2019 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pages 1-4, 2019.
  68. Ben Niu and Hong" Wang. Bacterial colony optimization: Principles and foun- dations. In Emerging Intelligent Computing Technology and Applications, pages 501-506, 2012.
  69. Alireza Askarzadeh. A novel metaheuristic method for solving constrained engi- neering optimization problems: Crow search algorithm. Computers & Structures, 169:1-12, 2016.
  70. Abdelazim G. Hussien, Mohamed Amin, Mingjing Wang, Guoxi Liang, Ahmed Alsanad, Abdu Gumaei, and Huiling Chen. Crow search algorithm: Theory, recent advances, and applications. IEEE Access, 8:173548-173565, 2020.
  71. Babak Zolghadr-Asli, Omid Bozorg-Haddad, and Xuefeng Chu. Crow Search Al- gorithm (CSA), pages 143-149. Springer Singapore, Singapore, 2018.
  72. Peifeng Niu, Songpeng Niu, Nan liu, and Lingfang Chang. The defect of the grey wolf optimization algorithm and its verification method. Knowledge-Based Systems, 171:37-43, 2019.
  73. Seyedali Mirjalili, Seyed Mohammad Mirjalili, and Andrew Lewis. Grey wolf op- timizer. Advances in Engineering Software, 69:46-61, 2014.
  74. Seyedali Mirjalili, Seyed Mirjalili, and Andrew Lewis. Grey wolf optimizer. Ad- vances in Engineering Software, 69:46-61, 03 2014.
  75. A. Ebrahimi and E. Khamehchi. Sperm whale algorithm: An effective metaheuristic algorithm for production optimization problems. Journal of Natural Gas Science and Engineering, 29:211-222, 2016.
  76. Jian Yang, Liang Qu, Yang Shen, Yuhui Shi, Shi Cheng, Junfeng Zhao, and Xi- aolong Shen. Swarm intelligence in data science: Applications, opportunities and challenges. In Ying Tan, Yuhui Shi, and Milan Tuba, editors, Advances in Swarm Intelligence, pages 3-14, Cham, 2020. Springer International Publishing.
  77. Yudong Zhang, Praveen Agarwal, Vishal Bhatnagar, Saeed Balochian, and Jie Yan. Swarm intelligence and its applications, 2013.
  78. R. Ganesan M. Vergin Raja Sarobin. Swarm intelligence in wireless sensor net- works: A survey. International Journal of Pure and Applied Mathematics, 101, 2015.
  79. Khumukcham Usharani Devi, Dipjyoti Sarma, and Romesh Laishram. Swarm intelligence based computing techniques in speech enhancement. In 2015 Interna- tional Conference on Green Computing and Internet of Things (ICGCIoT), pages 1199-1203, 2015.
  80. Xiaodong Zhuang and Nikos Mastorakis. Image processing with the artificial swarm intelligence. WSEAS Transactions on Computers, 4:333-341, 04 2005.
  81. Santosh Kumar, Deepanwita Datta, and Sanjay Singh. Swarm Intelligence for Biometric Feature Optimization, pages 147-181. 01 2015.
  82. Ihtiram Raza Khan Mehtab Alam, Asif Hameed Khan. Swarm intelligence in manets: A survey. International Journal of Emerging Research in Management & Technology, 5:141-150, 05 2016.
  83. Nandini Nayar, Sachin Ahuja, and Dr. Shaily Jain. Swarm intelligence and data mining: a review of literature and applications in healthcare. pages 1-7, 06 2019.
  84. Davide Anghinolfi, Antonio Boccalatte, Alberto Grosso, Massimo Paolucci, An- drea Passadore, and Christian Vecchiola. A swarm intelligence method applied to manufacturing scheduling. pages 65-70, 01 2007.

FAQs

sparkles

AI

What defines the convergence rate in swarm intelligence algorithms?add

The convergence rate in swarm intelligence algorithms is defined as the speed at which an algorithm approximates a solution, influenced by exploration and exploitation balance.

How have swarm intelligence techniques evolved in recent years?add

Over 140 swarm intelligence techniques have emerged since 1992, inspired by nature, such as the Ant Colony Optimization and the Grey Wolf Optimizer introduced in 2014.

What challenges do swarm intelligence techniques address in optimization problems?add

Swarm intelligence techniques tackle challenges like multiple local minima, complex constraints, and disruptions in nonlinear optimization, thus delivering approximate solutions effectively.

What role does exploration play in swarm intelligence techniques?add

Exploration in swarm intelligence helps diversify solutions and prevents stagnation at local minima, balancing the search landscape for better outcomes in optimization.

How do swarm intelligence algorithms balance exploration and exploitation?add

Algorithms fine-tune exploration versus exploitation according to specific problem requirements, ensuring effective searches while avoiding slow convergence from excessive exploration.