Particle Swarm Optimization - A Survey (original) (raw)

A Brief Review on Particle Swarm Optimization: Limitations & Future Directions

Particle swarm optimization is a heuristic global optimization method put forward originally by Doctor Kennedy and Eberhart in 1995. Various efforts have been made for solving unimodal and multimodal problems as well as two dimensional to multidimensional problems. Efforts were put towards topology of communication, parameter adjustment, initial distribution of particles and efficient problem solving capabilities. Here we presented detail study of PSO and limitation in present work. Based on the limitation we proposed future direction. I. INTRODUCTION Swarm Intelligence (SI) is an innovative distributed intelligent paradigm for solving optimization problems that originally took its inspiration from the biological examples by swarming, flocking and herding phenomena in vertebrates. Particle Swarm Optimization (PSO) incorporates swarming behaviors observed in flocks of birds, schools of fish, or swarms of bees, and even human social behavior, from which the idea is emerged. PSO is a population-based optimization tool, which could be implemented and applied easily to solve various function optimization problems, or the problems that can be transformed to function optimization problems. As an algorithm, the main strength of PSO is its fast convergence, which compares favorably with many global optimization algorithms like Genetic Algorithms (GA), Simulated Annealing (SA) and other global optimization algorithms. While population-based heuristics are more costly because of their dependency directly upon function values rather than derivative information, they are however susceptible to premature convergence, which is especially the case when there are many decision variables or dimensions to be optimized. Particle swarm optimization is a heuristic global optimization method put forward originally by Doctor Kennedy and Eberhart in 1995. While searching for food, the birds are either scattered or go together before they locate the place where they can find the food. While the birds are searching for food from one place to another, there is always a bird that can smell the food very well, that is, the bird is perceptible of the place where the food can be found, having the better food resource information. Because they are transmitting the information, especially the good information at any time while searching the food from one place to another, conduced by the good information, the birds will eventually flock to the place where food can be found. As far as particle swam optimization algorithm is concerned, solution swam is compared to the bird swarm, the birds' moving from one place to another is equal to the development of the solution swarm, good information is equal to the most optimist solution, and the food resource is equal to the most optimist solution during the whole course. The most optimist solution can be worked out in particle swarm optimization algorithm by the cooperation of each individual. The particle without quality and volume serves as each individual, and the simple behavioral pattern is regulated for each particle to show the complexity of the whole particle swarm. In PSO, the potential solution called particles fly through the problem space by following the current optimum particles. Each particles keeps tracks of its coordinates in the problem space which are associated with the best solution (fitness) achieved so far. This value is called as pbest. Another best value that is tracked by the particle swarm optimizer is the best value, obtained so far by any particle in the neighbors of the particle. This value is called lbest. When a particle takes all the population as its topological neighbors, the best value is a global best and is called gbest. The particle swarm optimization concept consists of, at each time step, changing the velocity of (accelerating) each particle toward its pbest and lbest (for lbest version). Acceleration is weighted by random term, with separate random numbers being generated for acceleration towards pbest and lbest locations. After finding the best values, the particle updates its velocity and positions with following equations.

Particle Swarm Optimization: Technique, System and Challenges

2011

Particle Swarm Optimization (PSO) is a biologically inspired computational search and optimization method developed in 1995 by Eberhart and Kennedy based on the social behaviors of birds flocking or fish schooling. A number of basic variations have been developed due to improve speed of convergence and quality of solution found by the PSO. On the other hand, basic PSO is more appropriate to process static, simple optimization problem. Modification PSO is developed for solving the basic PSO problem. The observation and review 46 related studies in the period between 2002 and 2010 focusing on function of PSO, advantages and disadvantages of PSO, the basic variant of PSO, Modification of PSO and applications that have implemented using PSO. The application can show which one the modified or variant PSO that haven't been made and which one the modified or variant PSO that will be developed.

The gregarious particle swarm optimizer (G-PSO)

Proceedings of the 8th annual conference on Genetic and evolutionary computation - GECCO '06, 2006

This paper presents a gregarious particle swarm optimization algorithm (G-PSO) in which the particles explore the search space by aggressively scouting the local minima with the help of only social knowledge. To avoid premature convergence of the swarm, the particles are re-initialized with a random velocity when stuck at a local minimum. Furthermore, G-PSO adopts a "reactive" determination of the step size, based on feedback from the last iterations. This is in contrast to the basic particle swarm algorithm, in which the particles explore the search space by using both the individual "cognitive" component and the "social" knowledge and no feedback is used for the self-tuning of algorithm parameters. The novel scheme presented, besides generally improving the average optimal values found, reduces the computation effort.

Autonomous Particles Groups for Particle Swarm Optimization

Arabian Journal for Science and Engineering, 2014

In this paper a modified Particle Swarm Optimization (PSO) algorithm called Autonomous Groups Particles Swarm Optimization (AGPSO) is proposed to further alleviate the two problems of trapping in local minima and slow convergence rate in solving high dimensional problems. The main idea of AGPSO algorithm is inspired by individuals' diversity in bird flocking or insect swarming. In natural colonies, individuals are not basically quite similar in terms of intelligence and ability, but they all do their duties as members of a colony. Each individual's ability can be useful in a particular situation. In this paper a mathematical model of diverse particles groups called autonomous groups is proposed. In other words different functions with diverse slopes, curvatures, and interception points are employed to tune the social and cognitive parameters of the PSO algorithm to give particles different behaviors as in natural colonies. The results show that PSO with autonomous groups of particles outperforms the conventional and some recent modifications of PSO in terms of escaping local minima and convergence speed. The results also indicate that dividing particles in groups and allowing them to have different individual and social thinking can improve the performance of PSO significantly.

A New Particle Swarm Optimization Technique

In this paper, a new particle swarm optimization method (NPSO) is proposed. It is compared with the regular particle swarm optimizer (PSO) invented by Kennedy and Eberhart in 1995 based on four different benchmark functions. PSO is motivated by the social behavior of organisms, such as bird flocking and fish schooling. Each particle studies its own previous best solution to the optimization problem, and its group's previous best, and then adjusts its position (solution) accordingly. The optimal value will be found by repeating this process. In the NPSO proposed here, each particle adjusts its position according to its own previous worst solution and its group's previous worst to find the optimal value. The strategy here is to avoid a particle's previous worst solution and its group's previous worst based on similar formulae of the regular PSO. Under all test cases, simulation shows that the NPSO always finds better solutions than PSO.

Particle Swarm Optimisation: A Historical Review Up to the Current Developments

Entropy, 2020

The Particle Swarm Optimisation (PSO) algorithm was inspired by the social and biological behaviour of bird flocks searching for food sources. In this nature-based algorithm, individuals are referred to as particles and fly through the search space seeking for the global best position that minimises (or maximises) a given problem. Today, PSO is one of the most well-known and widely used swarm intelligence algorithms and metaheuristic techniques, because of its simplicity and ability to be used in a wide range of applications. However, in-depth studies of the algorithm have led to the detection and identification of a number of problems with it, especially convergence problems and performance issues. Consequently, a myriad of variants, enhancements and extensions to the original version of the algorithm, developed and introduced in the mid-1990s, have been proposed, especially in the last two decades. In this article, a systematic literature review about those variants and improvemen...

Swarm intelligence: foundations, perspectives and applications

2006

Swarm Intelligence (SI) is an innovative distributed intelligent paradigm for solving optimization problems that originally took its inspiration from the biological examples by swarming, flocking and herding phenomena in vertebrates. Particle Swarm Optimization (PSO) incorporates swarming behaviors observed in flocks of birds, schools of fish, or swarms of bees, and even human social behavior, from which the idea is emerged [14, 7, 22].

A Study on Various Particle Swarm Optimization Techniques used in Current Scenario

Design, Modelling and Fabrication of Advanced Robots, 2022

optimization, that optimizes a problem by iteratively trying to improve a candidate solution with regard to a given measure of quality. The book by Kennedy and Bernhard describes many philosophical aspects of PSO and swarm intelligence. The Disadvantages of the particle mass optimization (PSO) algorithm are that it is easy to fall locally optimized at high dimensional space and has a low integration rate in the recirculation process. The computational complexity of DWCNPSO is accepted when used to solve high dimensional and complex problems. Particle mass optimization (PSO) is one of the bio-inspired algorithms, and finding the optimal solution in place of the solution is a simple one. It differs from other upgrade algorithms in that it requires only objective functionality and is not subject to gradient or objective particle mass optimization It does not depend on any different form, as proposed in the paper, as mentioned in the original, sociologists believe that At the school of fish or in a group A flock of migratory birds can "benefit from the experience of all other members." In other words, when a bird flies and randomly searches for food, for example, all the birds in the herd can share their findings and help the whole flock to hunt better.

An Intelligent Particle Swarm Optimization Model based on Multi-Agent System

Particle swarm optimization techniques are typically made up of a population of simple agents interacting locally with one another and with their environment, with the goal of locating the optima within the operational environment. In this paper, a robust and intelligent particle swarm optimization framework based on multi-agent system is presented, where learning capabilities are incorporated into the particle agents to dynamically adjust their optimality behaviours. Autonomy is achieved by the use of communicators that separate an agent's individual operation from that of the swarm, thereby making the system more robust.