Culturing evolution strategies to support the exploration of novel environments by an intelligent robotic agent (original) (raw)

Abstract

Recently, a lot of attention is paid to the use of evolutionary computing techniques for the development of adaptive robots. This paper presents the use of Cultural Algorithms with Evolution Strategies (ES) to produce optimal solutions to the ball following problem. This involves learning how to find and advance toward a ball. This is a basic skill needed to play robot soccer. Since it is possible that both the ball and the robot can be moving simultaneously this can be a difficult problem to solve. Four different solutions are implemented here. The first is the two member ES with comma strategy, (1,1)-ES. The second is the ES with plus strategy, (1+1)-ES. The third is a cultured version of the (1,1)-ES. The fourth is a cultured version of the (1+1)-ES. In cultural versions, the ES model is the population model for a Cultural Algorithm. The belief space contains generalizations about the individual's ancestral line, e.g. grandparents, in order to guide the modifications. Each of the four systems was tested by loading it into the RAM of a Khpera robot. Each system was then used to learn how to control the direction and speed of the two Khepera robot's wheels in order to direct it to a given ball. The real-time learning results are then compared. The results suggest that simple Evolution Strategies implemented here exhibit a satisfactory level of real-time learning in forwarding and pushing the ball. The cultured version exhibits an improvement in time over this performance as well.

Preview

Unable to display preview. Download preview PDF.

Similar content being viewed by others

Reference

  1. Takashi Gomi and Ann Griffith, “Evolutionary Robotics — An Overview,” In Proceedings of IEEE International Conference on Evolutionary Computation. IEEE Press, 1996, pp. 40–49.
    Google Scholar
  2. Henrik Hautop Lund, John Hallam, and Wei-Po Lee. “Evolving Robot Morphology,” In Proceedings of IEEE 4th International Conference on Evolutionary Computation. IEEE Press, 1997, pp. 197–202.
    Google Scholar
  3. Henrik Hautop Lund and John Hallam, “Evolving Sufficient Robot Controllers,” In Proceedings of IEEE 4th International Conference on Evolutionary Computation. IEEE Press, 1997, pp. 495–500.
    Google Scholar
  4. Francesco Mondada, Edoardo Franzi, and Paolo Ienne, “Mobile robot miniaturization: A tool for investigation in control algorithms,” in proceedings of the 3rd International Symposium on Experimental Robotics, Kyoto, Japan, Oct. 28–30, 1993, Springer Verlag, London, pp501–513.
    Google Scholar
  5. Thomas Bäck, Evolutionary Algorithms in Theory and Practice, Oxford University Press, New York, 1996.
    Google Scholar
  6. Thomas Bäck, U. Hammel, and Hans-Paul Schwefel, “Evolutionary Computation: History and Current State,” IEEE transactions on Evolutionary Computation, 1(1), pp. 3–17, 1997
    Google Scholar
  7. ChanJin Chung and Robert G. Reynolds, “Function Optimization Using Evolutionary Programming with Self-Adaptive Cultural Algorithms,” in Simulated Evolution and Learning, Selected Papers, Lecture Notes in Artificial Intelligence — 1285, Xin Yao and Jong-Hwan Kim (Editors), Springer-Verlag 1996, pp. 17–26
    Google Scholar
  8. Chan-Jin Chung, Knowledge-Based Approaches to Self-Adaptation in Cultural Algorithms, Ph.D. thesis, Wayne State University, May 1997
    Google Scholar
  9. David B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, IEEE Press, Piscataway, NJ, 1995
    Google Scholar
  10. David B. Fogel, “Using Fitness Distributions to Design More Efficient Evolutionary Computations,” in Proceedings of 1996 IEEE International Conference on Evolutionary Computation (ICEC'96), pp. 11–19.
    Google Scholar
  11. J.-H Kim, J.Y. Jeon, H.K. Chae, and K.I. Koh, “A novel Evolutionary Algorithm with Fast Convergence,” in Proceedings of 1995 IEEE International Conference on Evolutionary Computation (ICEC'95), 1995, pp. 819–824
    Google Scholar
  12. Robert G. Reynolds, “An Introduction to Cultural Algorithms,” in Proceedings of the 3rd Annual Conference on Evolutionary Programming, Sebald, A.V.; Fogel, L.J. (Editors), River Edge, NJ, World Scientific Publishing, 1994, pp. 131–139.
    Google Scholar
  13. H.-P. Schwefel, Numerical Optimization of Computer Models John Wiley, Chichester, UK, 1981
    Google Scholar
  14. Hans-Paul Schwefel, Evolution and Optimum Seeking, John Wiley & Sons, Inc., 1995
    Google Scholar
  15. Khepera User Manual, Version 4.09, K-Team S. A., Lausanne Switzerland, Nov. 1995
    Google Scholar
  16. Khepera K213 Vision Turret User Manual, Version 1.0, K-Team S.A., Lausanne Switzerland, Nov. 1995
    Google Scholar
  17. Nils J. Nilsson, Principles of Artificial Intelligence, Tioga Publishing Co., Palo Alto, CA, 1980.
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Wayne State University, 48202, Detroit, MI, USA
    Chan-Jin Chung & Robert G. Reynolds

Authors

  1. Chan-Jin Chung
  2. Robert G. Reynolds

Editor information

V. W. Porto N. Saravanan D. Waagen A. E. Eiben

Rights and permissions

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chung, CJ., Reynolds, R.G. (1998). Culturing evolution strategies to support the exploration of novel environments by an intelligent robotic agent. In: Porto, V.W., Saravanan, N., Waagen, D., Eiben, A.E. (eds) Evolutionary Programming VII. EP 1998. Lecture Notes in Computer Science, vol 1447. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0040775

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us