Evolving integrated low-level behaviors into intelligently interactive simulated forces (original) (raw)

Abstract

Combining optimal high-level planning with low-level behaviors has usually been accomplished through two separate mechanisms. Typically, both of these mechanisms have relied upon heuristic approaches to control the behaviors of simulated agents to achieve mission goals. Recent research into evolving optimal high-level tactical behaviors for simulated vehicles proved quite fruitful even when heuristics were utilized to navigate low-level terrain. Evolutionary programming was used to optimally control computer generated forces (CGFs) on two opposing teams in highly dynamic environments. Tactical courses of action were learned adaptively for individual vehicles as well as for higher-level aggregations (i.e., platoons). Evolutionary updates of behavioral plans incorporated dynamic changes in the developing situation and the sensed environment.

Inconsistencies can, however, arise when low-level heuristic navigation systems produce actions that significantly deviate from the evolved high-level tactical plans. Estimation and prediction of behaviors can result in erroneous outcomes due to the lack of integration between the planning mechanisms. This paper presents a method for solving these problems by using evolutionary programming for both high-level tactical planning and low-level navigation through arbitrary terrain. The resulting software, which builds upon previous work, uses no heuristics in the planning process. The evolved behaviors more accurately reflect the realities of planning in the face of nonhomogeneous terrain, and present a much improved simulation tool for training.

Preview

Unable to display preview. Download preview PDF.

References

• Fogel, D.B. (1995) Evolutionary Computation, Toward a New Philosophy of Machine Intelligence, Piscataway, NJ: IEEE Press.
  Google Scholar
• Fogel, L.J., Owens, A.J., and Walsh, MJ. (1966) Artificial Intelligence through Simulated Evolution, New York, NY: John Wiley.
  Google Scholar
• Fogel, L.J. (1995) “The Valuated State Space Approach and Evolutionary Computation for Problem Solving,” Computational Intelligence: A Dynamic System Perspective, M. Palaniswami, Y. Attikiouzel, R.J. Marks, D. Fogel, and T. Fukuda, (eds.), IEEE Press, NY, pp. 129–136.
  Google Scholar
• Goldman, S.R. (1996) “Knowledge Acquisition and Delivery: Constructing Intelligent Software Command Entities,” Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation, D.E. Mullally (ed.), Orlando, FL, pp. 31–36.
  Google Scholar
• Hocaoglu, C, and Sanderson, A. (1996) “Planning Multi-Paths using Speciation in Genetic Algorithms,” Proc. 1996 IEEE International Conference on Evolutionary Computation, Nagoya, Japan, May, pp. 378–383.
  Google Scholar
• McDonnell, J.R., and Page, W.C., (1990) “Mobile Robot Path Planning Using Evolutionary Programming,” Proc. of the 24th Asilomar Conference on Signals, Systems, and Computers, Vol. 2, Maple Press, San Jose, CA, pp. 1025–1029.
  Google Scholar
• Porto, V.W., and Fogel, L.J. (1997) “Evolution of Intelligently Interactive Behaviors for Simulated Forces,” Proceedings of the Sixth International Conference on Evolutionary Programming, P.J. Angeline, R.G. Reynolds, J.R. McDonnell, and R. Eberhart (eds.), Springer Verlag, pp. 419–429.
  Google Scholar
• Page, W.C., McDonnell, J.R., and Anderson, B. (1992) “An Evolutionary Programming Approach to Multi-Dimensional Path Planning,” Proc. of the First Annual Conference on Evolutionary Programming, D.B. Fogel and W. Atmar (eds.), Evolutionary Programming Society, San Diego, CA, pp. 63–70.
  Google Scholar
• Rajput, S., and Karr, C. (1996) “A New Mechanism for Cooperative Behavior in ModSAF” Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation, D.E. Mullally (ed.), Orlando, FL, pp. 189–199.
  Google Scholar
• Tambe, M., Johnson, W.L., Jones, R.M., Koss, F., Laird, J.E., Rosenbloom, P.S., and Schwamb, K. (1995) “Intelligent Agents for Interactive Simulation Environments,” AI Magazine, Vol. 16(1), pp. 15–40.
  Google Scholar
• Xiao, J., Michalewicz, Z., Zhang, L. and Trojanowski, K. (1997) “Adaptive Evolutionary Planner/Navigator for Mobile Robots,” IEEE Trans. Evolutionary Computation, Vol. 1, No. 1, April 1997, pp. 18–28.
  Google Scholar

Download references

Author information

Authors and Affiliations

1. Natural Selection, Inc., 3333 N. Torrey Pines Ct., Ste. 200, 92037, La Jolla, CA
   V. William Porto

Editor information

V. W. Porto N. Saravanan D. Waagen A. E. Eiben

Rights and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Porto, V.W. (1998). Evolving integrated low-level behaviors into intelligently interactive simulated forces. In: Porto, V.W., Saravanan, N., Waagen, D., Eiben, A.E. (eds) Evolutionary Programming VII. EP 1998. Lecture Notes in Computer Science, vol 1447. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0040828

Download citation

• .RIS
• .ENW
• .BIB
• DOI: https://doi.org/10.1007/BFb0040828
• Published: 10 December 2005
• Publisher Name: Springer, Berlin, Heidelberg
• Print ISBN: 978-3-540-64891-8
• Online ISBN: 978-3-540-68515-9
• eBook Packages: Springer Book Archive

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us