Abstract
Unsupervised online learning in commercial computer games allows computer-controlled opponents to adapt to the way the game is being played. As such it provides a mechanism to deal with weaknesses in the game AI and to respond to changes in human player tactics. In prior work we designed a novel technique called “dynamic scripting” that is able to create successful adaptive opponents. However, experimental evaluations indicated that, occasionally, the time needed for dynamic scripting to generate effective opponents becomes unacceptably long. We investigated two different countermeasures against these long adaptation times (which we call “outliers”), namely a better balance between rewards and penalties, and a history-fallback mechanism. Experimental results indicate that a combination of these two countermeasures is able to reduce the number of outliers significantly. We therefore conclude that the performance of dynamic scripting is enhanced by these counter-measures.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Tozour, P.: The Evolution of Game AI. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 3–15. Charles River Media, Hingham (2002)
Schaeffer, J.: A Gamut of Games. AI Magazine 22(3), 29–46 (2001)
Scott, B.: The Illusion of Intelligence. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 16–20. Charles River Media, Hingham (2002)
Tozour, P.: The Perils of AI Scripting. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 541–547. Charles River Media, Hingham (2002)
Brockington, M., Darrah, M.: How Not to Implement a Basic Scripting Language. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 548–554. Charles River Media, Hingham (2002)
Evans, R.: Varieties of Learning. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 567–578. Charles River Media, Hingham (2002)
Woodcock, S.: Game AI: The State of the Industry. Game Developer Magazine (August 2002)
Demasi, P., Cruz, A.J., de, O.: Online Coevolution for Action Games. Gough, N., Mehdi, Q. (eds.) International Journal of Intelligent Games and Simulation 2(2), 80–88 (2003)
Demasi, P., Cruz, A.J., de, O.: Anticipating Opponent Behaviour Using Sequential Prediction and Real-Time Fuzzy Rule Learning. In: Mehdi, Q., Gough, N., Natkin, S. (eds.) Proceedings of the 4th International Conference on Intelligent Games and Simulation, pp. 101–105 (2003)
Spronck, P., Sprinkhuizen-Kuyper, I., Postma, E.: Online Adaptation of Game Opponent AI in Simulation and in Practice. In: Mehdi, Q., Gough, N., Natkin, S. (eds.) Proceedings of 4th International Conference on Intelligent Games and Simulation, pp. 93–100 (2003)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice Hall, Englewood Cliffs (2002)
Manslow, J.: Learning and Adaptation. In: Rabin, S. (ed.) AI Game Programming Wisdom, pp. 557–566. Charles River Media, Hingham (2002)
Bäck, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press, New York (1996)
Spronck, P., Sprinkhuizen-Kuyper, I., Postma, E.: Improving Opponent Intelligence Through Offline Evolutionary Learning. International Journal of Intelligent Games and Simulation 2(1), 20–27 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 IFIP International Federation for Information Processing
About this paper
Cite this paper
Spronck, P., Sprinkhuizen-Kuyper, I., Postma, E. (2004). Enhancing the Performance of Dynamic Scripting in Computer Games. In: Rauterberg, M. (eds) Entertainment Computing – ICEC 2004. ICEC 2004. Lecture Notes in Computer Science, vol 3166. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28643-1_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-28643-1_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22947-6
Online ISBN: 978-3-540-28643-1
eBook Packages: Springer Book Archive