Abstract
In 2011, the authors were part of a team of researchers working on an intelligence analyst project, Heuristica, exploring the use of serious games to teach intelligence analysts to recognize cognitive biases in their own decision-making and in the decisions of those they observed, and to learn to use strategies that would mitigate those biases. In this paper we provide an analysis of the architecture and extend the design to include components built around a large language model (LLM, e.g. ChatGPT). We call the new design Heuristica II. Our analysis consists of envisioning updated components and preliminary explorations of prompt structures that can be inserted into the components of the adaptive instructional system to advance their capabilities. The updated design will take into account lessons learned from the 2011 project and beyond. These explorations reveal the capabilities of using LLMs for adaptive training but also highlight some areas requiring improvement and caution.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Whitaker, E., et al.: The effectiveness of intelligent tutoring on training in a video game. In: 2013 IEEE International Games Innovation Conference (IGIC), pp. 267–274. IEEE (2013)
Brown, T., et al.: Language models are few-shot learners. In: Advances in Neural Information Processing Systems, vol. 33, pp. 1877–1901 (2020)
Trewhitt, E., Whitaker, E.T., Holland, T., Glenister, L.: Adaptive learner assessment to train social media analysts. In: Sottilare, R.A., Schwarz, J. (eds.) HCII 2022, vol. 13332, pp. 36–52. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-05887-5_4
Vygotsky, L.S., Cole, M.: Mind in Society: Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978)
OpenAI. ChatGPT 4.0 [Large language model] (2024). https://chat.openai.com/chat
Acknowledgments
The original version of Heuristica was developed with funding from the IARPA Sirius program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Whitaker, E., Trewhitt, E., Veinott, E. (2024). Heuristica II: Updating a 2011 Game-Based Training Architecture Using Generative AI Tools. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. HCII 2024. Lecture Notes in Computer Science, vol 14727. Springer, Cham. https://doi.org/10.1007/978-3-031-60609-0_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-60609-0_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60608-3
Online ISBN: 978-3-031-60609-0
eBook Packages: Computer ScienceComputer Science (R0)