Using Learning Analytics to Measure Motivational and Affective Processes During Self-Regulated Learning with Advanced Learning Technologies

• Ainley, M., & Ainley, J. (2019). Motivation and learning: Measures and methods. In K. A. Renninger & S. E. Hidi (Eds.), The Cambridge handbook of motivation and learning (pp. 665–688). Cambridge University Press.

  Chapter  Google Scholar 

• Amon, M. J., & Holden, J. G. (2019). The mismatch of intrinsic fluctuations and the static assumptions of linear statistics. Review of Philosophy and Psychology, 12, 1–25. https://doi.org/10.1007/s13164-018-0428-x

  Article  Google Scholar 

• Amon, M. J., Pavlov, O. C., & Holden, J. G. (2018). Synchronization and fractal scaling as foundations for cognitive control. Cognitive Systems Research, 50, 155–179.

  Article  Google Scholar 

• Anderson, J. R., & Fincham, J. M. (2014). Extending problem-solving procedures through reflection. Cognitive Psychology, 74, 1–34.

  Article  Google Scholar 

• Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210.

  Article  Google Scholar 

• Azevedo, R., Taub, M., & Mudrick, N. V. (2018). Using multi-channel trace data to infer and foster self-regulated learning between humans and advanced learning technologies. In D. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 254–270). Routledge.

  Google Scholar 

• Azevedo, R., Mudrick, N. V., Taub, M., & Bradbury, A. (2019). Self-regulation in computer-assisted learning systems. In J. Dunlosky & K. Rawson (Eds.), Handbook of cognition and education (pp. 587–618). Cambridge University Press.

  Chapter  Google Scholar 

• Bakhtiar, A., Webster, E. A., & Hadwin, A. F. (2018). Regulation and socio-emotional interactions in a positive and a negative group climate. Metacognition and Learning, 13(1), 57–90. https://doi.org/10.1007/s11409-017-9178-x

  Article  Google Scholar 

• Bull, S. (2020). There are open learner models about! IEEE Transactions on Learning Technologies, 13(2), 425–448.

  Article  Google Scholar 

• Bull, S., & Kay, J. (2016). SMILI☺: A framework for interfaces to learning data in open learner models, learning analytics and related fields. International Journal of Artificial Intelligence in Education, 26(1), 293–331.

  Article  Google Scholar 

• Cleary, T. J., Konopasky, A., La Rochelle, J. S., Neubauer, B. E., Durning, S. J., & Artino, A. R. (2019). First-year medical students’ calibration bias and accuracy across clinical reasoning activities. Advances in Health Sciences Education, 24(4), 767–781.

  Google Scholar 

• Cloude, E. B., Taub, M., & Azevedo, R. (2018). Investigating the role of goal orientation: Metacognitive and cognitive strategy use and learning with intelligent tutoring systems. In R. Nkambou, R. Azevedo, & J. Vassileva (Eds.), ITS’18: Proceedings from the international conference of intelligent tutoring systems (pp. 44–53). Springer. https://doi.org/10.1007/978-3-319-91464-0_5

  Chapter  Google Scholar 

• Cloude, E. B., Dever, D. A., Wiedbusch, M. D., & Azevedo, R. (2020a). Quantifying scientific thinking using multichannel data with Crystal Island: Implications for individualized game-learning analytics. Frontiers in Education, 5, 572546. https://doi.org/10.3389/feduc

  Article  Google Scholar 

• Cloude, E. B., Wortha, F., Dever, D., & Azevedo, R. (2020b). How do emotions change during learning with an intelligent tutoring system? Metacognitive monitoring and performance with MetaTutor. In S. Denison, M. Mack, Y. Xu, & B. C. Armstrong (Eds.), Proceedings of the 42nd annual conference of the cognitive science society (pp. 423–429). Cognitive Science Society.

  Google Scholar 

• D’Mello, S. (2017). Emotional learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 115–127). Society for Learning Analytics Research.

  Chapter  Google Scholar 

• D’Mello, S., & Graesser, A. (2012). Dynamics of affective states during complex learning. Learning and Instruction, 22(2), 145–157.

  Article  Google Scholar 

• Dindar, M., Malmberg, J., Järvelä, S., Haataja, E., & Kirschner, P. A. (2019). Matching self-reports with electrodermal activity data: Investigating temporal changes in self-regulated learning. Education and Information Technologies, 25, 1785–1802. https://doi.org/10.1007/s10639-019-10059-5

  Article  Google Scholar 

• Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational psychologist, 46(1), 6–25.

  Article  Google Scholar 

• Efklides, A., Schwartz, B. L., & Brown, V. (2018). Motivation and affect in self-regulated learning: Does metacognition play a role? In D. H. Schunk & J. A. Greene (Eds.), Educational psychology handbook series. Handbook of self-regulation of learning and performance (pp. 64–82). Routledge/Taylor & Francis Group.

  Google Scholar 

• Emara, M., Hutchins, N., Grover, S., Snyder, C., & Biswas, G. (2021). Examining student regulation of collaborative, computational, problem-solving processes in open-ended learning environments. Journal of Learning Analytics, 8, 49–74.

  Article  Google Scholar 

• Emerson, A., Cloude, E. B., Azevedo, R., & Lester, J. (2020). Multimodal learning analytics for game‐based learning. British Journal of Educational Technology, 51(5), 1505–1526.

  Google Scholar 

• Favela, L. H. (2020). Cognitive science as complexity science. In Wiley interdisciplinary reviews: Cognitive science (p. e1525). Wiley-Blackwell.

  Google Scholar 

• Follmer, D. J., & Sperling, R. A. (2019). Examining the role of self-regulated learning microanalysis in the assessment of learners’ regulation. The Journal of Experimental Education, 87(2), 269–287.

  Article  Google Scholar 

• Gabriel, F., Buckley, S., & Barthakur, A. (2020). The impact of mathematics anxiety on self-regulated learning and mathematical literacy. Australian Journal of Education, 64(3), 227–242. https://doi.org/10.1177/0004944120947881

  Article  Google Scholar 

• Gilden, D. L. (2001). Cognitive emissions of 1/f noise. Psychological Review, 108(1), 33���56. https://doi.org/10.1037/0033-295X.108.1.33

  Article  Google Scholar 

• Goetz, T., Sticca, F., Pekrun, R., Murayama, K., & Elliot, A. J. (2016). Intraindividual relations between achievement goals and discrete achievement emotions: An experience sampling approach. Learning and Instruction, 41, 115–125.

  Article  Google Scholar 

• Järvelä, S., Gašević, D., Seppänen, T., Pechenizkiy, M., & Kirchener, P. (2020). Bridging learning sciences, machine learning, and affective computing for understanding cognition and affect in collaborative learning. British Journal of Educational Technology, 51, 2391–2400.

  Article  Google Scholar 

• Järvenoja, H., Malmberg, J., Törmänen, T., Mänty, K., Haataja, E., Ahola, S., & Järvelä, S. (2020). A collaborative learning design for promoting and analyzing adaptive motivation and emotion regulation in the science classroom. Frontiers in Education, 5, 111. https://www.frontiersin.org/article/10.3389/feduc.2020.00111

  Article  Google Scholar 

• Karabenick, S. A., Woolley, M. E., Friedel, J. M., Ammon, B. V., Blazevski, J., Bonney, C. R., … Kelly, K. L. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42(3), 139–151.

  Article  Google Scholar 

• Ketonen, E. E., Dietrich, J., Moeller, J., Salmela-Aro, K., & Lonka, K. (2018). The role of daily autonomous and controlled educational goals in students’ academic emotion states: An experience sampling method approach. Learning and Instruction, 53, 10–20.

  Article  Google Scholar 

• Klassen, R., & Usher, E. (2010). Self-efficacy in educational settings: Recent research and emerging directions. In T. Urdan & S. Karabenick (Eds.), The decade ahead: Theoretical perspectives on motivation and achievement (pp. 1–33). Emerald Group Publishing Limited.

  Google Scholar 

• Klerkx, J., Verbert, K., & Duval, R. (2017). Learning analytics dashboards. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 143–150). Society for Learning Analytics Research.

  Chapter  Google Scholar 

• Laird, J. E. (2012). The SOAR architecture. MIT Press.

  Google Scholar 

• Lajoie, S. P., Pekrun, R., Azevedo, R., & Leighton, J. P. (2020). Understanding and measuring emotions in technology-rich learning environments. Learning and Instruction, 70, 101272.

  Article  Google Scholar 

• Lang, C., Siemens, G., Wise, A., & Gasevic, D. (Eds.). (2017). Handbook of learning analytics (pp. 115–127). Solar, Society for Learning Analytics Research.

  Google Scholar 

• Laplace, P. S. marquis de. (1812). Théorie analytique des probabilités. V. Courcier.

  Google Scholar 

• Lodge, J. M., Panadero, E., Broadbent, J., & De Barba, P. G. (2019). Supporting self-regulated learning with learning analytics. In Learning analytics in the classroom: Translating learning analytics research for teachers (pp. 45–55). Routledge.

  Google Scholar 

• Mangaroska, K., Sharma, K., Gasevic, D., & Giannakos, M. (2020). Multimodal learning analytics to inform learning design: Lessons learned from computing education. Journal of Learning Analytics, 7(3), 79–97. https://doi.org/10.18608/jla.2020.73.7

  Article  Google Scholar 

• McRae, & Gross, J. J. (2020). Emotion regulation. Emotion, 20, 1–9.

  Article  Google Scholar 

• Miele, D. B., Scholer, A. A., & Fujita, K. (2020). Metamotivation: Emerging research on the regulation of motivational states. In A. J. Elliot (Ed.), Advances in motivation science (pp. 1–42). Elsevier.

  Google Scholar 

• Moeller, J., Ivcevic, Z., Brackett, M. A., & White, A. E. (2018). Mixed emotions: Network analyses of intra-individual co-occurrences within and across situations. Emotion, 18(8), 1106.

  Article  Google Scholar 

• Molenaar, I., & Knoop-van Campen, C. (2019). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12, 347–355.

  Article  Google Scholar 

• Mu, S., Cui, M., & Huang, X. (2020). Multimodal data fusion in learning analytics: A systematic review. Sensors, 20(23), 6856. https://doi.org/10.3390/s20236856

  Article  Google Scholar 

• Murayama, K., & Elliot, A. J. (2011). Achievement motivation and memory: Achievement goals differentially influence immediate and delayed remember–know recognition memory. Personality and Social Psychology Bulletin, 37(10), 1339–1348.

  Google Scholar 

• National Academies of Sciences, Engineering, and Medicine (NASME). (2018). How people learn II: Learners, contexts, and cultures. NASME.

  Google Scholar 

• Noroozi, O., Pijeira-Díaz, H. J., Sobocinski, M., Dindar, M., Järvelä, S., & Kirschner, P. A. (2020). Multimodal data indicators for capturing cognitive, motivational, and emotional learning processes: A systematic literature review. Education and Information Technologies, 25, 5499–5547.

  Article  Google Scholar 

• Ochoa, X. (2017). Multimodal learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 129–141). Society for Learning Analytics Research.

  Chapter  Google Scholar 

• Organisation for Economic Co-operation and Development (OECD). (2020). PISA 2025 assessment and analytical framework. OECD.

  Google Scholar 

• Panadero, E., Klug, J., & Järvelä, S. (2016). Third wave of measurement in the self-regulated learning field: When measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60(6), 723–735.

  Article  Google Scholar 

• Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341.

  Article  Google Scholar 

• Pekrun, R. (2013). Emotion, motivation, and self-regulation: Common principles and future directions. In Emotion, motivation, and self-regulation: A handbook for teachers (pp. 167–188). Emerald.

  Google Scholar 

• Pekrun, R. (2020). Self-report is indispensable to assess students’ learning. Frontline Learning Research, 8, 185–193.

  Article  Google Scholar 

• Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48.

  Article  Google Scholar 

• Pintrich, P. R. (2000). An achievement goal theory perspective on issues in motivation terminology, theory, and research. Contemporary Educational Psychology, 25(1), 92–104.

  Google Scholar 

• Pintrich, P. R. (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95(4), 667–686. https://doi.org/10.1037/0022-0663.95.4.667

• Price, M. J., Mudrick, N. V., Taub, M., & Azevedo, R. (2018). The role of negative emotions and emotion regulation on self-regulated learning with metatutor. In International conference on intelligent tutoring systems (pp. 170–179). Springer.

  Chapter  Google Scholar 

• Reindl, M., Tulis, M., & Dresel, M. (2020). Profiles of emotional and motivational self-regulation following errors: Associations with learning. Learning and Individual Differences, 77, 101806.

  Article  Google Scholar 

• Renninger, K. A., & Hidi, S. E. (Eds.). (2019). The Cambridge handbook of motivation and learning. Cambridge University Press.

  Google Scholar 

• Robinson, M. D., & Clore, G. L. (2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128(6), 934.

  Article  Google Scholar 

• Rovers, S. F. E., Clarebout, G., Savelberg, H. H. C. M., et al. (2019). Granularity matters: Comparing different ways of measuring self-regulated learning. Metacognition Learning, 14, 1–19. https://doi.org/10.1007/s11409-019-09188-6

  Article  Google Scholar 

• Schumacher, C., & Ifenthaler, D. (2018). The importance of students’ motivational dispositions for designing learning analytics. Journal of Computing in Higher Education, 30(3), 599–619.

  Article  Google Scholar 

• Schunk, D., & DiBenedetto, M. (2020). Motivation and social cognitive theory. Contemporary Educational Psychology, 60, 101832.

  Article  Google Scholar 

• Schunk, D., & Greene, J. A. (Eds.). (2018). Historical, contemporary, and future perspectives on self-regulated learning and performance. In D. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 254–270). Routledge.

  Google Scholar 

• Schunk, D. H., Meece, J. R., & Pintrich, P. R. (2014). Attribution theory. In Motivation in education: Theory, research and affiliation (pp. 91–138). Pearson.

  Google Scholar 

• Shahrokni, S. A., & Talaeizadeh, A. (2013). Learning processes in blended language learning: A mixed-methods approach. TESL-EJ, 17(3), 3.

  Google Scholar 

• Sharma, K., & Giannakos, M. (2020). Multimodal data capabilities for learning: What can multimodal data tell us about learning?. British Journal of Educational Technology, 51(5), 1450–1484.

  Google Scholar 

• Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., & Price, M. J. (2019). How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system? Learning and Instruction, 72, 101200. https://doi.org/10.1016/j.learninstruc.2019.04.001

  Article  Google Scholar 

• Taub, M., Sawyer, R., Smith, A., Rowe, J., Azevedo, R., & Lester, J. (2020). The agency effect: The impact of student agency on learning, emotions, and problem-solving behaviors in a game-based learning environment. Computers & Education, 147, 103781.

  Article  Google Scholar 

• Veenman, M. V. J. (2011). Alternative assessment of strategy use with self-report instruments: A discussion. Metacognition and Learning, 6(2), 205–211.

  Article  Google Scholar 

• Wiedbusch, M. D., Kite, V., Yang, X., Park, S., Chi, M., Taub, M., & Azevedo, R. (2021). A theoretical and evidence-based conceptual design of metadash: An intelligent teacher dashboard to support teachers’ decision making and students’ self-regulated learning. In Frontiers in education (Vol. 6, p. 570229). Frontiers Media SA.

  Google Scholar 

• Winne, P. H. (2018). Cognition and metacognition within self-regulated learning. In D. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 36–48). Routledge.

  Google Scholar 

• Winne, P. H. (2020). A proposed remedy for grievances about self-report methodologies. Frontline Learning Research, 8, 164–173.

  Article  Google Scholar 

• Winne, P. H., & Azevedo, R. (2022). Metacognition. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (3rd ed.). Cambridge University Press.

  Google Scholar 

• Wolters, C. A. (2003). Understanding procrastination from a self-regulated learning perspective. Journal of Educational Psychology, 95(1), 179–187. https://doi.org/10.1037/0022-0663.95.1.179

• Wong, E., Leslie, J. J., Soon, J. A., & Norman, W. V. (2016). Measuring interprofessional competencies and attitudes among health professional students creating family planning virtual patient cases. BMC Medical Education, 16(1), 1–9.

  Google Scholar 

• Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166–183.

  Article  Google Scholar 

Download references