Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation
Authors:
Elaf Alhazmi,
Quan Z. Sheng,
Wei Emma Zhang,
Munazza Zaib,
Ahoud Alhazmi
Abstract:
The distractor generation task focuses on generating incorrect but plausible options for objective questions such as fill-in-the-blank and multiple-choice questions. This task is widely utilized in educational settings across various domains and subjects. The effectiveness of these questions in assessments relies on the quality of the distractors, as they challenge examinees to select the correct…
▽ More
The distractor generation task focuses on generating incorrect but plausible options for objective questions such as fill-in-the-blank and multiple-choice questions. This task is widely utilized in educational settings across various domains and subjects. The effectiveness of these questions in assessments relies on the quality of the distractors, as they challenge examinees to select the correct answer from a set of misleading options. The evolution of artificial intelligence (AI) has transitioned the task from traditional methods to the use of neural networks and pre-trained language models. This shift has established new benchmarks and expanded the use of advanced deep learning methods in generating distractors. This survey explores distractor generation tasks, datasets, methods, and current evaluation metrics for English objective questions, covering both text-based and multi-modal domains. It also evaluates existing AI models and benchmarks and discusses potential future research directions.
△ Less
Submitted 11 October, 2024; v1 submitted 2 February, 2024;
originally announced February 2024.
An Empirical Study on Team Formation in Online Games
Authors:
Essa Alhazmi,
Sameera Horawalavithana,
Adriana Iamnitchi,
John Skvoretz,
Jeremy Blackburn
Abstract:
Online games provide a rich recording of interactions that can contribute to our understanding of human behavior. One potential lesson is to understand what motivates people to choose their teammates and how their choices leadto performance. We examine several hypotheses about team formation using a large, longitudinal dataset from a team-based online gaming environment. Specifically, we test how…
▽ More
Online games provide a rich recording of interactions that can contribute to our understanding of human behavior. One potential lesson is to understand what motivates people to choose their teammates and how their choices leadto performance. We examine several hypotheses about team formation using a large, longitudinal dataset from a team-based online gaming environment. Specifically, we test how positive familiarity, homophily, and competence determine team formationin Battlefield 4, a popular team-based game in which players choose one of two competing teams to play on. Our dataset covers over two months of in-game interactions between over 380,000 players. We show that familiarity is an important factorin team formation, while homophily is not. Competence affects team formation in more nuanced ways: players with similarly high competence team-up repeatedly, but large variations in competence discourage repeated interactions.
△ Less
Submitted 9 August, 2017;
originally announced August 2017.
