-
Automated speech- and text-based classification of neuropsychiatric conditions in a multidiagnostic setting
Authors:
Lasse Hansen,
Roberta Rocca,
Arndis Simonsen,
Alberto Parola,
Vibeke Bliksted,
Nicolai Ladegaard,
Dan Bang,
Kristian Tylén,
Ethan Weed,
Søren Dinesen Østergaard,
Riccardo Fusaroli
Abstract:
Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions. However, most studies only compare a single clinical group to healthy controls, whereas clinical practice often requires differentiating between multiple potential diagnoses (multiclass settings). To address this, we assembled a dataset of repeated recordings from 420 participants (67 with major d…
▽ More
Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions. However, most studies only compare a single clinical group to healthy controls, whereas clinical practice often requires differentiating between multiple potential diagnoses (multiclass settings). To address this, we assembled a dataset of repeated recordings from 420 participants (67 with major depressive disorder, 106 with schizophrenia and 46 with autism, as well as matched controls), and tested the performance of a range of conventional machine learning models and advanced Transformer models on both binary and multiclass classification, based on voice and text features.
While binary models performed comparably to previous research (F1 scores between 0.54-0.75 for autism spectrum disorder, ASD; 0.67-0.92 for major depressive disorder, MDD; and 0.71-0.83 for schizophrenia); when differentiating between multiple diagnostic groups performance decreased markedly (F1 scores between 0.35-0.44 for ASD, 0.57-0.75 for MDD, 0.15-0.66 for schizophrenia, and 0.38-0.52 macro F1). Combining voice and text-based models yielded increased performance, suggesting that they capture complementary diagnostic information.
Our results indicate that models trained on binary classification may learn to rely on markers of generic differences between clinical and non-clinical populations, or markers of clinical features that overlap across conditions, rather than identifying markers specific to individual conditions. We provide recommendations for future research in the field, suggesting increased focus on developing larger transdiagnostic datasets that include more fine-grained clinical features, and that can support the development of models that better capture the complexity of neuropsychiatric conditions and naturalistic diagnostic assessment.
△ Less
Submitted 31 January, 2023; v1 submitted 13 January, 2023;
originally announced January 2023.
-
crea.blender: A Neural Network-Based Image Generation Game to Assess Creativity
Authors:
Janet Rafner,
Arthur Hjorth,
Sebastian Risi,
Lotte Philipsen,
Charles Dumas,
Michael Mose Biskjær,
Lior Noy,
Kristian Tylén,
Carsten Bergenholtz,
Jesse Lynch,
Blanka Zana,
Jacob Sherson
Abstract:
We present a pilot study on crea.blender, a novel co-creative game designed for large-scale, systematic assessment of distinct constructs of human creativity. Co-creative systems are systems in which humans and computers (often with Machine Learning) collaborate on a creative task. This human-computer collaboration raises questions about the relevance and level of human creativity and involvement…
▽ More
We present a pilot study on crea.blender, a novel co-creative game designed for large-scale, systematic assessment of distinct constructs of human creativity. Co-creative systems are systems in which humans and computers (often with Machine Learning) collaborate on a creative task. This human-computer collaboration raises questions about the relevance and level of human creativity and involvement in the process. We expand on, and explore aspects of these questions in this pilot study. We observe participants play through three different play modes in crea.blender, each aligned with established creativity assessment methods. In these modes, players "blend" existing images into new images under varying constraints. Our study indicates that crea.blender provides a playful experience, affords players a sense of control over the interface, and elicits different types of player behavior, supporting further study of the tool for use in a scalable, playful, creativity assessment.
△ Less
Submitted 17 August, 2020; v1 submitted 13 August, 2020;
originally announced August 2020.
-
Inferring causality from noisy time series data
Authors:
Dan Mønster,
Riccardo Fusaroli,
Kristian Tylén,
Andreas Roepstorff,
Jacob F. Sherson
Abstract:
Convergent Cross-Mapping (CCM) has shown high potential to perform causal inference in the absence of models. We assess the strengths and weaknesses of the method by varying coupling strength and noise levels in coupled logistic maps. We find that CCM fails to infer accurate coupling strength and even causality direction in synchronized time-series and in the presence of intermediate coupling. We…
▽ More
Convergent Cross-Mapping (CCM) has shown high potential to perform causal inference in the absence of models. We assess the strengths and weaknesses of the method by varying coupling strength and noise levels in coupled logistic maps. We find that CCM fails to infer accurate coupling strength and even causality direction in synchronized time-series and in the presence of intermediate coupling. We find that the presence of noise deterministically reduces the level of cross-mapping fidelity, while the convergence rate exhibits higher levels of robustness. Finally, we propose that controlled noise injections in intermediate-to-strongly coupled systems could enable more accurate causal inferences. Given the inherent noisy nature of real-world systems, our findings enable a more accurate evaluation of CCM applicability and advance suggestions on how to overcome its weaknesses.
△ Less
Submitted 3 March, 2016;
originally announced March 2016.
-
A Heart for Interaction: Shared Physiological Dynamics and Behavioral Coordination in a Collective, Creative Construction Task
Authors:
Riccardo Fusaroli,
Johanne S. Bjørndahl,
Andreas Roepstorff,
Kristian Tylén
Abstract:
Interpersonally shared physiological dynamics are increasingly argued to underlie rapport, empathy and even team performance. Inspired by the model of interpersonal synergy, we critically investigate the presence, temporal development, possible mechanisms and impact of shared interpersonal heart rate dynamics during individual and collective creative LEGO construction tasks. In Study 1 we show how…
▽ More
Interpersonally shared physiological dynamics are increasingly argued to underlie rapport, empathy and even team performance. Inspired by the model of interpersonal synergy, we critically investigate the presence, temporal development, possible mechanisms and impact of shared interpersonal heart rate dynamics during individual and collective creative LEGO construction tasks. In Study 1 we show how shared HR dynamics are driven by a plurality of sources including task constraints and behavioral coordination. Generally, shared HR dynamics are more prevalent in individual trials (involving participants doing the same things) than in collective ones (involving participants taking turns and performing complementary actions). However, when contrasted against virtual pairs, collective trials display more stable shared HR dynamics suggesting that online social interaction plays an important role. Furthermore, in contrast to individual trials, shared HR dynamics are found to increase across collective trials. Study 2 investigates which aspects of social interaction might drive these effects. We show that shared HR dynamics are statistically predicted by interpersonal speech and building coordination. In Study 3, we explore the relation between HR dynamics, behavioral coordination, and self-reported measures of rapport and group competence. While behavioral coordination predicts rapport and group competence, shared HR dynamics do not. Although shared physiological dynamics were reliably observed in our study, our results warrant not to consider HR dynamics a general driving mechanism of social coordination. Behavioral coordination - on the other hand - seems to be more informative of both shared physiological dynamics and collective experience.
△ Less
Submitted 6 December, 2015; v1 submitted 22 April, 2015;
originally announced April 2015.
