skip to main content
research-article

An evaluation of measures to dissociate language and communication disorders from healthy controls using machine learning techniques

Published: 28 January 2012 Publication History

Abstract

Reliably distinguishing patients with verbal impairment due to brain damage, e.g. aphasia, cognitive communication disorder (CCD), from healthy subjects is an important challenge in clinical practice. A widely-used method is the application of word generation tasks, using the number of correct responses as a performance measure. Though clinically well-established, its analytical and explanatory power is limited. In this paper, we explore whether additional features extracted from task performance can be used to distinguish healthy subjects from aphasics or CCD patients. We considered temporal, lexical, and sublexical features and used machine learning techniques to obtain a model that minimizes the empirical risk of classifying participants incorrectly. Depending on the type of word generation task considered, the exploitation of features with state-of-the-art machine learning techniques outperformed the predictive accuracy of the clinical standard method (number of correct responses). Our analyses confirmed that number of correct responses is an adequate measure for distinguishing aphasics from healthy subjects. However, our additional features outperformed the traditional clinical measure in distinguishing patients with CCD from healthy subjects: The best classification performance was achieved by excluding number of correct responses. Overall, our work contributes to the challenging goal of distinguishing patients with verbal impairments from healthy subjects.

References

[1]
D. A. Abwender, J. G. Swan, J. T. Bowerman, and S. W. Connely. Qualitative analysis of verbal fluency output: Review and comparison of several scoring methods. Assessment, 8(3):323--336, 2001.
[2]
D. W. Aha and D. Kibler. Instance-based learning algorithms. Machine Learning, 6:37--66, 1991.
[3]
S. Aschenbrenner, O. Tucha, and K. W. Lange. RWT -- Regensburger Wortflüssigkeits-Test: Handanweisung. Hofgrefe, Göttingen, 2000.
[4]
I. M. Barrow, M. Hough, M. P. Rastatter, M. Walker, D. Holbert, and M. F. Rotondo. Can within-category naming identify subtle cognitive deficits in the mild traumatic brain-injured patient? The Journal of Trauma, Injury, Infection and Critical Care, 54(5):888--897, 2003.
[5]
A. Basso, F. Burgio, and P. Pradoni. Semantic category and initial letter word fluency in left-brain-damaged patients. European Journal of Neurology, 4:544--550, 1997.
[6]
W. W. Beatty, J. A. Testa, S. English, and P. Winn. Influences of clustering and switching on the verbal fluency performance of patients with alzheimer's disease. Aging, Neuropsychology and Cognition, 4(4):273--279, 1997.
[7]
R. M. Bittner and S. F. Crowe. The relationship between naming difficulty and FAS performance following traumatic brain injury. Brain Injury, 20(9):971--980, 2006.
[8]
D. Claros-Salinas, G. Greitemann, S. Lacher, and T. Leim. Die Bedeutung sprachlicher Störungen bei Schlaganfallpatienten für soziale und berufliche Rehabilitation: Jahresbericht, Schmieder Kliniken -- Lurija Institut, 2005.
[9]
C. A. Coelho and F. DeRuyter. Treatment efficacy: Cognitive communicative disorders resulting from traumatic brain injury in adults. Journal of Speech and Hearing Research, 39:5--17, 1996.
[10]
Cummings J. L. Pragmatics and adult language disorders: Past achievements and future directions. Seminars in Speech and Language, 28:96--110, 2007.
[11]
S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American society for information science, 41:391--407, 1990.
[12]
DGN. Akuttherapie des ischämischen Schlaganfalls: Leitlinie der Deutschen Gesellschaft für Neurologie (DGN) und der Deutschen Schlaganfallgesellschaft (DSG) in der Deutschen Gesellschaft für Neurologie, Mai 2009.
[13]
M. C. Duff, A. Proctor, and K. Haley. Mild traumatic brain injury (MTBI): assessment and treatment procedures used by speech-language pathologists (SLPs). Brain Injury, 16(9):773--787, 2002.
[14]
A. W. Ellis, D. Miller, and G. Sin. Wernicke's aphasia and normal language processing: A case study in cognitive neuropsychology. Cognition, (15):111--144, 1983.
[15]
E. Gabrilovich and S. Markovitch. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In Proceedings of the 20th International Joint Conference on Artifical Intelligence, 2007.
[16]
H. Goodglass and E. Kaplan. The assessment of aphasia and related disorders. Lea and Febiger, Philadelphia, 1972.
[17]
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: An update. SIGKDD Explorations, 11(1):10--18, 2009.
[18]
S. Haykin. Neural Networks. A Comprehensive Foundation. Prentice Hall, London, United Kingdom, 2 edition, 1999.
[19]
W. Huber, K. Poeck, D. Weniger, and K. Willmes. Aachener Aphasie Test. Hogrefe - Verlag für Psychologie, 1983.
[20]
A. K. Jain, R. P. W. Duin, and J. Mao. Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1):4--37, 2000.
[21]
A. J\"arvelin. Comparison of three neural network classifiers for aphasic and non-aphasic naming data. In Proceedings of the First International Conference on Health Informatics, 2008.
[22]
G. H. John and P. Langley. Estimating continuous distributions in bayesian classifiers. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, 1995.
[23]
G. Kavé, E. Heled, E. Vakil, and E. Agranov. Which verbal fluency measure is most useful in demonstrating executive deficits after traumatic brain injury? Journal of Clinical and Experimental Neuropsychology, 33(3):358--365, 2011.
[24]
I. Kononenko. Estimating attributes: Analysis and extensions of relief. In Proceedings of the European Conference on Machine Learning, 1994.
[25]
N. Landwehr, M. Hall, and E. Frank. Logistic model trees. Machine Learning, 95:161--205, 2005.
[26]
E. L. Lehmann and J. P. Romano. Testing tatistical hypotheses. Springer Texts in Statistics. Springer, New York, third edition, 2005.
[27]
P. Marklund, S. Sikstrom, R. Baath, and L.-G. Nilsson. Age effects on semantic coherence: Latent semantic analysis applied to letter fluency data. In Proceedings of the Third International Conference on Advances in Semantic Processing, 2009.
[28]
I. Martin and S. McDonald. Weak coherence, no theory of mind, or executive dysfunction? Solving the problem of pragmatic language disorders. Brain and Language, 85:451--466, 2003.
[29]
T. Mitchell. Machine Learning. McGraw-Hill, New York, 1997.
[30]
L. Nickels and D. Howard. Aphasic naming: What matters? Neuropsychologia, 33(10):1281--1303, 1995.
[31]
L. Nickels and D. Howard. Dissociating effects of number of phonemes, number of syllables, and syllabic complexity on word production in aphasia: It's the number of phonemes that counts. Cognitive Neuropsychology, 21(1):57--78, 2004.
[32]
J. Platt. Fast training of support vector machines using sequential minimal optimization. In B. Schoelkopf, C. Burges, and A. Smola, editors, Advances in Kernel Methods - Support Vector Learning. MIT Press, 1998.
[33]
G. P. Prigatano. Neuropsychological rehabilitation after brain injury. Johns Hopkins University Press, Baltimore, 1986.
[34]
V. M. Rosen and R. W. Engle. The role of working memory capacity in retrieval. Journal of Experimental Psychology: General, 126(3):211--227, 1997.
[35]
A. I. Tröster, J. A. Fields, J. A. Testa, R. H. Paul, C. R. Blanco, K. A. Hames, D. P. Salmon, and W. W. Beatty. Cortical and subcortical influences on clustering and switching in the performance of verbal fluency tasks. Neuropsychologia, 36(4):295--304, 1998.
[36]
A. K. Troyer, M. Moscovitch, and G. Winocur. Clustering and switching as two components of verbal fluency: Evidence from younger and older healthy adults. Neuropsychology, 11(1):138--146, 1997.

Cited By

View all
  • (2023)Predicting developmental language disorders using artificial intelligence and a speech data analysis toolHuman–Computer Interaction10.1080/07370024.2023.224283739:1-2(8-42)Online publication date: 16-Aug-2023
  • (2023)What Drives Task Performance in Animal Fluency in Individuals Without Dementia? The SMART-MR StudyJournal of Speech, Language, and Hearing Research10.1044/2023_JSLHR-22-0044566:9(3473-3485)Online publication date: 13-Sep-2023
  • (2020)Early Diagnosis of Alzheimer's Disease Using Hybrid Word Embedding and Linguistic CharacteristicsProceedings of the 2020 3rd International Conference on Algorithms, Computing and Artificial Intelligence10.1145/3446132.3446197(1-7)Online publication date: 24-Dec-2020
  • Show More Cited By

Index Terms

  1. An evaluation of measures to dissociate language and communication disorders from healthy controls using machine learning techniques

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IHI '12: Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium
    January 2012
    914 pages
    ISBN:9781450307819
    DOI:10.1145/2110363
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 January 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. aphasia
    2. cognitive communication disorder
    3. machine learning
    4. word generation tasks

    Qualifiers

    • Research-article

    Conference

    IHI '12
    Sponsor:
    IHI '12: ACM International Health Informatics Symposium
    January 28 - 30, 2012
    Florida, Miami, USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 22 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Predicting developmental language disorders using artificial intelligence and a speech data analysis toolHuman–Computer Interaction10.1080/07370024.2023.224283739:1-2(8-42)Online publication date: 16-Aug-2023
    • (2023)What Drives Task Performance in Animal Fluency in Individuals Without Dementia? The SMART-MR StudyJournal of Speech, Language, and Hearing Research10.1044/2023_JSLHR-22-0044566:9(3473-3485)Online publication date: 13-Sep-2023
    • (2020)Early Diagnosis of Alzheimer's Disease Using Hybrid Word Embedding and Linguistic CharacteristicsProceedings of the 2020 3rd International Conference on Algorithms, Computing and Artificial Intelligence10.1145/3446132.3446197(1-7)Online publication date: 24-Dec-2020
    • (2016)New ways to analyze word generation performance in brain injury: A systematic review and meta-analysis of additional performance measuresJournal of Clinical and Experimental Neuropsychology10.1080/13803395.2016.116332738:7(764-781)Online publication date: 12-May-2016
    • (2014)NLP-Oriented Contrastive Study of Linguistic Productions of Alzheimer’s and Control PeopleAdvances in Natural Language Processing10.1007/978-3-319-10888-9_41(412-424)Online publication date: 2014

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media