skip to main content
research-article

Health Problem Solving by Older Persons Using a Complex Government Web Site: Analysis and Implications for Web Design

Published: 01 April 2011 Publication History

Abstract

A large number of health-related Web sites currently exist that offer consumers a wealth of information that can be used to enhance the quality of their lives. Much less attention has been given to Web sites that can support complex health-related problem solving, as opposed to more general information search activities, of user populations such as older adults. In this article, we expand on a prior usability study that examined the performance of 112 older adults who were asked to solve two problems using the U. S. government’s Medicare.gov Web site. The indications from that study were that older adults had difficulty carrying out these problem-solving tasks.
This article illustrates, in the context of a case study, the use of a structured methodology for obtaining insights into Web site design issues that could make it difficult for healthcare consumers such as older adults to solve health-related problems. Initially, a number of Web design guidelines that have been developed for older users are presented. The argument is made that such checklist-type guidelines, though essential, are difficult to apply to complex Web-based problem-solving activities. Following a review of research in the area of Web-based health information seeking and problem-solving by older adults, the description and implementation of a methodology for aiding designers in anticipating cognitive demands that older users might confront during their problem-solving activities is presented. Detailed analysis of task performance is then presented to demonstrate that very few of the study participants were able to successfully negotiate the solution to the problem. The use of the methodology for identifying a number user-Web site interaction issues and for proposing recommendations particularly relevant to older users, and ultimately for enhancing the accessibility of health Web sites, is highlighted. Finally, a detailed framework is presented that is intended for guiding designers in the application of this methodology.

References

[1]
Arch, A. 2008. WAI-AGE literature review and analysis: Web accessibility for older users http://www.w3.org/TRfwai-age-literature/.
[2]
Baker, D. W., Williams, M. V., Parker, R. M., Gazmararian, J. A., and Nurss, J. 1999. Development of a brief test to measure functional health literacy. Patient Ed. Counsel. 38, 33--42.
[3]
Bauerle Bass, S. 2003. How will Internet use affect the patient? A review of computer network and closed Internet-based system studies and the implications in understanding how the llse of tile Internet affects patient populations. J. Health Psych. 8, 25--38.
[4]
Berson, F. G. 1993. Basic Ophthalmology for Medical Students and Primary Care Residents 6th Ed. American Academy of Ophthalmology, San Francisco.
[5]
Bhavnani, S. K. 2003. The distribution of online healthcare information: A case study of Melanoma. In Proceedings of the America Medical Informatics Association Symposium. 81--85.
[6]
Bhavnani, S. K. 2005. Why is it difficult to find comprehensive information? Implications of information scatter for search and design. J. Amer. Soc. Inform. Sci. Techn. 56, 989--1003.
[7]
Caldwell, B., Cooper, M., Reid, L. G., and Vanderheiden, G. 2008. Web Content Accessibility Guidelines(WCAG) 2.0. http://www.w3.org/TR/WC.
[8]
Chi, M.T.H. and Glaser, R. 1985. Problem solving ability. In Human Abilities: An Information Processing Approach. R. J. Sternberg, Ed., Freeman, New York.
[9]
Chin, J. and Fu, W. 2010. Interactive effects of age and interface differences on search strategies and performance.In Proceedings of the 28th International Conference on Human Factors in Computing Systems. ACM, New York, 403--412.
[10]
Chin, J., Fu, W., and Kannampallil, T. 2009. Adaptive inforn1ation search: Age-dependent interactions between cognitive profiles and strategies. In Proceedings of the 27th lntemational Conference on Human Factors in Computing Systems. ACM, New York, 1683--1692.
[11]
Czaja, S. J. and Sharit, J. 2003. Practically relevant research: Capturing real world tasks, environments. and outcome. Gerontologist 43, 9--18.
[12]
Czaja, S. J., Charness, N., Fisk, A. D., Hertzog, C., Nair, S. N., Rogers, W. A., and Sharit, J. 2006. Factors predicting the use of technology: Findings from the Center for Research and Ebcation on Aging and Technology Enhancement (CREATE). Psych. Aging 21, 333--352.
[13]
Czaja, S. J., Sharit, J., and Nair, S. N. 2008. Usability of tile Medicare health web site. J. Amer. Medic. Assn. 300, 7, 790--792.
[14]
Czaja, S. J., Sharit, J., Hernandez, M. A., Nair, S. N., and Loewenstein, D. 2010. Variability among older adults in Internet health information seeking. Gerontech. 9, 46--55.
[15]
Dervin, B. 1998. Sense-making in theory and practice: An overview of user interests in knowledge seeking and use. J. Knowl. Manage. 2, 2, 36--46.
[16]
Desurvire, H. and Thomas, T. C. 1993. Enhancing the performance of interface evaluators using nonempirical usability methods. In Proceedings of the 37th Annual Meeting of the Human Factors and Ergonomics Society. HFES, Santa Monica, CA, 1132--1136.
[17]
Diehl M., Willis S. L., and Schaie, K. W. 1995. Everyday problem solving in older adults: Observational assessment and cognitive correlates. Psych. Aging 10, 478--491.
[18]
Fairweather, P. G. 2008. How older and younger adults differ in their approach to problem solving on a complex website. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’08). ACM, New York, 67--72.
[19]
Fisk, A. D., Rodgers, W. A., Charness, N., Czaja, S. J., and Sharit, J. 2009. Designing for Older Adults: Principles and Creative Human Factors Approaches. CRC Press, Taylor & Francis Group, Boca Raton, FL.
[20]
Folstein M. F., Folstein S. E. And Mchugh P. R. 1975. Mini-Mental State: A practical method for grading the cognitive state of patients for the clinician. J. Psych. Resear. 12, 189--198.
[21]
Hanson, V. L. 2010. Influencing technology adoption by older adults. Interact. Comput. 22, 502--509.
[22]
Hyperionics Technology 2006. HyperCam. [email protected].
[23]
Kirwan, B. and Ainsworth, L. K. 1992. Guide to Task Analysis. Taylor & Francis, London.
[24]
Luczak, H. 1997. Task analysis. In Handbook of Human Factors and Ergonomics 2nd Ed. G. Salvendy, Ed., John Wiley & Sons, New York, 340--416.
[25]
National Institute on Aging and National Library of Medicine 2002. Making your website senior friendly: A checklist. http://www.nlm.nih.gov/pubs/checklist.pdf.
[26]
Nielsen, J. 1993. Usability Engineering. AP Professional, Cambridge, MA.
[27]
Nielsen, J. and Levy, J. 1994. Measuring usability: Preference vs. performance. Comm. ACM, 37, 4, 66--75.
[28]
O’Hara, K. 2004. “Cub cuts” on the information highway: Older adults and the Internet. Techn. Comm. Quarter. 4, 423--445.
[29]
Park, D. 2000. The basic mechanisms accounting for age-related decline in cognitive function. In D. Park, N. Schwartz, Eds., Cognitive Aging: A Primer, Taylor & Francis, Philadelphia, PA, 3--22.
[30]
Pew Internet & American Life Project 2006. Online health search 2006. http://www.pewinternet.org/Reports/2006/Online-Health-Search-2006.aspx
[31]
Pew Internet & American Life Project 2009. The social life of health information. http://www.pewinternet.org/Reports/2009/8-The-Social-Life-of-Health-Information.aspx.
[32]
Pfeiffer, R. I. 1975. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J. Amer. Geriat. Soc. 23, 433--441.
[33]
Radloff, L. S. 1977. The CES-D Scale: A self-report depression scale for research in the general population. Appl. Psych. Measure. 1, 385--40 I.
[34]
Salthouse, T. A. 1991. Theoretical Perspectives on Cognitive Aging. Lawrence Erlbaum, Hillsdale, NJ.
[35]
Salthouse, T. A. 1996. The processing-speed theory of adult age differences in cognition. Psych. Rev. 103, 403--428.
[36]
Salthouse, T. A. and Czaja, S. J. 2000. Structural constraints on process explanations in cognitive aging. Psych. Aging 15, 44--55.
[37]
Sharit, J., Hernández, M. A., Czaja, S. C., and Pirolli, P. 2008. Investigating the roles of knowledge and cognitive abilities in older adult information seeking on the web. ACM Trans. Comput.-Hum. Interact. 15, 1, 3:25.
[38]
Shepherd, A. 2000. Hierarchical Task Analysis. Taylor & Francis, London.
[39]
Sloan, D. 2006. Two cultures? The disconnect between the web standards movement and research-based web design guidelines for older people. Gerontech. 5, 106--112.
[40]
Taha, J., Sharit, J., and Czaja, S. J. 2009. Use of and satisfaction with sources of health information among older Internet users and non-users. Gerontologist 49, 663--673.
[41]
Wechsler, D. 1997. Wechsler Memory Scale III 3rd Ed. Psychological Corporation, San Antonio, TX.
[42]
Weick, K. E. 1995. Sense-Making in Organizations. Sage, Thousand Oaks, CA.
[43]
Wickens, C. D. and Hollands, J. 2000. Engineering Psychology and Human Performance 3rd Ed. Prentice Hall, Upper Saddle River, NJ.
[44]
Wickens, C. D., Lee, J. D., Liu, Y., and Gordon Becker, S. E. 2004. An Introduction to Human Factors Engineering, 2nd Ed. Prentice Hall, Upper Saddle River, NJ.
[45]
Woods, D. D. and Watts, J. C. 1997. How not to navigate through too many displays. In Handbook of Human-Computer Interaction, 2nd ed., M. Helander, T. K. Landauer, and P. Prabhu, Eds. Elsevier Science, New York, 617-650.
[46]
Yang, K. and El-Haik, B. 2003. Design for Six Sigma: A Roadmap for Product Development. McGraw-Hill, New York.
[47]
Zaphiris, P., Ghiawadala, M., and Mughal, S. 2005. Age-centered research-based web design guidelines. In Proceedings of the 23rd International Conference on Human Factors in Computing Systems. ACM, New York, 1897--1900.

Cited By

View all
  • (2024)Are Virtual Assistants Trustworthy for Medicare Information: An Examination of Accuracy and ReliabilityThe Gerontologist10.1093/geront/gnae06264:8Online publication date: 4-Jun-2024
  • (2020)Towards a Reference Model of Guidelines for the Elderly Based on Technology Adoption FactorsProceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3411170.3411240(30-35)Online publication date: 14-Sep-2020
  • (2019)Effects of Extended Use of an Age-friendly Computer System on Assessments of Computer Proficiency, Attitudes, and Usability by Older Non--Computer UsersACM Transactions on Accessible Computing10.1145/332529012:2(1-28)Online publication date: 11-Jun-2019
  • Show More Cited By

Index Terms

  1. Health Problem Solving by Older Persons Using a Complex Government Web Site: Analysis and Implications for Web Design

                              Recommendations

                              Comments

                              Information & Contributors

                              Information

                              Published In

                              cover image ACM Transactions on Accessible Computing
                              ACM Transactions on Accessible Computing  Volume 3, Issue 3
                              April 2011
                              88 pages
                              ISSN:1936-7228
                              EISSN:1936-7236
                              DOI:10.1145/1952383
                              Issue’s Table of Contents
                              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                              Publisher

                              Association for Computing Machinery

                              New York, NY, United States

                              Publication History

                              Published: 01 April 2011
                              Accepted: 01 January 2011
                              Revised: 01 January 2011
                              Received: 01 June 2010
                              Published in TACCESS Volume 3, Issue 3

                              Permissions

                              Request permissions for this article.

                              Check for updates

                              Author Tags

                              1. Human-computer interaction
                              2. government Web sites
                              3. health information seeking
                              4. hierarchical task analysis (HTA)
                              5. older adults
                              6. optimization
                              7. troubleshooting

                              Qualifiers

                              • Research-article
                              • Research
                              • Refereed

                              Funding Sources

                              Contributors

                              Other Metrics

                              Bibliometrics & Citations

                              Bibliometrics

                              Article Metrics

                              • Downloads (Last 12 months)21
                              • Downloads (Last 6 weeks)1
                              Reflects downloads up to 24 Oct 2024

                              Other Metrics

                              Citations

                              Cited By

                              View all
                              • (2024)Are Virtual Assistants Trustworthy for Medicare Information: An Examination of Accuracy and ReliabilityThe Gerontologist10.1093/geront/gnae06264:8Online publication date: 4-Jun-2024
                              • (2020)Towards a Reference Model of Guidelines for the Elderly Based on Technology Adoption FactorsProceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3411170.3411240(30-35)Online publication date: 14-Sep-2020
                              • (2019)Effects of Extended Use of an Age-friendly Computer System on Assessments of Computer Proficiency, Attitudes, and Usability by Older Non--Computer UsersACM Transactions on Accessible Computing10.1145/332529012:2(1-28)Online publication date: 11-Jun-2019
                              • (2019)A Human Factors Engineering Perspective to Aging and WorkCurrent and Emerging Trends in Aging and Work10.1007/978-3-030-24135-3_10(191-218)Online publication date: 14-Sep-2019
                              • (2016)An Analysis of Age, Technology Usage, and Cognitive Characteristics Within Information Retrieval TasksACM Transactions on Accessible Computing10.1145/28560468:3(1-26)Online publication date: 6-Apr-2016
                              • (2016)Rationale and study protocol for the Nursing Home Compare Plus (NHCPlus) randomized controlled trial: A personalized decision aid for patients transitioning from the hospital to a skilled-nursing facilityContemporary Clinical Trials10.1016/j.cct.2015.12.01847(139-145)Online publication date: Mar-2016
                              • (2015)A comparison of visual and textual city portal designs on desktop and mobile interfacesProceedings of the 41st Graphics Interface Conference10.5555/2788890.2788927(211-218)Online publication date: 3-Jun-2015
                              • (2015)Online Information Search Performance and Search Strategies in a Health Problem-Solving ScenarioJournal of Cognitive Engineering and Decision Making10.1177/15553434155837479:3(211-228)Online publication date: 21-May-2015
                              • (2014)Age, technology usage, and cognitive characteristics in relation to perceived disorientation and reported website ease of useProceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility10.1145/2661334.2661356(193-200)Online publication date: 20-Oct-2014
                              • (2013)Website design: Technical, social and medical issues for self-reporting by elderly patientsHealth Informatics Journal10.1177/146045821348838220:2(136-150)Online publication date: 18-Sep-2013
                              • Show More Cited By

                              View Options

                              Get Access

                              Login options

                              Full Access

                              View options

                              PDF

                              View or Download as a PDF file.

                              PDF

                              eReader

                              View online with eReader.

                              eReader

                              Media

                              Figures

                              Other

                              Tables

                              Share

                              Share

                              Share this Publication link

                              Share on social media