skip to main content
extended-abstract

Understanding the AI-intervened User Interfaces of Online Health Consultation Platforms

Published: 26 September 2023 Publication History

Abstract

This paper aims to investigate patient perceptions (i.e. social presence and trust) of online health consultation (OHC) interfaces with a focus on artificial intelligence (AI) intervention. It describes two studies, which are part of a larger body of research that aims to explore how AI interventions and their interfaces should be designed so that AI can better support the mobile health experience. Study 1 (n=10) was an interview study, which yielded four categories of design features of OHC interfaces. Three categories have been, or would be, strongly intervened by AI and were viewed to have influenced on user perceptions to different extents. Study 2 (n=18) focused on exploring one AI-intervened feature and found that the interface design of AI interventions influenced user perceptions. Our contributions to HCI include empirical insights into how interfaces of AI-intervened OHCs could influence the perceptions of their users, with design implications.

References

[1]
Zheng, S., Chang, P. Y., Chen, J., Chang, Y. W., & Fan, H. C. (2022). An Investigation of Patient Decisions to Use eHealth: A View of Multichannel Services. Journal of Organizational and End User Computing (JOEUC), 34(4), 1-24. https://doi.org/10.4018/JOEUC.289433
[2]
Al-Mahdi, I., Gray, K., & Lederman, R. (2015). Online Medical Consultation: A review of literature and practice. In Proceedings of the 8th Australasian workshop on health informatics and knowledge management, Sydney, Australia, pp. (27-30). Sydney: Australian Computer Society.
[3]
Seitz, L., Bekmeier-Feuerhahn, S., & Gohil, K. (2022). Can we trust a chatbot like a physician? A qualitative study on understanding the emergence of trust toward diagnostic chatbots. International Journal of Human-Computer Studies, 165, 102848. https://doi.org/10.1016/j.ijhcs.2022.102848
[4]
Kvedar, Joseph (25 August 2016). "It's time to break free of the traditional paradigms of disease management". Med City News. Retrieved 19 October 2016.
[5]
Almathami, H. K. Y., Win, K. T., & Vlahu-Gjorgievska, E. (2020). Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients’ homes: systematic literature review. Journal of medical Internet research, 22(2), e16407. Feb. 2020. https://doi.org/10.2196/16407
[6]
Zhang, X., Guo, X., Lai, K. H., & Yi, W. (2019). How does online interactional unfairness matter for patient–doctor relationship quality in online health consultation? The contingencies of professional seniority and disease severity. European Journal of Information Systems, 28(3), 336-354. Nov. 2019. https://doi.org/10.1080/0960085X.2018.1547354
[7]
Hartasanchez, S. A., Heen, A. F., Kunneman, M., García-Bautista, A., Hargraves, I. G., Prokop, L. J., ... & Montori, V. M. (2021). Remote shared decision making through telemedicine: a systematic review of the literature. Patient Education and Counseling. June. 2021. https://doi.org/10.1016/J.PEC.2021.06.012
[8]
Chang, Y. W., Hsu, P. Y., Wang, Y., & Chang, P. Y. (2019). Integration of online and offline health services: The role of doctor-patient online interaction. Patient Education and Counseling, 102(10), 1905-1910. Oct. 2019. https://doi.org/10.1016/j.pec.2019.04.018
[9]
Murphy, R. R. (2022). Would you trust an intelligent robot?. Science Robotics, 7(69), eade0862.
[10]
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., ... & Herrera, F. (2020). Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information fusion, 58, 82-115.
[11]
PingAn healthcare. (2021). PINGAN Healthcare and Technology Company Limited 2021 Interrim Results Release. Retrieved on May 2022 from http://www.pagd.net/media/pdf/cn/2021/2021IR_CN.PDF.
[12]
Hixon, Todd (9 December 2015). "Digital Therapeutics Have Huge Promise And They Are Real Today". Forbes. Retrieved 19 October 2016.
[13]
Yang, H., Guo, X., & Wu, T. (2015). Exploring the influence of the online physician service delivery process on patient satisfaction. Decision Support Systems, 78, 113-121. Oct. 2015. https://doi.org/10.1016/j.dss.2015.05.006
[14]
Wan, Y., Zhang, Y., & Yan, M. (2020). What influences patients' willingness to choose in online health consultation? An empirical study with PLS–SEM. Industrial Management & Data Systems, 120(12), 2423-2446. Dec. 2020. https://doi.org/10.1108/IMDS-11-2019-0633
[15]
Berrouiguet, S., Barrigón, M. L., Castroman, J. L., Courtet, P., Artés-Rodríguez, A., & Baca-García, E. (2019). Combining mobile-health (mHealth) and artificial intelligence (AI) methods to avoid suicide attempts: the Smartcrises study protocol. BMC psychiatry, 19(1), 1-9.
[16]
Baldauf, M., Fröehlich, P., & Endl, R. (2020, November). Trust me, I'ma doctor–user perceptions of AI-driven apps for mobile health diagnosis. In Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia (pp. 167-178).
[17]
Su, Z., Figueiredo, M. C., Jo, J., Zheng, K., & Chen, Y. (2020). Analyzing description, user understanding and expectations of AI in mobile health applications. In AMIA Annual Symposium Proceedings (Vol. 2020, p. 1170). American Medical Informatics Association.
[18]
Deniz-Garcia, A., Fabelo, H., Rodriguez-Almeida, A. J., Zamora-Zamorano, G., Castro-Fernandez, M., Alberiche Ruano, M. D. P., ... & WARIFA Consortium. (2023). Quality, Usability, and Effectiveness of mHealth Apps and the Role of Artificial Intelligence: Current Scenario and Challenges. Journal of Medical Internet Research, 25, e44030.
[19]
Mora, A., González, C., Arnedo-Moreno, J., & Álvarez, A. (2016, September). Gamification of cognitive training: a crowdsourcing-inspired approach for older adults. In Proceedings of the XVII international conference on human computer interaction (pp. 1-8).
[20]
Zheng, K., Padman, R., Johnson, M. P., & Diamond, H. S. (2009). An interface-driven analysis of user interactions with an electronic health records system. Journal of the American Medical Informatics Association, 16(2), 228-237.
[21]
Yu, N., & Huang, Y. T. (2020). Important factors affecting user experience design and satisfaction of a mobile health app—a case study of daily yoga app. International Journal of Environmental Research and Public Health, 17(19), 6967.
[22]
Parker EB, Short J, Williams E, Christie B. The social psychology of telecommunications. Contemp Sociol 1978 Jan;7(1):32.
[23]
Chen L, Zhang D, Hou M. The Influence of Perceived Social Presence on the Willingness to Communicate in Mobile Medical Consultations: Experimental Study[J]. Journal of Medical Internet Research, 2022, 24(5): e31797.
[24]
Pongpaew W, Speece M, Tiangsoongnern L. Social presence and customer brand engagement on Facebook brand pages[J]. Journal of Product & Brand Management, 2017.
[25]
Attar R W, Amidi A, Hajli N. The role of social presence and trust on customer loyalty[J]. British Food Journal, 2022.
[26]
Hassanein, K., & Head, M. (2007). Manipulating perceived social presence through the web interface and its impact on attitude towards online shopping. International journal of human-computer studies, 65(8), 689-708.
[27]
Guo, X. T., Zhang, X. F., & Sun, Y. Q. (2016). The privacy-personalization paradox in mHealth services acceptance of different age groups. Electronic Commerce Research and Applications, 16, 55–65.
[28]
Schnall R, Higgins T, Brown W, Trust, perceived risk, perceived ease of use and perceived usefulness as factors related to mHealth technology use[J]. Studies in health technology and informatics, 2015, 216: 467.
[29]
Yang, M., Yuan, F., & Jiang, J. (2020). When Does Trust Reinforce Intentions to Upgrade to Paid Online Healthcare Consultations? The Valence of Platform-Versus Service-Related Attitudes. PACIS 2020 Proceedings., 11
[30]
Interface and emotions: Exploring the interface dimensions and emotional processes to Interface Design Andreia Pinto de Sousa1 [0000-0001-8070-8970], Ana Margarida Pisco Almeida2 [0000-0002-7349-457X]
[31]
Hawlitschek, F., Jansen, L. E., Lux, E., Teubner, T., & Weinhardt, C. (2016, January). Colors and trust: The influence of user interface design on trust and reciprocity. In 2016 49th Hawaii International Conference on System Sciences (HICSS) (pp. 590-599). IEEE.
[32]
Egger, F. N. (2000, April). " Trust me, I'm an online vendor" towards a model of trust for e-commerce system design. In CHI'00 extended abstracts on Human factors in computing systems (pp. 101-102).
[33]
Wong, B. L. W., & Blandford, A. E. (2002). Analysing ambulance dispatcher decision making: Trailing emergent themes analysis. Proceedings of the joint conference of the computer human interaction special interest group and the ergonomics society of Australia HF2002, Publish: Factors 2002.
[34]
Sun, X., Sharples, S., & Makri, S. (2011). A user-centred mobile diary study approach to understanding serendipity in information research. Information Research, 16(3), 492–493.
[35]
Cyr D, Kindra G S, Dash S. Web site design, trust, satisfaction and e‐loyalty: the Indian experience[J]. Online Information Review, 2008.
[36]
Dong, X.L., Gabrilovich, E., Murphy, K., Dang, V., Horn, W., Lugaresi, C., Sun, S. and Zhang, W., 2015. Knowledge-based trust: Estimating the trustworthiness of web sources. arXiv preprint arXiv:1502.03519.
[37]
Naiseh M, Al-Thani D, Jiang N, How the different explanation classes impact trust calibration: The case of clinical decision support systems[J]. International Journal of Human-Computer Studies, 2023, 169: 102941.
[38]
Baozhou Lu, Weiguo Fan and Mi Zhou. 2016. Social presence, trust, and social commerce purchase intention: An empirical research. Computers in Human Behavior, 56 (March 2016), 225-237. https://doi.org/10.1016/j.chb.2015.11.057
[39]
David Gefen and Detmar W. Straub. 2004. Consumer Trust in B2C E-Commerce and the Importance of Social Presence: Experiments in E-Products and E-Services. Omega 32, 6 (December 2004), 407-424. https://doi.org/10.1016/j.omega.2004.01.006
[40]
D. Harrison McKnight, Vivek Choudhury, Charles Kacmar, (2002) Developing and Validating Trust Measures for e-Commerce: An Integrative Typology. Information Systems Research 13(3):334-359. http://dx.doi.org/10.1287/isre.13.3.334.81
[41]
Riek, L. D. (2012). Wizard of oz studies in hri: a systematic review and new reporting guidelines. Journal of Human-Robot Interaction, 1(1), 119-136.
[42]
Protopie. Retrieved on 26th December 2022 from https://www.protopie.io
[43]
Xuan Wang and Tao Huang. 2021. Study on characteristics of patients and agent consultation in online healthcare consultation: A case study of dxy. Com. Chinese Journal of Health Policy 14, 9 (September 2021), 54-61. https://doi.org/10.3969/j.issn.1674-2982.2021.09.009
[44]
Zimmerman, D. W., & Zumbo, B. D. (1993). Relative power of the Wilcoxon test, the Friedman test, and repeated-measures ANOVA on ranks. The Journal of Experimental Education, 62(1), 75-86.
[45]
Floridi, L., & Chiriatti, M. (2020). GPT-3: Its nature, scope, limits, and consequences. Minds and Machines, 30, 681-694.
[46]
Gong, Y., Wang, H., Xia, Q., Zheng, L., & Shi, Y. (2021). Factors that determine a patient's willingness to physician selection in online healthcare communities: a trust theory perspective. Technology in Society, 64(37), 101510.
[47]
Trowbridge, R.E. and Pearson, R. (2013), “Impact of military physician rank and appearance on patient perceptions of clinical competency in a primary care setting”, Military Medicine, Vol. 178 No. 9, pp. 994-1001.
[48]
Katharina Weitz, Dominik Schiller, Ruben Schlagowski, Tobias Huber, and Elisabeth André. 2019. "Do You Trust Me?": Increasing User-Trust by Integrating Virtual Agents in Explainable AI Interaction Design. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents (Paris, France) (IVA ’19).
[49]
Gupta, A., Basu, D., Ghantasala, R., Qiu, S. and Gadiraju, U., 2022, April. To Trust or Not To Trust: How a Conversational Interface Affects Trust in a Decision Support System. In Proceedings of the ACM Web Conference 2022 (pp. 3531-3540).
[50]
Proto.io. (2017, March 29). How Form and Function Play into the Rise of Good Design. Theuxblog. Retrieved August 15, 2022, from https://medium.theuxblog.com/how-form-and-function-play-into-the-rise-of-good-design-88503c206f97
[51]
Greenough, H. (1969). Form and Function: Remarks on Art, Design, and Architecture. University of California Press.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobileHCI '23 Companion: Proceedings of the 25th International Conference on Mobile Human-Computer Interaction
September 2023
256 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2023

Check for updates

Qualifiers

  • Extended-abstract
  • Research
  • Refereed limited

Funding Sources

  • Shuangchuang Programme of Jiangsu Province

Conference

MobileHCI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 174
    Total Downloads
  • Downloads (Last 12 months)156
  • Downloads (Last 6 weeks)13
Reflects downloads up to 22 Oct 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media