skip to main content
research-article

Solving Separation-of-Concerns Problems in Collaborative Design of Human-AI Systems through Leaky Abstractions

Published: 29 April 2022 Publication History

Abstract

In conventional software development, user experience (UX) designers and engineers collaborate through separation of concerns (SoC): designers create human interface specifications, and engineers build to those specifications. However, we argue that Human-AI systems thwart SoC because human needs must shape the design of the AI interface, the underlying AI sub-components, and training data. How do designers and engineers currently collaborate on AI and UX design? To find out, we interviewed 21 industry professionals (UX researchers, AI engineers, data scientists, and managers) across 14 organizations about their collaborative work practices and associated challenges. We find that hidden information encapsulated by SoC challenges collaboration across design and engineering concerns. Practitioners describe inventing ad-hoc representations exposing low-level design and implementation details (which we characterize as leaky abstractions) to “puncture” SoC and share information across expertise boundaries. We identify how leaky abstractions are employed to collaborate at the AI-UX boundary and formalize a process of creating and using leaky abstractions.

Supplementary Material

Supplemental Materials (3491102.3517537-supplemental-materials.zip)
MP4 File (3491102.3517537-talk-video.mp4)
Talk Video

References

[1]
Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. In International Conference on Machine Learning. PMLR, 60–69.
[2]
Philip Agre and Philip E Agre. 1997. Computation and human experience. Cambridge University Press.
[3]
Deloitte AI. 2019. Deloitte Insights. https://www2.deloitte.com/us/en/insights/deloitte-insights-magazine.html
[4]
Saleema Amershi. 2019. Guidelines for human-AI interaction design. https://www.microsoft.com/en-us/research/blog/guidelines-for-human-ai-interaction-design/
[5]
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLine, Harald Gall, Ece Kamar, Nachiappan Nagappan, Besmira Nushi, and Thomas Zimmermann. 2019. Software engineering for machine learning: a case study. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice. IEEE Press, 291–300.
[6]
Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the people: The role of humans in interactive machine learning. Ai Magazine 35, 4 (2014), 105–120.
[7]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 3.
[8]
Anders Arpteg, Björn Brinne, Luka Crnkovic-Friis, and Jan Bosch. 2018. Software engineering challenges of deep learning. In 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 50–59.
[9]
Rob Ashmore, Radu Calinescu, and Colin Paterson. 2021. Assuring the machine learning lifecycle: Desiderata, methods, and challenges. ACM Computing Surveys (CSUR) 54, 5 (2021), 1–39.
[10]
Jan Auernhammer. 2020. Human-centered AI: The role of Human-centered Design Research in the development of AI. (2020).
[11]
Julie Baca, Daniel Carruth, Elijah Davis, and Daniel Waddell. 2018. Merging the Cultures of Design and Engineering: A Case Study. In International Conference of Design, User Experience, and Usability. Springer, 628–641.
[12]
Balsamiq. 2021. balsamiq. https://balsamiq.com/
[13]
Thierry Bardini. 2000. Bootstrapping: Douglas Engelbart, coevolution, and the origins of personal computing. Stanford University Press.
[14]
Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, Duncan Wadsworth, and Hanna Wallach. 2021. Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs. arXiv preprint arXiv:2103.06076(2021).
[15]
Eric PS Baumer. 2017. Toward human-centered algorithm design. Big Data & Society 4, 2 (2017), 2053951717718854.
[16]
Michel Beaudouin-Lafon and Wendy E Mackay. 2009. Prototyping tools and techniques. In Human-Computer Interaction. CRC Press, 137–160.
[17]
Melanie Birks, Ysanne Chapman, and Karen Francis. 2008. Memoing in qualitative research: Probing data and processes. Journal of research in nursing 13, 1 (2008), 68–75.
[18]
Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77–91.
[19]
Carrie J Cai and Philip J Guo. 2019. Software developers learning machine learning: Motivations, hurdles, and desires. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), VL/HCC, Vol. 19.
[20]
Paul R Carlile. 2002. A pragmatic view of knowledge and boundaries: Boundary objects in new product development. Organization science 13, 4 (2002), 442–455.
[21]
Marcelo Cataldo and James D Herbsleb. 2010. Architecting in software ecosystems: interface translucence as an enabler for scalable collaboration. In Proceedings of the Fourth European Conference on Software Architecture: Companion Volume. ACM, 65–72.
[22]
M Ceconello, D Spallazzo, and M Sciannamè. 2019. Design and AI: prospects for dialogue. (2019).
[23]
Herbert H Clark and Susan E Brennan. 1991. Grounding in communication.(1991).
[24]
Melvin E Conway. 1968. How do committees invent. Datamation 14, 4 (1968), 28–31.
[25]
Eric Corbett, Nathaniel Saul, and Meg Pirrung. [n.d.]. Interactive Machine Learning Heuristics. ([n. d.]).
[26]
Design Council. 2005. The ‘double diamond’design process model. Design Council (2005).
[27]
Cleidson RB de Souza, David Redmiles, Li-Te Cheng, David Millen, and John Patterson. 2004. Sometimes you need to see through walls: a field study of application programming interfaces. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. ACM, 63–71.
[28]
Dominik Dellermann, Adrian Calma, Nikolaus Lipusch, Thorsten Weber, Sascha Weigel, and Philipp Ebel. 2019. The future of human-ai collaboration: a taxonomy of design knowledge for hybrid intelligence systems. (2019).
[29]
Norman K Denzin and Yvonna S Lincoln. 2011. The Sage handbook of qualitative research. sage.
[30]
Virginia Dignum. 2017. Responsible artificial intelligence: designing AI for human values. (2017).
[31]
Edsger W Dijkstra. 1972. The humble programmer. Commun. ACM 15, 10 (1972), 859–866.
[32]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. Ux design innovation: Challenges for working with machine learning as a design material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 278–288.
[33]
Maria R Ebling. 1998. Translucent cache management for mobile computing. Technical Report. CARNEGIE-MELLON UNIV PITTSBURGH PA SCHOOL OF COMPUTER SCIENCE.
[34]
Boris Ewenstein and Jennifer Whyte. 2009. Knowledge practices in design: the role of visual representations asepistemic objects’. Organization studies 30, 1 (2009), 07–30.
[35]
Gerhard Fischer. 2000. Symmetry of ignorance, social creativity, and meta-design. Knowledge-Based Systems 13, 7-8 (2000), 527–537.
[36]
David Flink. 2020. The Wire: Your AI-Powered ‘To Do’ list. https://people.ai/blog/the-wire-your-ai-powered-to-do-list/
[37]
Iason Gabriel. 2020. Artificial intelligence, values, and alignment. Minds and Machines 30, 3 (2020), 411–437.
[38]
Cristina B Gibson. 2001. From knowledge accumulation to accommodation: Cycles of collective cognition in work groups. Journal of Organizational Behavior: The International Journal of Industrial, Occupational and Organizational Psychology and Behavior 22, 2(2001), 121–134.
[39]
Google. 2019. People + AI Guidebook. https://pair.withgoogle.com/
[40]
Jonathan Grudin. 2017. From tool to partner: The evolution of human-computer interaction. Synthesis Lectures on Human-Centered Interaction 10, 1(2017), i–183.
[41]
Raymonde Guindon, Herb Krasner, Bill Curtis, 1987. Breakdowns and processes during the early activities of software design by professionals. In Empirical studies of programmers: Second Workshop. 65–82.
[42]
Joseph M Hellerstein, Vikram Sreekanti, Joseph E Gonzalez, James Dalton, Akon Dey, Sreyashi Nag, Krishna Ramachandran, Sudhanshu Arora, Arka Bhattacharyya, Shirshanka Das, 2017. Ground: A Data Context Service. In CIDR.
[43]
Karey Helms. 2017. Leaky Objects: Implicit Information, Unintentional Communication. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems. ACM, 182–186.
[44]
Karey Helms, Barry Brown, Magnus Sahlgren, and Airi Lampinen. 2018. Design Methods to Investigate User Experiences of Artificial Intelligence. In 2018 AAAI Spring Symposium Series.
[45]
Michi Henning. 2007. API design matters. Queue 5, 4 (2007), 24–36.
[46]
Alex Hern. 2020. Twitter apologises for ’racist’ image-cropping algorithm.
[47]
Charles Hill, Rachel Bellamy, Thomas Erickson, and Margaret Burnett. 2016. Trials and tribulations of developers of intelligent systems: A field study. In 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 162–170.
[48]
Akimitsu Hirota, Masaaki Takemura, and Manabu Mizuno. 2017. Design prototyping in” fuzzy front end” of product development-Rapid prototyping at the stage of high uncertainty. In ISPIM Innovation Symposium. The International Society for Professional Innovation Management (ISPIM), 1–14.
[49]
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miro Dudik, and Hanna Wallach. 2019. Improving fairness in machine learning systems: What do industry practitioners need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–16.
[50]
Thomas L Huber, Maike AE Winkler, Jens Dibbern, and Carol V Brown. 2020. The use of prototypes to bridge knowledge boundaries in agile software development. Information systems journal 30, 2 (2020), 270–294.
[51]
Apple Inc.2019. Designing the UI and User Experience of a Machine Learning App. https://developer.apple.com/design/human-interface-guidelines/machine-learning/overview/introduction/
[52]
Claire Kayacik, Sherol Chen, Signe Noerly, Jess Holbrook, Adam Roberts, and Douglas Eck. 2019. Identifying the intersections: User experience+ research scientist collaboration in a generative machine learning interface. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, CS09.
[53]
Zack Kertcher and Erica Coslor. 2018. Boundary objects and the technical culture divide: successful practices for voluntary innovation teams crossing scientific and professional fields. Journal of Management Inquiry(2018), 1056492618783875.
[54]
Rafal Kocielnik, Saleema Amershi, and Paul N Bennett. 2019. Will You Accept an Imperfect AI?: Exploring Designs for Adjusting End-user Expectations of AI Systems. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 411.
[55]
Charlotte P Lee. 2005. Between chaos and routine: Boundary negotiating artifacts in collaboration. In ECSCW 2005. Springer, 387–406.
[56]
Charlotte P Lee. 2007. Boundary negotiating artifacts: Unbinding the routine of boundary objects and embracing chaos in collaborative work. Computer Supported Cooperative Work (CSCW) 16, 3 (2007), 307–339.
[57]
Susan Leigh Star. 2010. This is not a boundary object: Reflections on the origin of a concept. Science, Technology, & Human Values 35, 5 (2010), 601–617.
[58]
Nancy G Leveson. 2000. Intent specifications: An approach to building human-centered specifications. IEEE Transactions on software engineering 26, 1 (2000), 15–35.
[59]
Josh Lovejoy. 2019. Human-centered AI Cheat-sheet. https://uxdesign.cc/human-centered-ai-cheat-sheet-1da130ba1bab
[60]
Percival Lucena, Alan Braz, Adilson Chicoria, and Leonardo Tizzei. 2016. IBM design thinking software development framework. In Brazilian Workshop on Agile Methods. Springer, 98–109.
[61]
Lucy Ellen Lwakatare, Aiswarya Raj, Jan Bosch, Helena Holmström Olsson, and Ivica Crnkovic. 2019. A taxonomy of software engineering challenges for machine learning systems: An empirical investigation. In International Conference on Agile Software Development. Springer, 227–243.
[62]
Ryan Mac. 2021. Facebook Apologizes After A.I. Puts ‘Primates’ Label on Video of Black Men. https://www.nytimes.com/2021/09/03/technology/facebook-ai-race-primates.html
[63]
Michael Madaio, Lisa Egede, Hariharan Subramonyam, Jennifer Wortman Vaughan, and Hanna Wallach. 2022. Assessing the Fairness of AI Systems: AI Practitioners’ Processes, Challenges, and Needs for Support. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1(2022).
[64]
Michael A Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-designing checklists to understand organizational challenges and opportunities around fairness in ai. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[65]
Martin Maguire and Nigel Bevan. 2002. User requirements analysis. In IFIP World Computer Congress, TC 13. Springer, 133–148.
[66]
Ann Majchrzak, Philip HB More, and Samer Faraj. 2012. Transcending knowledge differences in cross-functional teams. Organization Science 23, 4 (2012), 951–970.
[67]
Christopher Manning. 2020. Artificial Intelligence Definitions.
[68]
Yaoli Mao, Dakuo Wang, Michael Muller, Kush R Varshney, Ioana Baldini, Casey Dugan, and Aleksandra Mojsilović. 2019. How Data ScientistsWork Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?Proceedings of the ACM on Human-Computer Interaction 3, GROUP(2019), 1–23.
[69]
Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-Rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 72 (Nov. 2019), 23 pages. https://doi.org/10.1145/3359174
[70]
Microsoft. 2021. Azure AI - Make artificial intelligence (AI) real for your business today. https://azure.microsoft.com/en-us/overview/ai-platform/
[71]
Shakir Mohamed, Marie-Therese Png, and William Isaac. 2020. Decolonial AI: Decolonial theory as sociotechnical foresight in artificial intelligence. Philosophy & Technology 33, 4 (2020), 659–684.
[72]
Michael Muller, Melanie Feinberg, Timothy George, Steven J Jackson, Bonnie E John, Mary Beth Kery, and Samir Passi. 2019. Human-centered study of data science work practices. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8.
[73]
Michael Muller, Ingrid Lange, Dakuo Wang, David Piorkowski, Jason Tsay, Q Vera Liao, Casey Dugan, and Thomas Erickson. 2019. How data science workers work with data: Discovery, capture, curation, design, creation. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–15.
[74]
Donald A Norman and Stephen W Draper. 1986. User centered system design: New perspectives on human-computer interaction. CRC Press.
[75]
John Ousterhout. 2018. A Philosophy of Software Design. Yaknyam Press.
[76]
David Lorge Parnas. 1972. On the criteria to be used in decomposing systems into modules. Commun. ACM 15, 12 (1972), 1053–1058.
[77]
Kayur Patel. 2010. Lowering the barrier to applying machine learning. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology. 355–358.
[78]
Leonard Przybilla, Maximilian Schreieck, Kai Klinker, Christoph Pflügler, Manuel Wiesche, and Helmut Krcmar. 2018. Combining Design Thinking and Agile Development to Master Highly Innovative IT Projects. Projektmanagement und Vorgehensmodelle 2018-Der Einfluss der Digitalisierung auf Projektmanagementmethoden und Entwicklungsprozesse (2018).
[79]
Mark O Riedl. 2019. Human-centered artificial intelligence and machine learning. Human Behavior and Emerging Technologies 1, 1 (2019), 33–36.
[80]
Stuart Russell, Daniel Dewey, and Max Tegmark. 2015. Research priorities for robust and beneficial artificial intelligence. Ai Magazine 36, 4 (2015), 105–114.
[81]
Tobias Schnabel, Paul N Bennett, and Thorsten Joachims. 2018. Improving Recommender Systems Beyond the Algorithm. arXiv preprint arXiv:1802.07578(2018).
[82]
David Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Francois Crespo, and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In Advances in neural information processing systems. 2503–2511.
[83]
Raymond Scupin. 1997. The KJ method: A technique for analyzing data derived from Japanese ethnology. Human organization (1997), 233–237.
[84]
Ahmed Seffah, Jan Gulliksen, and Michel C Desmarais. 2005. Human-centered software engineering-integrating usability in the software development lifecycle. Vol. 8. Springer Science & Business Media.
[85]
Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019. Fairness and Abstraction in Sociotechnical Systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* ’19). Association for Computing Machinery, New York, NY, USA, 59–68. https://doi.org/10.1145/3287560.3287598
[86]
Ben Shneiderman. 2020. Human-centered artificial intelligence: Reliable, safe & trustworthy. International Journal of Human–Computer Interaction 36, 6(2020), 495–504.
[87]
Jared M. Spool. 2013. APIs: The Future Is Now. https://articles.uie.com/api_future/
[88]
Robert Stalnaker. 2002. Common ground. Linguistics and philosophy 25, 5/6 (2002), 701–721.
[89]
Susan Leigh Star. 1989. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. In Distributed artificial intelligence. Elsevier, 37–54.
[90]
Luke Stark. 2019. Facial recognition is the plutonium of AI. XRDS: Crossroads, The ACM Magazine for Students 25, 3 (2019), 50–55.
[91]
Anselm Strauss and Juliet Corbin. 1990. Basics of qualitative research. Sage publications.
[92]
Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces. In 26th International Conference on Intelligent User Interfaces. 48–58.
[93]
Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. Towards A Process Model for Co-Creating AI Experiences. (2021), 1529–1543. https://doi.org/10.1145/3461778.3462012
[94]
Willemien Visser. [n.d.]. The cognitive artifacts of designing. CRC Press.
[95]
Eric Von Hippel. 1994. “Sticky information” and the locus of problem solving: implications for innovation. Management science 40, 4 (1994), 429–439.
[96]
Maike AE Winkler, Carol Brown, and Thomas L Huber. 2015. Recurrent Knowledge Boundaries in Outsourced Software Projects: A Longitudinal Study. In ECIS.
[97]
Wei Xu. 2019. Toward human-centered AI: a perspective from human-computer interaction. Interactions 26, 4 (2019), 42–46.
[98]
Qian Yang. 2017. The role of design in creating machine-learning-enhanced user experience. In 2017 AAAI Spring Symposium Series.
[99]
Qian Yang. 2018. Machine Learning as a UX Design Material: How Can We Imagine Beyond Automation, Recommenders, and Reminders?. In 2018 AAAI Spring Symposium Series.
[100]
Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi T Iqbal, and Jaime Teevan. 2019. Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 185.
[101]
Qian Yang, Alex Scuito, John Zimmerman, Jodi Forlizzi, and Aaron Steinfeld. 2018. Investigating how experienced UX designers effectively work with machine learning. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, 585–596.
[102]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. In Proceedings of the 2020 chi conference on human factors in computing systems. 1–13.
[103]
Qian Yang, Aaron Steinfeld, and John Zimmerman. [n.d.]. Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. ([n. d.]).
[104]
Amy X Zhang, Michael Muller, and Dakuo Wang. 2020. How do data science workers collaborate? roles, workflows, and tools. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1(2020), 1–23.

Cited By

View all
  • (2024)Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge baseComputing and Artificial Intelligence10.59400/cai.v2i1.5352:1(535)Online publication date: 19-Apr-2024
  • (2024)AI-Powered Innovation in Digital Transformation: Key Pillars and Industry ImpactSustainability10.3390/su1605179016:5(1790)Online publication date: 22-Feb-2024
  • (2024)UX Matters: The Critical Role of UX in Responsible AIInteractions10.1145/366550431:4(22-27)Online publication date: 26-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
10459 pages
ISBN:9781450391573
DOI:10.1145/3491102
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AI applications
  2. Human-AI systems
  3. Industry practices
  4. UX design
  5. design processes

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)346
  • Downloads (Last 6 weeks)43
Reflects downloads up to 22 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge baseComputing and Artificial Intelligence10.59400/cai.v2i1.5352:1(535)Online publication date: 19-Apr-2024
  • (2024)AI-Powered Innovation in Digital Transformation: Key Pillars and Industry ImpactSustainability10.3390/su1605179016:5(1790)Online publication date: 22-Feb-2024
  • (2024)UX Matters: The Critical Role of UX in Responsible AIInteractions10.1145/366550431:4(22-27)Online publication date: 26-Jun-2024
  • (2024)Tinker, Tailor, Configure, Customize: The Articulation Work of Contextualizing an AI Fairness ChecklistProceedings of the ACM on Human-Computer Interaction10.1145/36537058:CSCW1(1-20)Online publication date: 26-Apr-2024
  • (2024)AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and ClientsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661577(728-742)Online publication date: 1-Jul-2024
  • (2024)Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in EducationProceedings of the ACM on Human-Computer Interaction10.1145/36373588:CSCW1(1-32)Online publication date: 26-Apr-2024
  • (2024)Leveraging Large Language Models to Enhance Domain Expert Inclusion in Data Science WorkflowsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651115(1-11)Online publication date: 11-May-2024
  • (2024)Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642754(1-19)Online publication date: 11-May-2024
  • (2024)``It Is a Moving Process": Understanding the Evolution of Explainability Needs of Clinicians in Pulmonary MedicineProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642551(1-21)Online publication date: 11-May-2024
  • (2024)Towards a Non-Ideal Methodological Framework for Responsible MLProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642501(1-17)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media