research-article

Hacking, Switching, Combining: Understanding and Supporting DIY Assistive Technology Design by Blind People

Authors:

Jaylin Herskovitz,

Anhong GuoAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 57, Pages 1 - 17

https://doi.org/10.1145/3544548.3581249

Published: 19 April 2023 Publication History

Abstract

Existing assistive technologies (AT) often fail to support the unique needs of blind and visually impaired (BVI) people. Thus, BVI people have become domain experts in customizing and ‘hacking’ AT, creatively suiting their needs. We aim to understand this behavior in depth, and how BVI people envision creating future DIY personalized AT. We conducted a multi-part qualitative study with 12 blind participants: an interview on unique uses of AT, a two-week diary study to log use cases, and a scenario-based design session to imagine creating future technologies. We found that participants work to design new AT both implicitly through creative use cases, and explicitly through regular ideation and development. Participants envisioned creating a variety of new technologies, and we summarize expected benefits and concerns of using a DIY technology approach. From our results, we present design considerations for future DIY technology systems to support existing customization and ‘hacking’ behaviors.

Supplementary Material

MP4 File (3544548.3581249-video-preview.mp4)

Video Preview

Download
1.06 MB

MP4 File (3544548.3581249-talk-video.mp4)

Pre-recorded Video Presentation

Download
21.03 MB

MP4 File (3544548.3581249-video-figure.mp4)

Video Figure

Download
11.83 MB

References

[1]

Ali Abdolrahmani, William Easley, Michele Williams, Stacy Branham, and Amy Hurst. 2017. Embracing Errors: Examining How Context of Use Impacts Blind Individuals’ Acceptance of Navigation Aid Errors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 4158��4169. https://doi.org/10.1145/3025453.3025528

Digital Library

[2]

Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: A Navigational Cognitive Assistant for the Blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services(Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 90–99. https://doi.org/10.1145/2935334.2935361

Digital Library

[3]

Taslima Akter, Bryan Dosono, Tousif Ahmed, Apu Kapadia, and Bryan Semaan. 2020. “I am uncomfortable sharing what I can’t see”: Privacy Concerns of the Visually Impaired with Camera Based Assistive Applications. In 29th USENIX Security Symposium (USENIX Security 20). 1929–1948.

[4]

Khaled Albusays, Stephanie Ludi, and Matt Huenerfauth. 2017. Interviews and Observation of Blind Software Developers at Work to Understand Code Navigation Challenges. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 91–100. https://doi.org/10.1145/3132525.3132550

Digital Library

[5]

Apple. 2022. Create ML. https://developer.apple.com/machine-learning/create-ml/

[6]

Apple. 2022. Shortcuts User Guide. https://support.apple.com/guide/shortcuts/welcome/ios

[7]

Ameer Armaly, Paige Rodeghero, and Collin McMillan. 2017. A Comparison of Program Comprehension Strategies by Blind and Sighted Programmers. IEEE Transactions on Software Engineering(2017).

[8]

Mauro Avila, Katrin Wolf, Anke Brock, and Niels Henze. 2016. Remote Assistance for Blind Users in Daily Life: A Survey about Be My Eyes. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, Corfu Island Greece, 1–2. https://doi.org/10.1145/2910674.2935839

Digital Library

[9]

Mauro Avila, Katrin Wolf, Anke Brock, and Niels Henze. 2016. Remote assistance for blind users in daily life: A survey about be my eyes. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 1–2.

Digital Library

[10]

Catherine M. Baker, Lauren R. Milne, and Richard E. Ladner. 2015. StructJumper: A Tool to Help Blind Programmers Navigate and Understand the Structure of Code. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 3043–3052. https://doi.org/10.1145/2702123.2702589

Digital Library

[11]

Catherine M Baker, Lauren R Milne, and Richard E Ladner. 2015. Structjumper: A Tool to Help Blind Programmers Navigate and Understand the Structure of Code.

Digital Library

[12]

Cynthia L. Bennett, Erin Brady, and Stacy M. Branham. 2018. Interdependence as a Frame for Assistive Technology Research and Design. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Galway Ireland, 161–173. https://doi.org/10.1145/3234695.3236348

Digital Library

[13]

Cynthia L Bennett, Cole Gleason, Morgan Klaus Scheuerman, Jeffrey P Bigham, Anhong Guo, and Alexandra To. 2021. “It’s Complicated”: Negotiating Accessibility and (Mis) Representation in Image Descriptions of Race, Gender, and Disability. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–19.

Digital Library

[14]

Cynthia L. Bennett, Daniela K. Rosner, and Alex S. Taylor. 2020. The Care Work of Access. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376568

Digital Library

[15]

Cynthia L. Bennett, Abigale Stangl, Alexa F. Siu, and Joshua A. Miele. 2019. Making Nonvisually: Lessons from the Field. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Pittsburgh PA USA, 279–285. https://doi.org/10.1145/3308561.3355619

Digital Library

[16]

Michael S. Bernstein, Jaime Teevan, Susan Dumais, Daniel Liebling, and Eric Horvitz. 2012. Direct answers for search queries in the long tail. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin Texas USA, 237–246. https://doi.org/10.1145/2207676.2207710

Digital Library

[17]

Jeffrey P. Bigham, Jeremy T. Brudvik, and Bernie Zhang. 2010. Accessibility by demonstration: enabling end users to guide developers to web accessibility solutions. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility(ASSETS ’10). Association for Computing Machinery, New York, NY, USA, 35–42. https://doi.org/10.1145/1878803.1878812

Digital Library

[18]

Jeffrey P Bigham and Patrick Carrington. 2018. Learning from the front: People with disabilities as early adopters of AI. Proceedings of the 2018 HCIC Human-Computer Interaction Consortium (2018).

[19]

Jeffrey P. Bigham, Anna C. Cavender, Jeremy T. Brudvik, Jacob O. Wobbrock, and Richard E. Ladner. 2007. WebinSitu: a comparative analysis of blind and sighted browsing behavior. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility(Assets ’07). Association for Computing Machinery, New York, NY, USA, 51–58. https://doi.org/10.1145/1296843.1296854

Digital Library

[20]

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology(UIST ’10). Association for Computing Machinery, New York, NY, USA, 333–342. https://doi.org/10.1145/1866029.1866080

Digital Library

[21]

Jeffrey P. Bigham and Richard E. Ladner. 2007. Accessmonkey: a collaborative scripting framework for web users and developers. In Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)(W4A ’07). Association for Computing Machinery, New York, NY, USA, 25–34. https://doi.org/10.1145/1243441.1243452

Digital Library

[22]

Jeffrey P. Bigham, Richard E. Ladner, and Yevgen Borodin. 2011. The design of human-powered access technology. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility(ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 3–10. https://doi.org/10.1145/2049536.2049540

Digital Library

[23]

Nilton Bila, Troy Ronda, Iqbal Mohomed, Khai N Truong, and Eyal De Lara. 2007. Pagetailor: reusable end-user customization for the mobile web. In Proceedings of the 5th international conference on Mobile systems, applications and services. 16–29.

Digital Library

[24]

Syed Masum Billah, Vikas Ashok, Donald E. Porter, and I.V. Ramakrishnan. 2017. Ubiquitous Accessibility for People with Visual Impairments: Are We There Yet?. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 5862–5868. https://doi.org/10.1145/3025453.3025731

Digital Library

[25]

BlindSquare. 2022. BlindSquare. https://www.blindsquare.com/

[26]

Michael Bolin, Matthew Webber, Philip Rha, Tom Wilson, and Robert C. Miller. 2005. Automation and customization of rendered web pages. In Proceedings of the 18th annual ACM symposium on User interface software and technology(UIST ’05). Association for Computing Machinery, New York, NY, USA, 163–172. https://doi.org/10.1145/1095034.1095062

Digital Library

[27]

Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, and Jeffrey P. Bigham. 2013. Visual challenges in the everyday lives of blind people. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Paris France, 2117–2126. https://doi.org/10.1145/2470654.2481291

Digital Library

[28]

Danielle Bragg, Nicholas Huynh, and Richard E. Ladner. 2016. A Personalizable Mobile Sound Detector App Design for Deaf and Hard-of-Hearing Users. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’16). Association for Computing Machinery, New York, NY, USA, 3–13. https://doi.org/10.1145/2982142.2982171

Digital Library

[29]

Stacy M. Branham and Shaun K. Kane. 2015. Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 2373–2382. https://doi.org/10.1145/2702123.2702511

Digital Library

[30]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.

[31]

Virginia Braun and Victoria Clarke. 2021. Can I use TA? Should I use TA? Should I not use TA? Comparing reflexive thematic analysis and other pattern-based qualitative analytic approaches. Counselling and Psychotherapy Research 21, 1 (2021), 37–47.

[32]

Robin N. Brewer. 2018. Facilitating Discussion and Shared Meaning: Rethinking Co-Design Sessions with People with Vision Impairments. In Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare (New York, NY, USA) (PervasiveHealth ’18). Association for Computing Machinery, New York, NY, USA, 258–262. https://doi.org/10.1145/3240925.3240981

Digital Library

[33]

Erin Buehler, Stacy Branham, Abdullah Ali, Jeremy J. Chang, Megan Kelly Hofmann, Amy Hurst, and Shaun K. Kane. 2015. Sharing is Caring: Assistive Technology Designs on Thingiverse. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 525–534. https://doi.org/10.1145/2702123.2702525

Digital Library

[34]

Erin Buehler, Amy Hurst, and Megan Hofmann. 2014. Coming to grips: 3D printing for accessibility. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility(ASSETS ’14). Association for Computing Machinery, New York, NY, USA, 291–292. https://doi.org/10.1145/2661334.2661345

Digital Library

[35]

Michele A Burton, Erin Brady, Robin Brewer, Callie Neylan, Jeffrey P Bigham, and Amy Hurst. 2012. Crowdsourcing subjective fashion advice using VizWiz: challenges and opportunities. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. 135–142.

Digital Library

[36]

Ann Chapman, Brian Kelly, Liddy Nevile, and Andy Heath. 2006. Personalization and accessibility: integration of library and web approaches. In Proceedings of the 15th international conference on World Wide Web(WWW ’06). Association for Computing Machinery, New York, NY, USA, 871–872. https://doi.org/10.1145/1135777.1135920

Digital Library

[37]

Google Cloud. 2022. AutoML. https://cloud.google.com/automl

[38]

Aira Tech Corp. 2022. Aira. https://aira.io/

[39]

Lynne Coventry, Graham Johnson, and Antonella De Angeli. 2002. Achieving accessibility through personalization. (Jan. 2002).

[40]

Dries De Roeck, Karin Slegers, Johan Criel, Marc Godon, Laurence Claeys, Katriina Kilpi, and An Jacobs. 2012. I would DiYSE for it! a manifesto for do-it-yourself internet-of-things creation. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design(NordiCHI ’12). Association for Computing Machinery, New York, NY, USA, 170–179. https://doi.org/10.1145/2399016.2399044

Digital Library

[41]

Disability Visibility Project 2015. Integrating the disability perspective: assistive technology, design, hackathons & makeathons. https://disabilityvisibilityproject.com/2015/08/05/integrating-the-disability-perspective-assistive-technology-design-hackathons-makeathons/

[42]

Be My Eyes. 2022. Be My Eyes. https://www.bemyeyes.com/

[43]

Christopher Frauenberger. 2015. Disability and Technology: A Critical Realist Perspective. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility(ASSETS ’15). Association for Computing Machinery, New York, NY, USA, 89–96. https://doi.org/10.1145/2700648.2809851

Digital Library

[44]

Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. 2007. Automatically generating user interfaces adapted to users’ motor and vision capabilities. In Proceedings of the 20th annual ACM symposium on User interface software and technology(UIST ’07). Association for Computing Machinery, New York, NY, USA, 231–240. https://doi.org/10.1145/1294211.1294253

Digital Library

[45]

Alejandra Garrido, Sergio Firmenich, Gustavo Rossi, Julián Grigera, Nuria Medina-Medina, and Ivana Harari. 2013. Personalized Web Accessibility using Client-Side Refactoring. IEEE Internet Computing 17 (July 2013), 58–66. https://doi.org/10.1109/MIC.2012.143

Digital Library

[46]

Google. 2022. Lookout - Assisted Vision. https://play.google.com/store/apps/details?id=com.google.android.apps.accessibility.reveal

[47]

Anhong Guo, Xiang ‘Anthony’ Chen, Haoran Qi, Samuel White, Suman Ghosh, Chieko Asakawa, and Jeffrey P Bigham. 2016. Vizlens: A robust and interactive screen reader for interfaces in the real world. In Proceedings of the 29th annual symposium on user interface software and technology. 651–664.

Digital Library

[48]

Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, and Meredith Ringel Morris. 2020. Toward fairness in AI for people with disabilities: a research roadmap. ACM SIGACCESS Accessibility and Computing125 (2020), 1–1.

[49]

Anhong Guo, Jeeeun Kim, Xiang ‘Anthony’ Chen, Tom Yeh, Scott E. Hudson, Jennifer Mankoff, and Jeffrey P. Bigham. 2016. Facade: Auto-Generating Tactile Interfaces to Appliances. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(Reno, Nevada, USA) (ASSETS ’16). Association for Computing Machinery, New York, NY, USA, 315–316. https://doi.org/10.1145/2982142.2982187

Digital Library

[50]

Foad Hamidi, Patrick Mbullo Owuor, Michaela Hynie, and Melanie Baljko. 2022. "Knowledge Comes Through Participation": Understanding Disability through the Lens of DIY Assistive Technology in Western Kenya. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (April 2022), 72:1–72:25. https://doi.org/10.1145/3512919

Digital Library

[51]

Foad Hamidi, Kellie Poneres, Aaron Massey, and Amy Hurst. 2018. Who Should Have Access to my Pointing Data? Privacy Tradeoffs of Adaptive Assistive Technologies. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 203–216. https://doi.org/10.1145/3234695.3239331

Digital Library

[52]

Megan Hofmann, Jeffrey Harris, Scott E. Hudson, and Jennifer Mankoff. 2016. Helping Hands: Requirements for a Prototyping Methodology for Upper-limb Prosthetics Users. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 1769–1780. https://doi.org/10.1145/2858036.2858340

Digital Library

[53]

Amber Horvath, Sachin Grover, Sihan Dong, Emily Zhou, Finn Voichick, Mary Beth Kery, Shwetha Shinju, Daye Nam, Mariann Nagy, and Brad Myers. 2019. The Long Tail: Understanding the Discoverability of API Functionality. In 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 157–161. https://doi.org/10.1109/VLHCC.2019.8818681 ISSN: 1943-6106.

[54]

Amy Hurst and Shaun Kane. 2013. Making "making" accessible. In Proceedings of the 12th International Conference on Interaction Design and Children(IDC ’13). Association for Computing Machinery, New York, NY, USA, 635–638. https://doi.org/10.1145/2485760.2485883

Digital Library

[55]

Amy Hurst and Jasmine Tobias. 2011. Empowering individuals with do-it-yourself assistive technology. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility(ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 11–18. https://doi.org/10.1145/2049536.2049541

Digital Library

[56]

Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 5839–5849. https://doi.org/10.1145/3025453.3025899

Digital Library

[57]

Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility(Assets ’09). Association for Computing Machinery, New York, NY, USA, 115–122. https://doi.org/10.1145/1639642.1639663

Digital Library

[58]

Shaun K. Kane, Varsha Koushik, and Annika Muehlbradt. 2018. Bonk: accessible programming for accessible audio games. In Proceedings of the 17th ACM Conference on Interaction Design and Children(IDC ’18). Association for Computing Machinery, New York, NY, USA, 132–142. https://doi.org/10.1145/3202185.3202754

Digital Library

[59]

Amy J. Ko, Robin Abraham, Laura Beckwith, Alan Blackwell, Margaret Burnett, Martin Erwig, Chris Scaffidi, Joseph Lawrance, Henry Lieberman, Brad Myers, Mary Beth Rosson, Gregg Rothermel, Mary Shaw, and Susan Wiedenbeck. 2011. The state of the art in end-user software engineering. Comput. Surveys 43, 3 (April 2011), 21:1–21:44. https://doi.org/10.1145/1922649.1922658

Digital Library

[60]

Stacey Kuznetsov and Eric Paulos. 2010. Rise of the Expert Amateur: DIY Projects, Communities, and Cultures. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries(Reykjavik, Iceland) (NordiCHI ’10). Association for Computing Machinery, New York, NY, USA, 295–304. https://doi.org/10.1145/1868914.1868950

Digital Library

[61]

Jean Lave and Etienne Wenger. 1991. Situated learning: Legitimate peripheral participation. Cambridge university press.

[62]

Kyungjun Lee. 2020. Teachable Object Recognizers for the Blind: Using First-Person Vision. SIGACCESS Access. Comput.123, Article 3 (mar 2020), 1 pages. https://doi.org/10.1145/3386402.3386405

Digital Library

[63]

Kyungjun Lee, Jonggi Hong, Simone Pimento, Ebrima Jarjue, and Hernisa Kacorri. 2019. Revisiting blind photography in the context of teachable object recognizers. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 83–95.

Digital Library

[64]

Sooyeon Lee, Madison Reddie, Chun-Hua Tsai, Jordan Beck, Mary Beth Rosson, and John M. Carroll. 2020. The Emerging Professional Practice of Remote Sighted Assistance for People with Visual Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376591

Digital Library

[65]

Sooyeon Lee, Rui Yu, Jingyi Xie, Syed Masum Billah, and John M. Carroll. 2022. Opportunities for Human-AI Collaboration in Remote Sighted Assistance. In 27th International Conference on Intelligent User Interfaces(IUI ’22). Association for Computing Machinery, New York, NY, USA, 63–78. https://doi.org/10.1145/3490099.3511113

Digital Library

[66]

Helena Lindgren, Jayalakshmi Baskar, Esteban Guerrero, Juan Carlos Nieves, Ingeborg Nilsson, and Chunli Yan. 2016. Computer-Supported Assessment for Tailoring Assistive Technology. In Proceedings of the 6th International Conference on Digital Health Conference(DH ’16). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2896338.2896352

Digital Library

[67]

Google LLC. 2022. Google Assistant. https://play.google.com/store/apps/details?id=com.google.android.apps.googleassistant&hl=en_US&gl=US&pli=1

[68]

Janis Lena Meissner, John Vines, Janice McLaughlin, Thomas Nappey, Jekaterina Maksimova, and Peter Wright. 2017. Do-it-yourself empowerment as experienced by novice makers with disabilities. In Proceedings of the 2017 conference on designing interactive systems. 1053–1065.

Digital Library

[69]

Microsoft. 2021. Seeing AI. https://www.microsoft.com/en-us/ai/seeing-ai

[70]

Microsoft Research. 2021. Microsoft Soundscape – A map delivered in 3D sound. https://www.microsoft.com/en-us/research/product/soundscape/.

[71]

Lauren R. Milne and Richard E. Ladner. 2018. Blocks4All: Overcoming Accessibility Barriers to Blocks Programming for Children with Visual Impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173643

Digital Library

[72]

Kazunori Minatani. 2019. Smart Apps vs. Renovated Low-tech Devices with DIY Assistive Technology: A Case of a Banknote Identifier for Visually Impaired People. In Proceedings of the 5th EAI International Conference on Smart Objects and Technologies for Social Good(GoodTechs ’19). Association for Computing Machinery, New York, NY, USA, 96–101. https://doi.org/10.1145/3342428.3342673

Digital Library

[73]

Moovit. 2022. Moovit Inc.https://moovit.com/

[74]

Argyro Moraiti, Vero Vanden Abeele, Erwin Vanroye, and Luc Geurts. 2015. Empowering Occupational Therapists with a DIY-toolkit for Smart Soft Objects. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’15). Association for Computing Machinery, New York, NY, USA, 387–394. https://doi.org/10.1145/2677199.2680598

Digital Library

[75]

Aboubakar Mountapmbeme and Stephanie Ludi. 2020. Investigating Challenges Faced by Learners with Visual Impairments using Block-Based Programming/Hybrid Environments. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3373625.3417998

Digital Library

[76]

Aboubakar Mountapmbeme and Stephanie Ludi. 2021. How Teachers of the Visually Impaired Compensate with the Absence of Accessible Block-Based Languages. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3441852.3471221

Digital Library

[77]

Brian J Nguyen, William S Chen, Allison J Chen, Andrew Utt, Emily Hill, Ryan Apgar, and Daniel L Chao. 2019. Large-scale assessment of needs in low vision individuals using the Aira assistive technology. Clinical Ophthalmology (Auckland, N.Z.) 13 (Sept. 2019), 1853–1868. https://doi.org/10.2147/OPTH.S215658

[78]

National Federation of the Blind. 2022. KNFB Reader (OneStep Reader). https://nfb.org/programs-services/knfb-reader

[79]

Johanna Okerlund and David Wilson. 2019. DIY Assistive Technology for Others: Considering Social Impacts and Opportunities to Leverage HCI Techniques. In Proceedings of FabLearn 2019(FL2019). Association for Computing Machinery, New York, NY, USA, 152–155. https://doi.org/10.1145/3311890.3311914

Digital Library

[80]

Maulishree Pandey, Sharvari Bondre, Sile O’Modhrain, and Steve Oney. 2022. Accessibility of UI Frameworks and Libraries for Programmers with Visual Impairments. (2022), 10.

[81]

Maulishree Pandey, Vaishnav Kameswaran, Hrishikesh V. Rao, Sile O’Modhrain, and Steve Oney. 2021. Understanding Accessibility and Collaboration in Programming for People with Visual Impairments. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 129:1–129:30. https://doi.org/10.1145/3449203

Digital Library

[82]

Joon Sung Park, Danielle Bragg, Ece Kamar, and Meredith Ringel Morris. 2021. Designing an Online Infrastructure for Collecting AI Data From People With Disabilities. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. ACM, Virtual Event Canada, 52–63. https://doi.org/10.1145/3442188.3445870

Digital Library

[83]

Venkatesh Potluri, Tadashi Grindeland, Jon E Froehlich, and Jennifer Mankoff. 2019. AI-Assisted UI Design for Blind and Low-Vision Creators.

[84]

Venkatesh Potluri, Liang He, Christine Chen, Jon E Froehlich, and Jennifer Mankoff. 2019. A Multi-Modal Approach for Blind and Visually Impaired Developers to Edit Webpage Designs. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 612–614.

Digital Library

[85]

Venkatesh Potluri, Priyan Vaithilingam, Suresh Iyengar, Y. Vidya, Manohar Swaminathan, and Gopal Srinivasa. 2018. CodeTalk: Improving Programming Environment Accessibility for Visually Impaired Developers. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174192

Digital Library

[86]

Venkatesh Potluri, Priyan Vaithilingam, Suresh Iyengar, Y Vidya, Manohar Swaminathan, and Gopal Srinivasa. 2018. CodeTalk: Improving Programming Environment Accessibility for Visually Impaired Developers.

[87]

Alberto Monge Roffarello and Luigi De Russis. 2022. Understanding and Streamlining App Switching Experiences in Mobile Interaction. International Journal of Human-Computer Studies 158 (2022), 102735.

Digital Library

[88]

Emma Sadjo, Leah Findlater, and Abigale Stangl. 2021. Landscape Analysis of Commercial Visual Assistance Technologies. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, USA) (ASSETS ��21). Association for Computing Machinery, New York, NY, USA, Article 76, 4 pages. https://doi.org/10.1145/3441852.3476521

Digital Library

[89]

Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. NavCog3: An Evaluation of a Smartphone-Based Blind Indoor Navigation Assistant with Semantic Features in a Large-Scale Environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(Baltimore, Maryland, USA) (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 270–279. https://doi.org/10.1145/3132525.3132535

Digital Library

[90]

Ashrith Shetty, Ebrima Jarjue, and Huaishu Peng. 2020. Tangible web layout design for blind and visually impaired people: An initial investigation. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology. 37–39.

Digital Library

[91]

Robert M. Siegfried. 2006. Visual programming and the blind: the challenge and the opportunity. ACM SIGCSE Bulletin 38, 1 (March 2006), 275–278. https://doi.org/10.1145/1124706.1121427

Digital Library

[92]

David Sloan, Matthew Tylee Atkinson, Colin Machin, and Yunqiu Li. 2010. The potential of adaptive interfaces as an accessibility aid for older web users. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)(W4A ’10). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/1805986.1806033

Digital Library

[93]

Abigale Stangl, Nitin Verma, Kenneth R. Fleischmann, Meredith Ringel Morris, and Danna Gurari. 2021. Going Beyond One-Size-Fits-All Image Descriptions to Satisfy the Information Wants of People Who are Blind or Have Low Vision. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3441852.3471233

Digital Library

[94]

Neil Stewart. 2021. Disability-first Dataset Creation: Lessons from Constructing a Dataset for Teachable Object Recognition with Blind and Low Vision Data Collectors. ASSETS (2021), 22.

[95]

Michele A. Williams, Amy Hurst, and Shaun K. Kane. 2013. "Pray before you step out": describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’13). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/2513383.2513449

Digital Library

[96]

Jeffrey Wong and Jason I. Hong. 2007. Making mashups with marmite: towards end-user programming for the web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). Association for Computing Machinery, New York, NY, USA, 1435–1444. https://doi.org/10.1145/1240624.1240842

Digital Library

Cited By

Xu ACai MHou DChang RGuo A(2024)ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the WildProceedings of the 21st International Web for All Conference10.1145/3677846.3677861(59-69)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3677846.3677861
Loewen G(2024)Exploring Gaming Wearables for Players with Upper Limb Motor Disabilities through Design Fiction and DIYCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678854(427-430)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678854
Alharbi RLor PHerskovitz JSchoenebeck SBrewer R(2024)Misfitting With AI: How Blind People Verify and Contest AI ErrorsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675659(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675659
Show More Cited By

Index Terms

Hacking, Switching, Combining: Understanding and Supporting DIY Assistive Technology Design by Blind People
1. Human-centered computing
  1. Accessibility
    1. Empirical studies in accessibility
  2. Human computer interaction (HCI)
2. Social and professional topics
  1. User characteristics
    1. People with disabilities

Recommendations

Understanding Visual Arts Experiences of Blind People
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Visual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people’s access to visual ...
Understanding Curators' Practices and Challenge of Making Exhibitions More Accessible for People with Visual Impairments
ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

Assistive technologies are increasingly developed and applied in exhibition environments to help blind and low vision (BLV) people deal with the challenges they face when visiting exhibitions. While studies have examined the experiences of BLV people ...
“I Choose Assistive Devices That Save My Face”: A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Despite the potential benefits of assistive technologies (ATs) for people with various disabilities, only around 7% of Chinese with disabilities have had an opportunity to use ATs. Even for those who have used ATs, the abandonment rate was high. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation Graduate Research Fellowship

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
953
Total Downloads

Downloads (Last 12 months)590
Downloads (Last 6 weeks)66

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu ACai MHou DChang RGuo A(2024)ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the WildProceedings of the 21st International Web for All Conference10.1145/3677846.3677861(59-69)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3677846.3677861
Loewen G(2024)Exploring Gaming Wearables for Players with Upper Limb Motor Disabilities through Design Fiction and DIYCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678854(427-430)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678854
Alharbi RLor PHerskovitz JSchoenebeck SBrewer R(2024)Misfitting With AI: How Blind People Verify and Contest AI ErrorsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675659(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675659
Hong JKacorri H(2024)Understanding How Blind Users Handle Object Recognition Errors: Strategies and ChallengesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675635(1-15)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675635
Natalie RChang RSheshadri SGuo AHara K(2024)Audio Description CustomizationProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675617(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675617
Chang RLiu YZhang LGuo A(2024)EditScribe: Non-Visual Image Editing with Natural Language Verification LoopsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675599(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675599
Herskovitz JXu AAlharbi RGuo A(2024)ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User ProgrammingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676391(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676391
Chang RLiu YGuo A(2024)WorldScribe: Towards Context-Aware Live Visual DescriptionsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676375(1-18)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676375
Herskovitz J(2024)DIY Assistive Software: End-User Programming for Personalized Assistive TechnologyACM SIGACCESS Accessibility and Computing10.1145/3654768.3654772(1-1)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3654768.3654772
Mörike FKiossis I(2024)Workarounds as enabling factor in the use of assistive technology amongst white-collar workers with visual impairmentJournal of Enabling Technologies10.1108/JET-02-2024-0020Online publication date: 28-Aug-2024
https://doi.org/10.1108/JET-02-2024-0020
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents