skip to main content
extended-abstract

Actuated Materials and Soft Robotics Strategies for Human-Computer Interaction Design

Published: 28 April 2022 Publication History

Abstract

The fields of programmable matter, actuated materials, and Soft Robotics are becoming increasingly more relevant for the design of novel applications, interfaces, and user experiences in the domain of Human-Computer Interaction (HCI). These research fields often use soft, flexible materials with elastic actuation mechanisms to build systems that are more adaptable, compliant, and suitable for a very broad range of environments. However, at the intersection between HCI and the aforementioned domains, there are numerous challenges related to fabrication methods, development tools, resource availability, nomenclature, design for inclusion, etc. This workshop aims to explore how to make Soft Robotics more accessible to both researchers and nonresearchers alike. We will (1) investigate and identify the various difficulties people face when developing HCI applications that require the transfer of knowledge from those other domains, and (2) discuss possible solutions and visions on how to overcome those difficulties.

References

[1]
Ahmad Alsaleem, Ross Imburgia, Mateo Godinez, Andrew Merryweather, Roger Altizer, Tamara Denning, Jeffery Rosenbluth, Stephen Trapp, and Jason Wiese. 2019. Leveraging Shared Control to Empower People with Tetraplegia to Participate in Extreme Sports. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 470–481. https://doi.org/10.1145/3308561.3353775
[2]
Byoungkwon An, Ye Tao, Jianzhe Gu, Tingyu Cheng, Xiang ’Anthony’ Chen, Xiaoxiao Zhang, Wei Zhao, Youngwook Do, Shigeo Takahashi, Hsiang-Yun Wu, Teng Zhang, and Lining Yao. 2018. Thermorph: Democratizing 4D Printing of Self-Folding Materials and Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173834
[3]
Cameron Aubin, Snehashis Choudhury, Rhiannon Jerch, Lynden Archer, James Pikul, and Robert Shepherd. 2019. Electrolytic vascular systems for energy-dense robots. Nature 571 (07 2019). https://doi.org/10.1038/s41586-019-1313-1
[4]
Hedan Bai, Shuo Li, Jose Barreiros, Yaqi Tu, Clifford R. Pollock, and Robert F. Shepherd. 2020. Stretchable distributed fiber-optic sensors. Science 370, 6518 (2020), 848–852. https://doi.org/10.1126/science.aba5504 arXiv:https://www.science.org/doi/pdf/10.1126/science.aba5504
[5]
Jose Barreiros, Houston Claure, Bryan Peele, Omer Shapira, Josef Spjut, David Luebke, Malte Jung, and Robert Shepherd. 2019. Fluidic Elastomer Actuators for Haptic Interactions in Virtual Reality. IEEE Robotics and Automation Letters 4, 2 (2019), 277–284. https://doi.org/10.1109/LRA.2018.2888628
[6]
Jose Barreiros, Ilbey Karakurt, Priyanshu Agarwal, Talha Agcayazi, Shawn Reese, Katherine Healy, and Yigit Menguc. 2020. Self-sensing Elastomeric Membrane for Haptic Bubble Arrray. In 2020 3rd IEEE International Conference on Soft Robotics (RoboSoft). 229–236. https://doi.org/10.1109/RoboSoft48309.2020.9116051
[7]
Ang Chen, Ruixue Yin, Lin Cao, Chenwang Yuan, H.K. Ding, and W.J. Zhang. 2017. Soft robotics: Definition and research issues. In 2017 24th International Conference on Mechatronics and Machine Vision in Practice (M2VIP). 366–370. https://doi.org/10.1109/M2VIP.2017.8267170
[8]
Nick Cheney, Josh Bongard, and Hod Lipson. 2015. Evolving Soft Robots in Tight Spaces. In Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation (Madrid, Spain) (GECCO ’15). Association for Computing Machinery, New York, NY, USA, 935–942. https://doi.org/10.1145/2739480.2754662
[9]
Stephen Coyle, Carmel Majidi, Philip LeDuc, and K. Jimmy Hsia. 2018. Bio-inspired soft robotics: Material selection, actuation, and design. Extreme Mechanics Letters 22 (2018), 51–59. https://doi.org/10.1016/j.eml.2018.05.003
[10]
Uranbileg Daalkhaijav, Osman Dogan Yirmibesoglu, Stephanie Walker, and Yigit Mengüç. 2018. Rheological Modification of Liquid Metal for Additive Manufacturing of Stretchable Electronics. Advanced Materials Technologies 3, 4 (2018), 1700351. https://doi.org/10.1002/admt.201700351
[11]
Dylan Drotman, Saurabh Jadhav, David Sharp, Christian Chan, and Michael T. Tolley. 2021. Electronics-free pneumatic circuits for controlling soft-legged robots. Science Robotics 6, 51 (2021), eaay2627. https://doi.org/10.1126/scirobotics.aay2627 arXiv:https://www.science.org/doi/pdf/10.1126/scirobotics.aay2627
[12]
Jiachun Du, Panos Markopoulos, Qi Wang, Marina Toeters, and Ting Gong. 2018. ShapeTex: Implementing Shape-Changing Structures in Fabric for Wearable Actuation. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (Stockholm, Sweden) (TEI ’18). Association for Computing Machinery, New York, NY, USA, 166–176. https://doi.org/10.1145/3173225.3173245
[13]
Nazek El-Atab, Rishabh B. Mishra, Fhad Al-Modaf, Lana Joharji, Aljohara A. Alsharif, Haneen Alamoudi, Marlon Diaz, Nadeem Qaiser, and Muhammad Mustafa Hussain. 2020. Soft Actuators for Soft Robotic Applications: A Review. Advanced Intelligent Systems 2, 10 (2020), 2000128. https://doi.org/10.1002/aisy.202000128 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/aisy.202000128
[14]
Jack Forman, Taylor Tabb, Youngwook Do, Meng-Han Yeh, Adrian Galvin, and Lining Yao. 2019. ModiFiber: Two-Way Morphing Soft Thread Actuators for Tangible Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300890
[15]
Kristian Gohlke. 2017. Exploring Bio-Inspired Soft Fluidic Actuators and Sensors for the Design of Shape Changing Tangible User Interfaces. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (Yokohama, Japan) (TEI ’17). Association for Computing Machinery, New York, NY, USA, 703–706. https://doi.org/10.1145/3024969.3025039
[16]
Kristian Gohlke and Eva Hornecker. 2018. A Stretch-Flexible Textile Multitouch Sensor for User Input on Inflatable Membrane Structures & Non-Planar Surfaces. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (Berlin, Germany) (UIST ’18 Adjunct). Association for Computing Machinery, New York, NY, USA, 191–193. https://doi.org/10.1145/3266037.3271647
[17]
Liang He, Cheng Xu, Ding Xu, and Ryan Brill. 2015. PneuHaptic: Delivering Haptic Cues with a Pneumatic Armband. In Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (ISWC ’15). Association for Computing Machinery, New York, NY, USA, 47–48. https://doi.org/10.1145/2802083.2802091
[18]
Yuhan Hu, Sang-won Leigh, and Pattie Maes. 2017. Hand Development Kit: Soft Robotic Fingers as Prosthetic Augmentation of the Hand. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 27–29. https://doi.org/10.1145/3131785.3131805
[19]
Haptx Inc. 2021. Haptic gloves for virtual reality and Robotics. https://haptx.com/
[20]
Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping on-Skin User Interfaces Using Skin-Friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC ’16). Association for Computing Machinery, New York, NY, USA, 16–23. https://doi.org/10.1145/2971763.2971777
[21]
Sourav Karmakar and Abhishek Sarkar. 2019. Design and Implementation of Bio-Inspired Soft Robotic Grippers. In Proceedings of the Advances in Robotics 2019 (Chennai, India) (AIR 2019). Association for Computing Machinery, New York, NY, USA, Article 24, 6 pages. https://doi.org/10.1145/3352593.3352618
[22]
Ozgun Kilic Afsar, Ali Shtarbanov, Hila Mor, Ken Nakagaki, Jack Forman, Karen Modrei, Seung Hee Jeong, Klas Hjort, Kristina Höök, and Hiroshi Ishii. 2021. OmniFiber: Integrated Fluidic Fiber Actuators for Weaving Movement Based Interactions into the ‘Fabric of Everyday Life’. In UIST ’21: Proceedings of the 34rd Annual ACM Symposium on User Interface Software and Technology (Virtual) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3472749.3474802
[23]
C. Larson, B. Peele, S. Li, S. Robinson, M. Totaro, L. Beccai, B. Mazzolai, and R. Shepherd. 2016. Highly stretchable electroluminescent skin for optical signaling and tactile sensing. Science 351, 6277 (2016), 1071–1074. https://doi.org/10.1126/science.aac5082 arXiv:https://www.science.org/doi/pdf/10.1126/science.aac5082
[24]
Haiqing Lu, Zhanan Zou, Xingli Wu, Chuanqian Shi, Yimeng Liu, and Jianliang Xiao. 2021. Biomimetic Prosthetic Hand Enabled by Liquid Crystal Elastomer Tendons. Micromachines 12, 7 (2021). https://doi.org/10.3390/mi12070736
[25]
Eric Markvicka, Guanyun Wang, Yi-Chin Lee, Gierad Laput, Carmel Majidi, and Lining Yao. 2019. ElectroDermis: Fully Untethered, Stretchable, and Highly-Customizable Electronic Bandages. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300862
[26]
Meta. 2021. Inside reality labs research: Meet the team that’s working to bring touch to the Digital World. https://tech.fb.com/inside-reality-labs-meet-the-team-thats-bringing-touch-to-the-digital-world/
[27]
Anand K. Mishra, Thomas J. Wallin, Wenyang Pan, Patricia Xu, Kaiyang Wang, Emmanuel P. Giannelis, Barbara Mazzolai, and Robert F. Shepherd. 2020. Autonomic perspiration in 3D-printed hydrogel actuators. Science Robotics 5, 38 (2020), eaaz3918. https://doi.org/10.1126/scirobotics.aaz3918
[28]
Philipp Rothemund, Nicholas Kellaris, Shane K. Mitchell, Eric Acome, and Christoph Keplinger. 2021. HASEL Artificial Muscles for a New Generation of Lifelike Robots—Recent Progress and Future Opportunities. Advanced Materials 33, 19 (2021), 2003375. https://doi.org/10.1002/adma.202003375 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/adma.202003375
[29]
Ali Shtarbanov. 2021. FlowIO Development Platform – the Pneumatic “Raspberry Pi” for Soft Robotics. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 479, 6 pages. https://doi.org/10.1145/3411763.3451513
[30]
Ronit Slyper, Ivan Poupyrev, and Jessica Hodgins. 2010. Sensing through Structure: Designing Soft Silicone Sensors. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (Funchal, Portugal) (TEI ’11). Association for Computing Machinery, New York, NY, USA, 213–220. https://doi.org/10.1145/1935701.1935744
[31]
Yi Sun, Yun Seong Song, and Jamie Paik. 2013. Characterization of silicone rubber based soft pneumatic actuators. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. 4446–4453. https://doi.org/10.1109/IROS.2013.6696995
[32]
Carlos E. Tejada, Raf Ramakers, Sebastian Boring, and Daniel Ashbrook. 2020. AirTouch: 3D-Printed Touch-Sensitive Objects Using Pneumatic Sensing. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376136
[33]
Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chi-huan Chiang, Da-Yuan Huang, Liwei Chan, and Bing-Yu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 5–17. https://doi.org/10.1145/3242587.3242628
[34]
Seppe Terryn, Joost Brancart, Dirk Lefeber, Guy Van Assche, and Bram Vanderborght. 2017. Self-healing soft pneumatic robots. Science Robotics 2, 9 (2017), eaan4268. https://doi.org/10.1126/scirobotics.aan4268 arXiv:https://www.science.org/doi/pdf/10.1126/scirobotics.aan4268
[35]
Ilse M. Van Meerbeek, Benjamin C. Mac Murray, Jae Woo Kim, Sanlin S. Robinson, Perry X. Zou, Meredith N. Silberstein, and Robert F. Shepherd. 2016. Morphing Metal and Elastomer Bicontinuous Foams for Reversible Stiffness, Shape Memory, and Self-Healing Soft Machines. Advanced Materials 28, 14 (2016), 2801–2806. https://doi.org/10.1002/adma.201505991 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/adma.201505991
[36]
Luisa von Radziewsky, Antonio Krüger, and Markus Löchtefeld. 2015. Scarfy: Augmenting Human Fashion Behaviour with Self-Actuated Clothes. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction(Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 313–316. https://doi.org/10.1145/2677199.2680568
[37]
Guanyun Wang, Ye Tao, Ozguc Bertug Capunaman, Humphrey Yang, and Lining Yao. 2019. A-Line: 4D Printing Morphing Linear Composite Structures. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300656
[38]
Wen Wang, Lining Yao, Teng Zhang, Chin-Yi Cheng, Daniel Levine, and Hiroshi Ishii. 2017. Transformative Appetite: Shape-Changing Food Transforms from 2D to 3D by Water Interaction through Cooking. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6123–6132. https://doi.org/10.1145/3025453.3026019
[39]
Michael Wehner, Ryan L. Truby, Daniel J. Fitzgerald, Bobak Mosadegh, George M. Whitesides, Jennifer A. Lewis, and Robert J. Wood. 2016. An integrated design and fabrication strategy for entirely soft, autonomous robots. Nature 536, 7617 (Oct. 2016), 451–455. https://doi.org/10.1038/nature19100

Cited By

View all
  • (2024)Exploring the Design of Playful Devices for SurfingCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678786(200-207)Online publication date: 14-Oct-2024
  • (2024)Human Building Interaction and Design for Climate ChangeCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658386(462-466)Online publication date: 1-Jul-2024
  • (2024)KiPneu: Designing a Constructive Pneumatic Platform for Biomimicry Learning in STEAM EducationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661828(441-458)Online publication date: 1-Jul-2024
  • Show More Cited By

Index Terms

  1. Actuated Materials and Soft Robotics Strategies for Human-Computer Interaction Design
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
    April 2022
    3066 pages
    ISBN:9781450391566
    DOI:10.1145/3491101
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 April 2022

    Check for updates

    Author Tags

    1. Design Tools
    2. Fabrication
    3. Fluidic
    4. HCI
    5. Interaction Design
    6. Pneumatic
    7. Programmable Materials
    8. Shape Change
    9. Soft Robotics
    10. Tangible Interfaces

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Conference

    CHI '22
    Sponsor:
    CHI '22: CHI Conference on Human Factors in Computing Systems
    April 29 - May 5, 2022
    LA, New Orleans, USA

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)181
    • Downloads (Last 6 weeks)21
    Reflects downloads up to 22 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exploring the Design of Playful Devices for SurfingCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678786(200-207)Online publication date: 14-Oct-2024
    • (2024)Human Building Interaction and Design for Climate ChangeCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658386(462-466)Online publication date: 1-Jul-2024
    • (2024)KiPneu: Designing a Constructive Pneumatic Platform for Biomimicry Learning in STEAM EducationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661828(441-458)Online publication date: 1-Jul-2024
    • (2023)Soft Robotics and Programmable Materials for Human-Computer InteractionCompanion Publication of the 2023 ACM Designing Interactive Systems Conference10.1145/3563703.3591460(110-113)Online publication date: 10-Jul-2023
    • (2023)MiuraKit: A Modular Hands-On Construction Kit For Pneumatic Shape-Changing And Robotic InterfacesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596108(2066-2078)Online publication date: 10-Jul-2023
    • (2022)Human-Computer Interaction in Robotics: A bibliometric evaluation using Web of ScienceMetaverse Basic and Applied Research10.56294/mr202222Online publication date: 27-Dec-2022
    • (2022)Symbiosis: Design and Development of Novel Soft Robotic Structures for Interactive Public SpacesCompanion Publication of the 2022 International Conference on Multimodal Interaction10.1145/3536220.3558541(46-51)Online publication date: 7-Nov-2022
    • (2022)PneuBots: Modular Inflatables for Playful Exploration of Soft RoboticsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3514490(1-6)Online publication date: 27-Apr-2022

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media