demonstration

Using gestures on mobile phones to create SMS comics

Authors:

Vidya Setlur,

Agathe Battestini,

Timothy Sohn,

Hiroshi HoriiAuthors Info & Claims

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Pages 217 - 220

https://doi.org/10.1145/1709886.1709926

Published: 24 January 2010 Publication History

Get Access

Abstract

SMS messages provide an easy and simple method to communicate with others. These short messages are useful, but can sometimes feel restricted due to the limitations of textual communication. The ability to express subtle nuances and contexts around the message could help add enjoyment and amplify the emotions being expressed by the mobile user. We present SensorComix, a new way of creating comics using SMS messages combined with gestures on mobile phones. Comics are automatically generated from users' SMS messages, and augmented with visual icons based on the performed gestures. We demonstrate that gestures mapped to comics can help influence the expressiveness of messages sent by mobile users.

References

[1]

A.K. Amin, B.T.A. Kersten, O.A. Kulyk, P.H. Pelgrim, C.M. Wang, and P. Markopoulos. Sensems: a user-centered approach to enrich the messaging experience for teens by non-verbal means. In MobileHCI '05, pages 161--166, New York, NY, USA, 2005. ACM.

Digital Library

Google Scholar

[2]

S. Bhandari and Y.-K. Lim. Exploring gestural mode of interaction with mobile phones. In CHI '08: CHI '08 extended abstracts on Human factors in computing systems, pages 2979--2984, New York, NY, USA, 2008. ACM.

Digital Library

Google Scholar

[3]

CellSigns. http://www.cellsigns.com/industry.shtml.

Google Scholar

[4]

L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell., 20(11):1254--1259, 1998.

Digital Library

Google Scholar

[5]

D. Kurlander, T. Skelly, and D. Salesin. Comic chat. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pages 225--236, New York, NY, USA, 1996. ACM.

Digital Library

Google Scholar

[6]

P. Persson. Exms: an animated and avatar-based messaging system for expressive peer communication. In GROUP '03: Proceedings of the 2003 international ACM SIGGROUP conference on Supporting group work, pages 31--39, New York, NY, USA, 2003. ACM.

Digital Library

Google Scholar

[7]

M.-T. Pham and T.-J. Chain. Fast training and selection of haar features using statistics in boosting-based face detection. IEEE International Conference on Computer Vision, 0:1--7, 2007.

Crossref

Google Scholar

[8]

A. Salovaara. Appropriation of a mms-based comic creator: from system functionalities to resources for action. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1117--1126, New York, NY, USA, 2007. ACM.

Digital Library

Google Scholar

[9]

C. von Wrede, P. Laskov, and F.F. Ida. Using classification to determine the number of finger strokes on a multi-touch tactile device. In European Symposium on Artificial Neural Networks, pages 549--554, 2004.

Google Scholar

[10]

J. Wang, S. Zhai, and J. Canny. Camera phone based motion sensing: interaction techniques, applications and performance study. In UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology, pages 101--110, New York, NY, USA, 2006. ACM.

Digital Library

Google Scholar

[11]

L. Yujian and L. Bo. A normalized levenshtein distance metric. IEEE Trans. Pattern Anal. Mach. Intell., 29(6):1091--1095, 2007.

Digital Library

Google Scholar

Cited By

View all

Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Sabato CGiraudet ADelattre VDesnos YFrisson CGiot RYvart WRocca FDupont SBemden GLeleu-Merviel SDutoit T(2014)Scenarizing CADastre ExquisseProceedings of the 20th Anniversary International Conference on MultiMedia Modeling - Volume 832610.1007/978-3-319-04117-9_3(22-33)Online publication date: 6-Jan-2014
https://dl.acm.org/doi/10.1007/978-3-319-04117-9_3
Hurtienne JStöíel CSturm CMaus ARötting MLangdon PClarkson J(2010)Physical gestures for abstract conceptsInteracting with Computers10.1016/j.intcom.2010.08.00922:6(475-484)Online publication date: 1-Nov-2010
https://dl.acm.org/doi/10.1016/j.intcom.2010.08.009

Index Terms

Using gestures on mobile phones to create SMS comics
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Decentralized search and retrieval for mobile networks using SMS
WIMOB '12: Proceedings of the 2012 IEEE 8th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob)

This paper describes the iTrust over SMS decentralized search and retrieval system for mobile networks. Any mobile device in the iTrust network can communicate with any other mobile device in the iTrust network to distribute, search for, and retrieve ...
Eye-gaze interaction for mobile phones
Mobility '07: Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology

In this paper, we discuss the use of eye-gaze tracking technology for mobile phones. In particular we investigate how gaze interaction can be used to control applications on handheld devices. In contrast to eye-tracking systems for desktop computers, ...
Use of mobile phones by male and female Greek students

Mobile technology is a continuously growing domain, and research activities regarding its use are quite intensive. A questionnaire regarding the use of mobile devices was developed and distributed to 416 students in a Greek University. There were completed ...

Comments

Information & Contributors

Information

Published In

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

January 2010

414 pages

ISBN:9781605588414

DOI:10.1145/1709886

Conference Chairs:
Marcelo Coelho
MIT Media Lab
,
Jamie Zigelbaum
MIT Media Lab, Oblong Industries
,
General Chairs:
Hiroshi Ishii
MIT Media Lab
,
Robert J.K. Jacob
Tufts University
,
Pattie Maes
MIT Media Lab
,
Program Chairs:
Thomas Pederson
IT University of Copenhagen
,
Orit Shaer
Wellesley College
,
Ron Wakkary
Simon Fraser University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

TEI '10

Sponsor:

SIGCHI

TEI '10: Fourth International Conference on Tangible, Embedded, and Embodied Interaction

January 24 - 27, 2010

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
456
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Sabato CGiraudet ADelattre VDesnos YFrisson CGiot RYvart WRocca FDupont SBemden GLeleu-Merviel SDutoit T(2014)Scenarizing CADastre ExquisseProceedings of the 20th Anniversary International Conference on MultiMedia Modeling - Volume 832610.1007/978-3-319-04117-9_3(22-33)Online publication date: 6-Jan-2014
https://dl.acm.org/doi/10.1007/978-3-319-04117-9_3
Hurtienne JStöíel CSturm CMaus ARötting MLangdon PClarkson J(2010)Physical gestures for abstract conceptsInteracting with Computers10.1016/j.intcom.2010.08.00922:6(475-484)Online publication date: 1-Nov-2010
https://dl.acm.org/doi/10.1016/j.intcom.2010.08.009

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Decentralized search and retrieval for mobile networks using SMS

Eye-gaze interaction for mobile phones

Use of mobile phones by male and female Greek students