research-article

Development and Design of a Dancing Robot System Based on Phonetic Control and 3D Gesture Interaction

Authors:

Zhao Xiaofan,

Cai Qingyu,

Peng Xi,

Sun Hao,

Zheng ShijueAuthors Info & Claims

ICCAI '23: Proceedings of the 2023 9th International Conference on Computing and Artificial Intelligence

Pages 781 - 786

https://doi.org/10.1145/3594315.3594405

Published: 02 August 2023 Publication History

Get Access

Abstract

The dancing robot system based on sound control and 3D gesture interaction breaks the conventional remote control mode, the robot can follow the melody and rhythm of the music to make dance movements at any time and make real-time effective feature extraction of the music features. During the direction of the robot, the system realizes the self-following of the dancing robot based on 3D gesture sensing through the PAJ7260U2 sensing module to learn the coordinated control of each degree of freedom of the robot, which significantly improves the flexibility and fun of the dancing robot. The experimental results of this system's robot dance movement prove the system design's correctness and feasibility, which is of great significance for the simulation research of the robot.

References

[1]

M.P. Michalowski, "Rhythmic human-robot social interaction," Ph. D. Dissertation, Robot. Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, 2010.

Google Scholar

[2]

Qian, T. Research and application of vocal features in music recognition methods[J]. Microcomputer Applications,2020,36(06):127-129+135.

Google Scholar

[3]

Tang J. W. Design and implementation of a small dancing bipedal robot[J]. Science and Technology Perspectives,2020,(09):177-179.

Google Scholar

[4]

Jiaqing Liu, Kotaro Furusawa, Tomoko Tateyama, Yutaro Iwamoto, and Yen-wei Chen, "An Improved Kinect-Based Real-Time Gesture Recognition Using Deep Convolutional Neural Networks for Touchless Visualization of Hepatic Anatomical Mode," Journal of Image and Graphics, Vol. 7, No. 2, pp. 45-49, June 2019.

Crossref

Google Scholar

[5]

Jingzhong Wang, Xiaoqing Xu, and Meng Li, "The Study of Gesture Recognition Based on SVM with LBP and PCA," Journal of Image and Graphics, Vol. 3, No. 1, pp. 16-19, June 2015.

Crossref

Google Scholar

[6]

Trong-Nguyen Nguyen, Huu-Hung Huynh, and Jean Meunier, "Static Hand Gesture Recognition Using Artificial Neural Network," Journal of Image and Graphics, Vol. 1, No. 1, pp. 34-38, March 2013.

Crossref

Google Scholar

Index Terms

Development and Design of a Dancing Robot System Based on Phonetic Control and 3D Gesture Interaction
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. Robotic control
        Evolutionary robotics

Recommendations

A dancing robot for rhythmic social interaction
HRI '07: Proceedings of the ACM/IEEE international conference on Human-robot interaction

This paper describes a robotic system that uses dance as a form of social interaction to explore the properties and importance of rhythmic movement in general social interaction. The system consists of a small creature-like robot whose movement is ...
Creating an autonomous dancing robot
ICHIT '09: Proceedings of the 2009 International Conference on Hybrid Information Technology

A robot with the ability to dance autonomously has many potential applications, such as serving as a prototype dancer for choreographers or as a participant in stage performances with human dancers. A robot that dances autonomously must be able to ...
Music and Movement Based Dancing for a Non-Anthropomorphic Robot
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

The purpose of this research is to use human motion and musical features to generate dances for non-anthropomorphic robots. Many non-humanoid dancing robots are hard-coded by their choreographer/programmer. While some robots do generate dances based on ...

Comments

Information & Contributors

Information

Published In

ICCAI '23: Proceedings of the 2023 9th International Conference on Computing and Artificial Intelligence

March 2023

824 pages

ISBN:9781450399029

DOI:10.1145/3594315

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 August 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCAI 2023

ICCAI 2023: 2023 9th International Conference on Computing and Artificial Intelligence

March 17 - 20, 2023

Tianjin, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
39
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)4

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Index Terms

Recommendations

A dancing robot for rhythmic social interaction

Creating an autonomous dancing robot

Music and Movement Based Dancing for a Non-Anthropomorphic Robot

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations