Abstract
An Internet-based media service platform can control recording processes and manage video and audio data. Furthermore, the design and implementation of an object-based system for recording enable the flexible playback of the viewing contents. Augmented Reality (AR) is a three-dimensional video projection technology. However, there are few examples of its use as a method for audio-visual media platforms. In this study, we propose Co-Sound, which is designed as a multimodal interface that renders object-based AR dynamically in response to various actions from viewers on a web browser by sharing AR objects among multiple devices in real time. We confirmed that the system was developed as an object-based interactive medium with AR, achieved the general acceptance of the system was very high through a questionnaire survey, and low-latency synchronization to accept operations from multiple users in real time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
https://github.com/jeromeetienne/AR.js (Accessed on 01/05/2020).
- 2.
https://aframe.io/blog/arjs/ (Accessed on 01/05/2020).
- 3.
https://threejs.org/ (Accessed on 01/05/2020).
- 4.
https://github.com/skyway/skyway-js-sdk (Accessed on 01/05/2020).
References
Fenu, C., Pittarello, F.: Svevo tour: the design and the experimentation of an augmented reality application for engaging visitors of a literary museum. Int. J. Hum Comput Stud. 114, 20–35 (2018)
Fiala, M.: Artag, a fiducial marker system using digital techniques, vol. 2, pp. 590–596, July 2005
Rec, I.T.U.R.: Itu-r bs 2051–0 (02/2014): Advanced Sound System For Programme Production. Int. Telecommun. Union, Geneva, Swizerland (2014)
Jarschel, M., Schlosser, D., Scheuring, S., Hoßfeld, T.: An evaluation of QoE in cloud gaming based on subjective tests. In: 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, pp. 330–335 (2011)
Kasuya, T., et al.: Livration: Remote VR live platform with interactive 3d audio-visual service. In: IEEE Games Entertainment & Media Conference (IEEE GEM) 2019, pp. 1–7. Yale University, New Haven, CT, U.S. (2019)
Kato, S., Ikeda, T., Kawamorita, M., Tsukada, M., Esaki, H.: Web360\(^2\): an interactive web application for viewing 3D Audio-visual Contents. In: 17th Sound and Music Computing Conference (SMC). Torino, Italy (2020)
Santos-González, I., Rivero-García, A., González-Barroso, T., Molina-Gil, J., Caballero-Gil, P.: Real-time streaming: a comparative study between RTSP and WebRTC. In: García, C.R., Caballero-Gil, P., Burmester, M., Quesada-Arencibia, A. (eds.) UCAmI/IWAAL/AmIHEALTH -2016. LNCS, vol. 10070, pp. 313–325. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48799-1_36
Silzle, A., Sazdov, R., Weitnauer, M.: The EU Project ORPHEUS: Object-Based Broadcasting-For Next Generation Audio Experiences. In: The 29th Tonmeistertagung -VDT International Convention, January 2016
Tillon, A.B., Marchal, I., Houlier, P.: Mobile augmented reality in the museum: can a lace-like technology take you closer to works of art? In: 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities, pp. 41–47, October 2011
Tsukada, M., et al.: Software defined media: virtualization of audio-visual services. In: 2017 IEEE International Conference on Communications (ICC), pp. 1–7 (2017)
Vlahovic, S., Suznjevic, M., Skorin-Kapov, L.: Challenges in assessing network latency impact on QoE and in-game performance in VR first person shooter games. In: 2019 15th International Conference on Telecommunications (ConTEL), pp. 1–8, July 2019
Yu, N., Yukio, T., Sone, T.: Study and experiment of recognition of the delay in musical performance with delay. IPSJ SIG Technical Reports 53, pp. 37–42, December 2003
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 IFIP International Federation for Information Processing
About this paper
Cite this paper
Inokuchi, K., Tsukada, M., Esaki, H. (2020). Co-sound: An Interactive Medium with WebAR and Spatial Synchronization. In: Nunes, N.J., Ma, L., Wang, M., Correia, N., Pan, Z. (eds) Entertainment Computing – ICEC 2020. ICEC 2020. Lecture Notes in Computer Science(), vol 12523. Springer, Cham. https://doi.org/10.1007/978-3-030-65736-9_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-65736-9_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-65735-2
Online ISBN: 978-3-030-65736-9
eBook Packages: Computer ScienceComputer Science (R0)
