skip to main content
research-article
Public Access

Psychoacoustic Characterization of Propagation Effects in Virtual Environments

Published: 29 July 2016 Publication History

Abstract

As sound propagation algorithms become faster and more accurate, the question arises as to whether the additional efforts to improve fidelity actually offer perceptual benefits over existing techniques. Could environmental sound effects go the way of music, where lower-fidelity compressed versions are actually favored by listeners? Here we address this issue with two acoustic phenomena that are known to have perceptual effects on humans and that, accordingly, might be expected to heighten their experience with simulated environments. We present two studies comparing listeners’ perceptual response to both accurate and approximate algorithms simulating two key acoustic effects: diffraction and reverberation. For each effect, we evaluate whether increased numerical accuracy of a propagation algorithm translates into increased perceptual differentiation in interactive virtual environments. Our results suggest that auditory perception does benefit from the increased accuracy, with subjects showing better perceptual differentiation when experiencing the more accurate rendering method: the diffraction experiment shows a more linearly decaying sound field (with respect to the diffraction angle) for the accurate diffraction method, whereas the reverberation experiment shows that more accurate reverberation, after modest user experience, results in near-logarithmic response to increasing room volume.

Supplementary Material

rungta (rungta.zip)
Supplemental movie and image files for, Psychoacoustic Characterization of Propagation Effects in Virtual Environments

References

[1]
Jont B. Allen and David A. Berkley. 1979. Image method for efficiently simulating small-room acoustics. Journal of the Acoustical Society of America 65, 4, 943--950.
[2]
Lakulish Antani, Anish Chandak, Micah Taylor, and Dinesh Manocha. 2012. Efficient finite-edge diffraction using conservative from-region visibility. Applied Acoustics 73, 3, 218--233.
[3]
Durand R. Begault. 1992. Perceptual effects of synthetic reverberation on three-dimensional audio systems. Journal of the Audio Engineering Society 40, 11, 895--904.
[4]
Durand R. Begault. 1994. 3-D Sound for Virtual Reality and Multimedia. Academic Press, Cambridge, MA.
[5]
Jean-Pierre Berenger. 1994. A perfectly matched layer for the absorption of electromagnetic waves. Journal of Computational Physics 114, 2, 185--200.
[6]
Maurice Anthony Biot and Ivan Tolstoy. 1957. Formulation of wave propagation in infinite media by normal coordinates with an application to diffraction. Journal of the Acoustical Society of America 29, 3, 381--391.
[7]
Jeffrey Borish. 1984. Extension of the image model to arbitrary polyhedra. Journal of the Acoustical Society of America 75, 6, 1827--1836.
[8]
Densil Cabrera, Daeup Jeong, Hyun Jeong Kwak, Ji-Young Kim, and Jeonju Duckjin-Gu. 2005. Auditory room size perception for modeled and measured rooms. In Proceedings of the 2005 Congress and Exposition on Noise Control Engineering (InterNoise’05).
[9]
Anish Chandak, Christian Lauterbach, Micah Taylor, Zhimin Ren, and Dinesh Manocha. 2008. Ad-frustum: Adaptive frustum tracing for interactive sound propagation. IEEE Transactions on Visualization and Computer Graphics 14, 6, 1707--1722.
[10]
Alexander H.-D. Cheng and Daisy T. Cheng. 2005. Heritage and early history of the boundary element method. Engineering Analysis with Boundary Elements 29, 3, 268--302.
[11]
Dezhang Chu, Timothy K. Stanton, and Allan D. Pierce. 2007. Higher-order acoustic diffraction by edges of finite thickness. Journal of the Acoustical Society of America 122, 6, 3177--3194.
[12]
Thomas Djelani and Jens Blauert. 2001. Investigations into the build-up and breakdown of the precedence effect. Acta Acustica United with Acustica 87, 2, 253--261.
[13]
Hugo Fastl and Eberhard Zwicker. 2007. Psychoacoustics: Facts and Models. Vol. 22. Springer Science and Business Media.
[14]
Thomas Funkhouser, Nicolas Tsingos, Ingrid Carlbom, Gary Elko, Mohan Sondhi, James E. West, Gopal Pingali, Patrick Min, and Addy Ngan. 2004. A beam tracing method for interactive architectural acoustics. Journal of the Acoustical Society of America 115, 2, 739--756.
[15]
Jason A. Galster. 2007. The Effect of Room Volume on Speech Recognition in Enclosures with Similar Mean Reverberation Time. Ph.D. Dissertation. Vanderbilt University, Nashville, TN.
[16]
Christian Giguère and Sharon M. Abel. 1993. Sound localization: Effects of reverberation time, speaker array, stimulus frequency, and stimulus rise/decay. Journal of the Acoustical Society of America 94, 2, 769--776.
[17]
Helmut Haas. 1951. Über den Einfluβ eines Einfachechos auf die Hörsamkeit von Sprache. Acta Acustica United with Acustica 1, 2, 49--58.
[18]
Sharaf Hameed, Jyri Pakarinen, Kari Valde, and Ville Pulkki. 2004. Psychoacoustic cues in room size perception. In Proceedings of the 116th Audio Engineering Society Convention.
[19]
William M. Hartmann. 1983. Localization of sound in rooms. Journal of the Acoustical Society of America 74, 5, 1380--1391.
[20]
Jean-Marc Jot and Antoine Chaigne. 1991. Digital delay networks for designing artificial reverberators. In Proceedings of the 90th Audio Engineering Society Convention.
[21]
T. Kawai. 1981. Sound diffraction by a many-sided barrier or pillar. Journal of Sound and Vibration 79, 2, 229--242.
[22]
Vern Oliver Knudsen. 1932. Architectural Acoustics. John Wiley & Sons.
[23]
Robert G. Kouyoumjian and Prabhakar H. Pathak. 1974. A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface. Proceedings of the IEEE 62, 11, 1448--1461.
[24]
A. Krokstad, S. Strom, and S. Sørsdal. 1968. Calculating the acoustical room response by the use of a ray tracing technique. Journal of Sound and Vibration 8, 1, 118--125.
[25]
Heinrich Kuttruff. 2007. Acoustics: An Introduction. CRC Press, Boca Raton, FL.
[26]
Pontus Larsson, Daniel Vastfjall, and Mendel Kleiner. 2002. Better presence and performance in virtual environments by improved binaural sound rendering. In Proceedings of the 22nd International Audio Engineering Society Conference: Virtual, Synthetic, and Entertainment Audio.
[27]
Christian Lauterbach, Anish Chandak, and Dinesh Manocha. 2007. Interactive sound rendering in complex and dynamic scenes using frustum tracing. IEEE Transactions on Visualization and Computer Graphics 13, 6, 1672--1679.
[28]
Ravish Mehra, Nikunj Raghuvanshi, Lakulish Antani, Anish Chandak, Sean Curtis, and Dinesh Manocha. 2013. Wave-based sound propagation in large open scenes using an equivalent source formulation. ACM Transactions on Graphics 32, 2, 19.
[29]
Ravish Mehra, Nikunj Raghuvanshi, Lauri Savioja, Ming C. Lin, and Dinesh Manocha. 2012. An efficient GPU-based time domain solver for the acoustic wave equation. Applied Acoustics 73, 2, 83--94.
[30]
Ravish Mehra, Atul Rungta, Abhinav Golas, Ming Lin, and Dinesh Manocha. 2015. WAVE: Interactive wave-based sound propagation for virtual environments. IEEE Transactions on Visualization and Computer Graphics 21, 4, 434--442.
[31]
Nicolas Morales, Ravish Mehra, and Dinesh Manocha. 2015. A parallel time-domain wave simulator based on rectangular decomposition for distributed memory architectures. Applied Acoustics 97, 104--114.
[32]
Claudiu B. Pop and Densil Cabrera. 2005. Auditory room size perception for real rooms. In Proceedings of the Australian Acoustical Society Conference.
[33]
Nikunj Raghuvanshi, Rahul Narain, and Ming C. Lin. 2009. Efficient and accurate sound propagation using adaptive rectangular decomposition. IEEE Transactions on Visualization and Computer Graphics 15, 5, 789--801.
[34]
B. Rakerd and W. M. Hartmann. 1985. Localization of sound in rooms, II: The effects of a single reflecting surface. Journal of the Acoustical Society of America 78, 2, 524--533.
[35]
Carl Schissler and Dinesh Manocha. 2016. Adaptive impulse response modeling for interactive sound propagation. In Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM, New York, NY, 71--78.
[36]
Carl Schissler, Ravish Mehra, and Dinesh Manocha. 2014. High-order diffraction and diffuse reflections for interactive sound propagation in large environments. ACM Transactions on Graphics 33, 4, 39.
[37]
Manfred R. Schroeder. 1962. Natural sounding artificial reverberation. Journal of the Audio Engineering Society 10, 3, 219--223.
[38]
Micah Taylor, Anish Chandak, Qi Mo, Christian Lauterbach, Carl Schissler, and Dinesh Manocha. 2012. Guided multiview ray tracing for fast auralization. IEEE Transactions on Visualization and Computer Graphics 18, 11, 1797--1810.
[39]
Micah T. Taylor, Anish Chandak, Lakulish Antani, and Dinesh Manocha. 2009. RESound: Interactive sound rendering for dynamic virtual environments. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, New York, NY, 271--280.
[40]
R. R. Torres, M. Kleiner, U. P. Svensson, and B. I. Dalenbäck. 2001a. Edge diffraction and surface scattering in auralization. In Proceedings of SIGGRAPH Campfire.
[41]
Rendell R. Torres and Mendel Kleiner. 1998. Audibility of edge diffraction in auralization of a stage house. Journal of the Acoustical Society of America 103, 5, 2789--2789.
[42]
Rendell R. Torres, U. Peter Svensson, and Mendel Kleiner. 2001b. Computation of edge diffraction for more accurate room acoustics auralization. Journal of the Acoustical Society of America 109, 2, 600--610.
[43]
Nicolas Tsingos, Thomas Funkhouser, Addy Ngan, and Ingrid Carlbom. 2001. Modeling acoustics in virtual environments using the uniform theory of diffraction. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM, New York, NY, 545--552.
[44]
Michael Vorländer. 1989. Simulation of the transient and steady-state sound propagation in rooms using a new combined ray-tracing/image-source algorithm. Journal of the Acoustical Society of America 86, 1, 172--178.
[45]
Craig Webb and Alan Gray. 2013. Large-scale virtual acoustics simulation at audio rates using three dimensional finite difference time domain and multiple graphics processing units. In Proceedings of Meetings on Acoustics, Vol. 19.
[46]
J. Wolfe, D. Levi, K. Kluender, L. Bartoshuk, R. Herz, R. Klatzky, S. Lederman, and D. M. Merfeld. 2014. Sensation and Perception (4th ed.). Sinauer Associates, Sunderland, MA.
[47]
Kane S. Yee. 1966. Numerical solution of initial boundary value problems involving Maxwell’s equations in isotropic media. IEEE Transactions on Antennas and Propagation 14, 3, 302--307.
[48]
Cecilia Maria Zannini, Raffaele Parisi, and Aurelio Uncini. 2011. Binaural sound source localization in the presence of reverberation. In Proceedings of the 2011 17th International Conference on Digital Signal Processing (DSP’11). IEEE, Los Alamitos, CA, 1--6.
[49]
Olek C. Zienkiewicz. 2005. The Finite Element Method for Fluid Dynamics. Ph.D. Dissertation. University of Wales.
[50]
J. J. Zwislocki and D. A. Goodman. 1980. Absolute scaling of sensory magnitudes: A validation. Perception and Psychophysics 28, 1, 28--38.

Cited By

View all
  • (2023)A Psychoacoustic Quality Criterion for Path-Traced Sound PropagationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321351429:12(5422-5433)Online publication date: 1-Dec-2023
  • (2022)Sound Synthesis, Propagation, and RenderingSynthesis Lectures on Visual Computing10.2200/S01162ED1V01Y202201VCP03311:2(1-110)Online publication date: 24-Mar-2022
  • (2018)Diffraction Kernels for Interactive Sound Propagation in Dynamic EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.279409824:4(1613-1622)Online publication date: 1-Apr-2018
  • Show More Cited By

Index Terms

  1. Psychoacoustic Characterization of Propagation Effects in Virtual Environments

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Applied Perception
    ACM Transactions on Applied Perception  Volume 13, Issue 4
    Special Issue SAP 2016
    July 2016
    71 pages
    ISSN:1544-3558
    EISSN:1544-3965
    DOI:10.1145/2974016
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 July 2016
    Accepted: 01 May 2016
    Received: 01 May 2016
    Published in TAP Volume 13, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Auditory perception
    2. virtual environments/reality

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)91
    • Downloads (Last 6 weeks)24
    Reflects downloads up to 19 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)A Psychoacoustic Quality Criterion for Path-Traced Sound PropagationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321351429:12(5422-5433)Online publication date: 1-Dec-2023
    • (2022)Sound Synthesis, Propagation, and RenderingSynthesis Lectures on Visual Computing10.2200/S01162ED1V01Y202201VCP03311:2(1-110)Online publication date: 24-Mar-2022
    • (2018)Diffraction Kernels for Interactive Sound Propagation in Dynamic EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.279409824:4(1613-1622)Online publication date: 1-Apr-2018
    • (2018)Optimizing source placement for noise minimization using hybrid acoustic simulationComputer-Aided Design10.1016/j.cad.2017.09.00796(1-12)Online publication date: Mar-2018
    • (2017)The Plausibility of a String Quartet Performance in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265713823:4(1352-1359)Online publication date: 1-Apr-2017

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media