skip to main content
short-paper

Example-based synthesis of three-dimensional clouds from photographs

Published: 27 June 2017 Publication History

Abstract

In this paper, we propose a modeling method of clouds from a single photograph. To synthesize realistic images of outdoor scenes, modeling of 3D clouds is necessary. However, synthesizing realistic clouds is still a difficult task. To address this problem, we propose an example-based volume texture synthesis to model nonhomogeneous density volumes. Our method prepares an example cloud volume data using a physically-based fluid simulator. Then the output cloud volume is automatically synthesized from the example cloud volume data so that its rendered image becomes similar to the clouds in the input photograph. In contrast to the previous texture synthesis methods, our method synthesizes density volumes taking into account scattering and transmittance of light. We show several cloud volumes whose rendered images are similar to the input photograph.

References

[1]
Y. Dobashi, W. Iwasaki, A. Ono, T. Yamamoto, Y. Yue, and T. Nishita. 2012. An Inverse Problem Approach for Automatically Adjusting the Parameters for Rendering Clouds Using Photographs. ACM Transactions on Graphics 31, 6 (2012), Article 145.
[2]
Y. Dobashi, K. Kusumoto, T. Nishita, and T. Yamamoto. 2008. Feedback Control of Cumuliform Cloud Formation based on Computational Fluid Dynamics. ACM Transactions on Graphics 27, 3 (2008), Article 94.
[3]
Y. Dobashi, T. Nishita, H. Yamashita, and T. Okita. 1998. Using Metaballs to Modeling and Animate Clouds from Satellite Images. The Visual Computer 15, 9 (1998), 471--482.
[4]
Y. Dobashi, Y. Shinzo, and T. Yamamoto. 2010. Modeling of Clouds from a Single Photograph. Computer Graphics Forum 29, 7 (2010), 2083--2090.
[5]
D. S. Ebert. 1997. Volumetric Modeling with Implicit Functions: A Cloud is Born. In Visual Proceedings of SIGGRAPH 1997. 147.
[6]
D. S. Ebert, F. K. Musgrave, D. Peachey, K. Perlin, and S. Worley. 2002. Texturing & modeling: a procedural approach. Morgan Kaufman.
[7]
G. Y. Gardner. 1985. Visual simulation of clouds. Computer Graphics (Proceedings of SIGGRAPH 1985) 19, 3 (1985), 297--304.
[8]
D. J. Heeger and J. R. Bergen. 1995. Pyramid-based Texture Analysis and Synthesis. In Proc. ACM SIGGRAPH 1995. 229--238.
[9]
J. T. Kajiya and B. P Von Herzen. 1984. Ray tracing volume densities. Computer Graphics (Proceedings of SIGGRAPH 1984) 18, 3 (1984), 165--174.
[10]
J. Kopf, C.-W. Fu, D. Cohen-or, O. Deussen, D. Lischinski, and T.-T. Wong. 2007. Solid Texture Synthesis from 2D Exemplars. ACM Transactions on Graphics 26, 3 (2007), Article 2.
[11]
V. Kwatra, I. Essa, and N. Kwatra A. Bobick. 2005. Texture Optimization for Example-based Texture Synthesis. ACM. Transactions on Graphics 24, 3 (2005), 795--802.
[12]
A. Levis, Y. Y. Schechner, A. Aides, and A. B. Davis. 2015. Airbone Three-Dimensional Cloud Tomography. In Proceedings of IEEE International Conference Computer Vision.
[13]
R. Miyazaki, S. Yoshida, T. Nishita, and Y. Dobashi. 2001. A Method for Modeling Clouds Based on Atmospheric Fluid Dynamics. In Proceedings of the 9th Pacific Conference on Computer Graphics and Applications. 363--372.
[14]
M. Muja and D. G. Lowe. 2014. Scalable Nearest Neighbor Algorithms for High Dimensional Data. IEEE Transactions on Pattern Analysis and Machine Intelligence 36 (2014), 2227--2240.
[15]
T. Nishita, E. Nakamae, and Y. Dobashi. 1996. Display of Clouds Taking into Account Multiple Anisotropic Scattering and Sky Light. In Proceedings of ACM SIGGRAPH 1996, Annual Conference Series. 379--386.
[16]
M. Okabe, Y. Dobashi, K. Anjyo, and R. Onai. 2015. Fluid Volume Modeling from Sparse Multi-view Images by Appearance Transfer. ACM Transactions on Graphics 34, 4 (2015), 93:1--93:10.
[17]
G. Sakas. 1993. Modeling and animating turbulent gaseous phenomena using spectral synthesis. The Visual Computer 9, 4 (1993), 200--212.
[18]
J. Schpok, J. Simons, D. S. Ebert, and C. Hansen. 2003. A real-time cloud modeling, rendering, and animation system. In Proceedings of Symposium on Computer Animation 2005. 160--166.
[19]
Y. Shu, Y. Qian, H. Sun, and Y. Chen. 2014. Efficient Texture Synthesis of Aggregate Solid Material. The Visual Computer 30, 6--8 (2014), 877--887.
[20]
R. Voss. 1983. Fourier Synthesis of Gaussian Fractals: 1/f noises, landscapes, and flakes. In SIGGRAPH'83: Tutorial on State of the Art Image Synthesis, Vol. 10.
[21]
C. Yuan, X. Liang, S. Hao, Y. Qi, and Q. Zhao. 2014. Modelling Cumulus Cloud Shape from a Single Image. Computer Graphics Forum 33, 6 (2014), 288--297.
[22]
S. Zhao, W. Jakob, S. Marschner, and K. Bala. 2012. Structure-aware Synthesis for Predictive Woven Fabric Appearance. ACM Transactions on Graphics 31, 4 (2012), 75:1--75:10.
[23]
C. Zhu, R. H. Byrd, and J. Nocedal. 1997. L-BFGS-B: Algorithm 778: L-BFGS-B, FORTRAN routines for large scale bound constrained optimization. ACM Trans. Math. Software 23, 4 (1997), 550--560.

Cited By

View all
  • (2023)STS-GANProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/196(1768-1776)Online publication date: 19-Aug-2023
  • (2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022

Index Terms

  1. Example-based synthesis of three-dimensional clouds from photographs

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CGI '17: Proceedings of the Computer Graphics International Conference
    June 2017
    260 pages
    ISBN:9781450352284
    DOI:10.1145/3095140
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. image-based modeling
    2. natural phenomena
    3. texture synthesis

    Qualifiers

    • Short-paper

    Conference

    CGI '17
    CGI '17: Computer Graphics International 2017
    June 27 - 30, 2017
    Yokohama, Japan

    Acceptance Rates

    Overall Acceptance Rate 35 of 159 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 24 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)STS-GANProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/196(1768-1776)Online publication date: 19-Aug-2023
    • (2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media