Abstract
Dynamic texture can be defined as a temporally continuous and infinitely varying stream of images that exhibit certain temporal statistics. Linear dynamic system (LDS) represented by the state-space equation has been proposed to model dynamic texture [12]. LDS can be used to synthesize dynamic texture by sampling the system noise. However, the visual quality of the synthesized dynamic texture using noise-driven LDS is often unsatisfactory. In this paper, we regard the noise-driven LDS as an open-loop control system and analyze its stability through its pole placement. We show that the noise-driven LDS can produce good quality dynamic texture if the LDS is oscillatory. To deal with an LDS not oscillatory, we present a novel approach, called closed-loop LDS (CLDS) where feedback control is introduced into the system. Using the succeeding hidden states as an input reference signal, we design a feedback controller based on the difference between the current state and the reference state. An iterative algorithm is proposed to generate dynamic textures. Experimental results demonstrate that CLDS can produce dynamic texture sequences with promising visual quality.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., Werman, M.: Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 120–135 (2001)
Doretto, G., Chiuso, A., Wu, Y.N., Soatto, S.: Dynamic Textures. International Journal of Computer Vision 2, 91–109 (2003)
Doretto, G., Cremers, D., Favaro, P., Soatto, S.: Dynamic Texture Segmentation. In: Proceedings of ICCV 2003, pp. 1236–1242 (2003)
Doretto, G., Soatto, S.: Editable Dynamic Textures. In: Proceedings of CVPR 2003, pp. 137–142 (2003)
Fitzgibbon, W.: Stochastic rigidity: Image registration for nowhere-static scenes. In: Proceedings of ICCV 2001, vol. 1, pp. 662–670 (2001)
Franklin, G.F., Powell, J.D., Emami-Naeini, A.: Feedback Control of Dynamic Systems, 4th edn., pp. 201–252, pp. 706-797. Prentice Hall, Englewood Cliffs (2002)
Kuo, B.C.: Automatic Control Systems, 6th edn., pp. 5–15. Prentice-Hall, Englewood Cliffs (1991)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In: Proceedings of Siggraph 2003, pp. 277–286 (2003)
Ljung, L.: System Identification – Theory for the User, 2nd edn. Prentice Hall, Englewood Cliffs (1999)
Saisan, P., Doretto, G., Wu, Y.N., Soatto, S.: Dynamic Texture Recognition. In: Proceedings of CVPR 2001, vol. 2, pp. 58–63 (2001)
Schödl, R., Szeliski, D.H.: Video Textures. In: Proceedings of Siggraph 2000, pp. 489–498 (2000)
Soatto, S., Doretto, G., Wu, Y.N.: Dynamic textures. In: Proceedings of ICCV 2001, vol. 2, pp. 439–446 (2001)
Szummer, M., Picard, R.W.: Temporal Texture Modeling. In: IEEE International Conference on Image Processing, vol. 3, pp. 823–826 (1996)
Wang, Y.Z., Zhu, S.C.: A Generative Method for Textured Motion: Analysis and Synthesis. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 583–597. Springer, Heidelberg (2002)
Wei, L.Y., Levoy, M.: Fast Texture Synthesis using Tree-structured Vector Quantization. In: Proceedings of Siggraph 2000, pp. 479–488 (2000)
Wei, W.W.S.: Time Series Analysis: Univariate and Multivariate Methods. Addison-Wesley, New York (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yuan, L., Wen, F., Liu, C., Shum, HY. (2004). Synthesizing Dynamic Texture with Closed-Loop Linear Dynamic System. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24671-8_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-24671-8_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21983-5
Online ISBN: 978-3-540-24671-8
eBook Packages: Springer Book Archive