×

Multigrid solution of the optical flow system using a combined diffusion- and curvature-based regularizer. (English) Zbl 1212.65366

The paper describes an approach to combine a diffusion-based regularizer normally used for optical flow problems, with a curvature-based regularizer used for image registration problems. Both problems are defined on a time-sequence of images, i.e., on \(\Omega \times \mathbb {T}\), where \(\Omega \subset \mathbb {R}^2\) represents a space of images, and time \(t\in \mathbb {T}=[0,t_{max}]\), \(t,t_{max}\in \mathbb {N}\). The combined regularizer allows to handle both problems with the same solver. The authors note, however, that one can not expect to achieve the same accuracy using this generalized approach, as it is obtained, e.g., in very accurate optical models with advanced data term. The resulting system of fourth-order partial differential equations is discretized using the standard five-point finite difference scheme. The system of linear equations is solved using the mutligrid method. The authors present some convergence rates, timing and investigate the visual quality of the obtained motion or deformation field for academic as well as real-world images. A discussion about possible generalizations concludes the paper.

MSC:

65M55 Multigrid methods; domain decomposition for initial value and initial-boundary value problems involving PDEs
68U10 Computing methodologies for image processing
Full Text: DOI

References:

[1] Horn, Artificial Intelligence 17 pp 185– (1981)
[2] Robot Vision. MIT Press: Cambridge, MA, U.S.A., 1986.
[3] Nagel, IEEE Transactions on Pattern Analysis and Machine Intelligence 8 pp 565– (1986)
[4] , , , . Recovering motion fields: an evaluation of eight optical flow algorithms. British Machine Vision Conference, Southampton, 1998.
[5] Verri, IEEE Transactions on Pattern Analysis and Machine Intelligence 11 pp 490– (1989)
[6] Haussecker, IEEE Transactions on Pattern Analysis and Machine Intelligence 23 pp 661– (2001)
[7] Weickert, International Journal of Computer Vision 45 pp 245– (2001) · Zbl 0988.35070
[8] Weickert, Journal of Mathematical Imaging and Vision 14 pp 245– (2001)
[9] . Nonlinear matrix diffusion for optic flow estimation. In Pattern Recognition, (ed.). Lecture Notes in Computer Science, vol. 2449. Springer: Berlin, 2002; 446–453. · Zbl 1017.68598
[10] Motion estimation and vector splines. Proceedings of the Conference on Computer Vision and Pattern Recognition, Los Alamos, U.S.A., 1994; 939–948.
[11] Gupta, IEEE Signal Processing Letters 3 pp 32– (1996)
[12] Corpetti, IEEE Transactions on Pattern Analysis and Machine Intelligence 24 pp 365– (2002)
[13] , . Variational dense motion estimation using the Helmholtz decomposition. In Fourth International Conference on Scale Space Methods in Computer Vision, (eds), Isle of Skye, U.K. Lecture Notes in Computer Science, vol. 2695. Springer: Berlin, 2003; 432–448. · Zbl 1067.68748
[14] Corpetti, Experiments in Fluids 40 pp 80– (2006)
[15] Numerical Methods for Image Registration. Oxford University Press: Oxford, 2004. · Zbl 1055.68140
[16] Fischer, Journal of Mathematical Imaging and Vision 18 pp 81– (2003)
[17] , , . Enhanced motion Blur calculation with optical flow. Proceedings of Vision, Modeling and Visualization, RWTH Aachen, Germany. Aka GmbH, IOS Press: Berlin, 2006; 253–260.
[18] Fischer, PAMM 3 pp 32– (2003)
[19] , , , , . Towards PDE-based image compression. Proceedings of Variational, Geometric, and Level Set Methods in Computer Vision. Lecture Notes in Computer Science. Springer: Berlin, Heidelberg, New York, 2005; 37–48.
[20] Papenberg, International Journal of Computer Vision 67 pp 141– (2006)
[21] Multilevel relaxation in low-level computer vision. In Multi-Resolution Image Processing and Analysis, (ed.). Springer: Berlin, 1984; 312–330. · doi:10.1007/978-3-642-51590-3_18
[22] Terzopoulos, IEEE Transactions on Pattern Analysis and Machine Intelligence 8 pp 129– (1986)
[23] Enkelmann, Computer Vision, Graphics, and Image Processing 43 pp 150– (1988)
[24] Battiti, International Journal of Computer Vision 6 pp 133– (1991)
[25] . A variational multigrid for computing the optical flow. In Vision, Modeling and Visualization, , , , , , (eds). Akademische Verlagsgesellschaft: Berlin, 2003; 577–584.
[26] Kalmoun, Image and Vision Computing 25 pp 1482– (2007)
[27] , . Robust and efficient multigrid techniques for the optical flow problem using different regularizers. In Proceedings of 18th Symposium Simulations Technique ASIM 2005, , (eds), Frontiers in Simulation, vol. 15. SCS Publishing House: Erlangen, 2005; 341–346. Preprint version published as Technical Report 05-6.
[28] Variational optic flow computation: accurate modeling and efficient numerics. Ph.D. Thesis, Department of Mathematics and Computer Science, Saarland University, Saarbrücken, Germany, 2006.
[29] Bruhn, International Journal of Computer Vision 70 pp 257– (2006)
[30] Haber, SIAM Journal on Scientific Computing 27 pp 1594– (2006)
[31] Henn, SIAM Journal on Scientific Computing 27 pp 831– (2005)
[32] Hömke, Numerical Linear Algebra with Applications 13 pp 215– (2006)
[33] Multi-grid Methods and Applications. Springer: Berlin, Heidelberg, New York, 1985. · Zbl 0595.65106 · doi:10.1007/978-3-662-02427-0
[34] Keeling, Applied Mathematics and Computation 184 pp 536– (2007)
[35] Multigrid techniques: 1984 guide with applications to fluid dynamics. GMD-Studie Nr. 85, Sankt Augustin, West Germany, 1984.
[36] , . Multigrid. Academic Press: San Diego, CA, U.S.A., 2001.
[37] . Practical Fourier analysis for multigrid methods. In Numerical Insights, vol. 5. Chapman & Hall/CRC Press: Boca Raton, FL, U.S.A., 2005.
[38] , . A Multigrid Tutorial (2nd edn). SIAM: Philadelphia, PA, U.S.A., 2000. · Zbl 0958.65128 · doi:10.1137/1.9780898719505
[39] Multigrid Methods. Edwards: Philadelphia, PA, U.S.A., 2004.
[40] McCane, Computer Vision and Image Understanding 84 pp 126– (2001)
[41] Douglas, Electronic Transactions on Numerical Analysis 10 pp 21– (2000)
[42] , , . Parallel geometric multigrid. In Numerical Solution of Partial Differential Equations on Parallel Computers, Chapter 5, (eds), Lecture Notes in Computational Science and Engineering, vol. 51. Springer: Berlin, Heidelberg, New York, 2005; 165–208. · Zbl 1097.65123
[43] Barron, International Journal of Computer Vision 12 pp 43– (1994)
[44] Heeger, Journal of the Optical Society of America A: Optics, Image Science, and Vision 4 pp 1455– (1987)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.