Two novel iterative approaches for improved LSPIA convergence. (English) Zbl 07873094
Summary: This paper introduces two improved variants of the least squares progressive-iterative approximation (LSPIA) by leveraging momentum techniques. Specifically, based on the Polyak’s and Nesterov’s momentum techniques, the proposed methods utilize the previous iteration information to update the control points. We name these two methods PmLSPIA and NmLSPIA, respectively. The introduction of momentum enhances the determination of the search directions, leading to a significant improvement in convergence rate. The geometric interpretations of PmLSPIA and NmLSPIA are elucidated, providing insights into the underlying principles of these accelerated algorithms. Rigorous convergence analyses are conducted, revealing that both PmLSPIA and NmLSPIA exhibit faster convergence than LSPIA. Numerical results further validate the efficacy of the proposed algorithms.
MSC:
| 65Dxx | Numerical approximation and computational geometry (primarily algorithms) |
References:
| [1] | Bo, P.; Mai, X.; Meng, W.; Zhang, C., Improving geometric iterative approximation methods using local approximations, Comput. Graph., 116, 33-45, 2023 |
| [2] | Bollapragada, R.; Chen, T.; Ward, R. A., On the fast convergence of minibatch heavy ball momentum, 2022 |
| [3] | Chang, Q.; Ma, W.; Deng, C., Constrained least square progressive and iterative approximation (CLSPIA) for B-spline curve and surface fitting, Vis. Comput., 2023 |
| [4] | Channark, S.; Kumam, P.; Martinez-Moreno, J.; Jirakitpuwapat, W., Hermitian and skew-Hermitian splitting method on a progressive-iterative approximation for least squares fitting, AIMS Math., 7, 17570-17591, 2022 |
| [5] | Deng, C.; Lin, H., Progressive and iterative approximation for least-squares B-spline curve and surface fitting, Comput. Aided Des., 47, 32-44, 2014 |
| [6] | Donghwa, K.; Jeffrey, F. A., Adaptive restart of the optimized gradient method for convex optimization, J. Optim. Theory Appl., 178, 240-263, 2018 · Zbl 1406.90093 |
| [7] | Ebrahimi, A.; Loghmani, G. B., A composite iterative procedure with fast convergence rate for the progressive iteration approximation of curves, J. Comput. Appl. Math., 359, 1-15, 2019 · Zbl 1416.65057 |
| [8] | Hamza, Y. F.; Jiang, Y.; Lin, H., Gauss-Seidel progressive and iterative approximation for least squares fitting, J. Comput.-Aided Des. Comput. Graph., 33, 1-10, 2021 |
| [9] | Hansen, P. C.; Pereyra, V.; Scherer, G., Least Squares Data Fitting with Applications, 2013, The Johns Hopkins University Press: The Johns Hopkins University Press Baltimore, Maryland USA · Zbl 1270.65008 |
| [10] | Huang, Z.; Wang, H., On a progressive and iterative approximation method with memory for least-square fitting, Comput. Aided Geom. Des., 82, Article 101931 pp., 2020 · Zbl 1450.65019 |
| [11] | Lan, L.; Ji, Y.; Wang, M.; Zhu, C., Full-LSPIA: a least-squares progressive-iterative approximation method with optimization of weights and knots for NURBS curves and surfaces, Comput. Aided Des., 169, Article 103673 pp., 2024 |
| [12] | Lin, H., Adaptive data fitting by the progressive-iterative approximation, Comput. Aided Geom. Des., 29, 463-473, 2012 · Zbl 1250.65021 |
| [13] | Lin, H.; Cao, Q.; Zhang, X., The convergence of least-squares progressive iterative approximation for singular least-squares fitting system, J. Syst. Sci. Complex., 31, 1618-1632, 2018 · Zbl 1486.68168 |
| [14] | Lin, H.; Maekawa, T.; Deng, C., Survey on geometric iterative methods and their applications, Comput. Aided Des., 95, 40-51, 2018 |
| [15] | Lin, H.; Zhang, Z., An efficient method for fitting large data sets using T-splines, SIAM J. Sci. Comput., 35, A3052-A3068, 2013 · Zbl 1285.65008 |
| [16] | Liu, M.; Li, B.; Guo, Q.; Zhu, C.; Hu, P.; Shao, Y., Progressive iterative approximation for regularized least-square bivariate B-spline surface fitting, J. Comput. Appl. Math., 327, 175-187, 2018 · Zbl 1371.41012 |
| [17] | Liu, Y.; Wang, W., A revisit to least squares orthogonal distance fitting of parametric curves and surfaces, (Advances in Geometric Modeling and Processing: 5th International Conference, 2008), 384-397 |
| [18] | Pereyr, V.; Scherer, G., Large scale least squares scattered data fitting, Appl. Numer. Math., 44, 225-239, 2003 · Zbl 1013.65010 |
| [19] | Rios, D.; Jüttler, B., LSPIA, (stochastic) gradient descent, and parameter correction, J. Comput. Appl. Math., 406, Article 113921 pp., 2022 · Zbl 1482.65024 |
| [20] | Ruder, S., An overview of gradient descent optimization algorithms, 2016 |
| [21] | Sajavicius, S., Hyperpower least squares progressive iterative approximation, J. Comput. Appl. Math., 422, Article 114888 pp., 2023 · Zbl 1524.65176 |
| [22] | Wang, H., On extended progressive and iterative approximation for least-squares fitting, Vis. Comput., 38, 591-602, 2022 |
| [23] | Zhang, L.; Tan, J.; Ge, X.; Zheng, G., Generalized B-splines’ geometric iterative fitting method with mutually different weights, J. Comput. Appl. Math., 329, 331-343, 2017 · Zbl 1376.65014 |
| [24] | Zheng, W.; Bo, P.; Liu, Y.; Wang, W., Fast B-spline curve fitting by L-BFGS, Comput. Aided Geom. Des., 29, 448-462, 2012 · Zbl 1250.65022 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
