×

A new LAD curve-fitting algorithm: Slightly overdetermined equation systems in \(L_ 1\). (English) Zbl 0532.65005

Given n points \((x_ i,y_ i)\in R^{k+1}\), the least absolute deviation (LAD) curve-fitting problem is to minimize \(f(c)=\sum^{n}_{i=1}| y_ i-\sum^{k}_{j=1}x_{ij}c_ j|\) over \(c\in R^ k\), where \(x_{ij}\) is the j-th component of the vector \(x_ i\) and \(c_ j\) is the j-th component of the vector c. The authors propose a new procedure for solving this well-known problem when \(k\leq n\). The LAD curve-fitting problem is first converted into an equivalent minimization problem with linear equality constraints and then an algorithm is designed to solve the latter problem which becomes easier to solve as k grows towards n. The procedure is demonstrated by a simple example, and computational experience is recorded.
Reviewer: J.Parida

MSC:

65D10 Numerical smoothing, curve fitting
41A45 Approximation by arbitrary linear expressions
90C90 Applications of mathematical programming

Software:

Algorithm 478
Full Text: DOI

References:

[1] Abdelmalek, N. N., Linear \(L_1\) approximation for a discrete point set and \(L_1\) solutions of overdetermined equations, J. ACM, 18, 41-47 (1971) · Zbl 0217.21303
[2] Anderson, D.; Steiger, W. L., A comparison of methods for discrete \(L_1\) curve fitting (1980), Department of Computer Science Technical Report, No. 96, Rutgers University
[3] Barrodale, I.; Roberts, F. D.K., An improved algorithm for discrete \(L_1\) linear approximation, SIAM J. Numer. Anal., 10, 839-848 (1973) · Zbl 0266.65016
[4] Barrodale, I.; Roberts, F. D.K., Algorithm 478: Solution of an overdetermined system of equations in the \(L_1\) norm, Comm. ACM, 14, 319-320 (1974)
[5] Bartels, R.; Conn, A.; Sinclair, James W., Minimization techniques for piecewise differentiable functions: The \(L_1\) solution to an overdetermined systems, SIAM J. Numer. Anal., 15, 224-241 (1978) · Zbl 0376.65018
[6] Bloomfield, P.; Steiger, W. L., Least absolute deviations curve-fitting, SIAM J. Scientific and Statistical Comp., 1, 290-301 (1980) · Zbl 0471.65007
[7] Charnes, A.; Cooper, W. W.; Ferguson, R. O., Optimal estimation of executive compensation by linear programming, Management Sci., 1, 138-151 (1955) · Zbl 0995.90590
[8] Claerbaut, Jon; Muir, Francis, Robust modeling with erratic data, Geophysics, 38, 826-844 (1973)
[9] Edgeworth, F. Y., A new method of reducing observations relating to several quantities, Phil. Mag. (Fifth Series), 24, 222-223 (1887)
[10] Edgeworth, F. Y., On a new method of reducing observations relating to several quantities, Phil. Mag. (Fifth Series), 25, 184-191 (1988) · JFM 20.0219.01
[11] Eisenhart, C., Boscovich and the combination of observations, (Whyte, L. L. (1961), Fordham University Press: Fordham University Press New York), Roger Joseph Boscovich
[12] Harris, T., Regression using minimum absolute deviations, Amer. Statistician, 4, 14-15 (1950)
[13] Karst, Otto J., Linear curve fitting using least deviations, J. Amer. Stat. Assoc., 53, 118-132 (1958) · Zbl 0080.13402
[14] McCormick, G. F.; Sposito, V. A., Using the \(L_2\) estimator in \(L_1\) estimation, SIAM J. Numer. Anal., 13, 337-343 (1976) · Zbl 0327.65012
[15] Rhodes, E. C., Reducing observations by the method of minimum deviations, Phil. Mag. (Seventh Series), 9, 974-992 (1930) · JFM 56.0477.01
[16] Robers, P.; ben Israel, A., A suboptimization method for interval linear programming: A new method for linear programming, Linear Algebra Appl., 3, 383-405 (1970) · Zbl 0215.58806
[17] Schlossmacher, E. J., An iterative technique for absolute deviations curve fitting, J. Amer. Stat. Assoc., 68, 857-865 (1973) · Zbl 0287.62038
[18] Seneta, EE., On a contribution of Cauchy to linear regression theory, Ann. de la Société Scientifique de Bruxelles, 90, 229-235 (1976) · Zbl 0341.62050
[19] Sheynin, O. B., R.J. Boscovich’s work on probability, Archive for History of Exact Sciences, 9, 306-324 (1973) · Zbl 0263.01018
[20] Singleton, R. R., A method for minimizing the sum of absolute values of deviations, Ann. Math. Stat., 11, 301-310 (1940) · Zbl 0023.34403
[21] Steiger, W. L., Linear programming via discrete \(L_1\) curve fitting, (Dept. of Computer Science Technical Report (1980), Rutgers University), No. 97
[22] Usow, K. H., On \(L_1\) approximation II: Computation for discrete functions and discretization effects, SIAM J. Numer. Anal., 4, 233-244 (1967) · Zbl 0166.41902
[23] Wagner, Harvey M., Linear programming techniques for regression analysis, J. Amer. Stat. Assoc., 54, 206-212 (1959) · Zbl 0088.35702
[24] Goldfarb, D.; Reid, J. K., A practicable steepest-edge simplex algorithm, Math. Programming, 12, 361-371 (1977) · Zbl 0443.90058
[25] Bloomfield, P.; Steiger, W. L., Least Absolute Deviations: Theory, Applications, and Algorithms (1983), Birkhauser: Birkhauser Boston, MA · Zbl 0536.62049
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.