×

A simple new algorithm for quadratic programming with applications in statistics. (English) Zbl 1347.62013

Summary: Problems involving estimation and inference under linear inequality constraints arise often in statistical modeling. In this article, we propose an algorithm to solve the quadratic programming problem of minimizing \(\psi (\theta)=\theta^{\prime}\mathcal Q\theta -2c^{\prime}\theta\) for positive definite Q, where \(\theta\) is constrained to be in a closed polyhedral convex cone \(\mathcal C =\{\theta :A\theta \geq d\}\), and the \(m \times n\) matrix \(A\) is not necessarily full row rank. The three-step algorithm is intuitive and easy to code. Code is provided in the R programming language.

MSC:

62-04 Software, source code, etc. for problems pertaining to statistics
62J02 General nonlinear regression
62G05 Nonparametric estimation
90C20 Quadratic programming

Software:

R; SemiPar; coneproj
Full Text: DOI

References:

[1] DOI: 10.1214/aoms/1177728420 · Zbl 0066.38503 · doi:10.1214/aoms/1177728420
[2] de Boor C., A Practical Guide to Splines. Rev. ed (2001) · Zbl 0987.65015
[3] DOI: 10.1080/01621459.1983.10477029 · doi:10.1080/01621459.1983.10477029
[4] Fang S. C., Linear Optimization and Extensions. Theory and Algorithms (1993)
[5] Fraser D. A. S., Scandinavian Journal of Statistics 16 pp 65– (1989)
[6] DOI: 10.1007/BF02591962 · Zbl 0537.90081 · doi:10.1007/BF02591962
[7] DOI: 10.2307/1912529 · Zbl 0483.62058 · doi:10.2307/1912529
[8] Gourieroux C., Statistics and Econometric Models (1995) · Zbl 0870.62088 · doi:10.1017/CBO9780511751950
[9] Grömping U., Journal of Statistical Software 33 (10) pp 1– (2010) · doi:10.18637/jss.v033.i10
[10] Hawkins D. M., Computational Statistics 9 pp 233– (1994)
[11] DOI: 10.1080/01621459.1966.10502016 · doi:10.1080/01621459.1966.10502016
[12] DOI: 10.1007/BF02579150 · Zbl 0557.90065 · doi:10.1007/BF02579150
[13] Lawson C. L., Solving Least Squares Problems (1974) · Zbl 0860.65028
[14] DOI: 10.1080/01621459.1976.10481560 · doi:10.1080/01621459.1976.10481560
[15] McCullagh P., Generalized Linear Models., 2. ed. (1989) · Zbl 0744.62098
[16] DOI: 10.1016/S0378-3758(99)00025-7 · Zbl 1057.62510 · doi:10.1016/S0378-3758(99)00025-7
[17] DOI: 10.1214/08-AOAS167 · Zbl 1149.62033 · doi:10.1214/08-AOAS167
[18] DOI: 10.2307/3316001 · Zbl 1046.62034 · doi:10.2307/3316001
[19] DOI: 10.1214/ss/1177012761 · doi:10.1214/ss/1177012761
[20] DOI: 10.1080/03610928608829280 · Zbl 0607.62058 · doi:10.1080/03610928608829280
[21] Robertson T., Order Restricted Statistical Inference (1988) · Zbl 0645.62028
[22] Ruppert D., Semiparametric Regression (Cambridge Series in Statistical and Probabilistic Mathematics) (2003) · Zbl 1038.62042 · doi:10.1017/CBO9780511755453
[23] DOI: 10.2307/2532799 · Zbl 0821.62041 · doi:10.2307/2532799
[24] Silvapulle M. J., Constrained Statistical Inference (2005) · Zbl 1077.62019
[25] van Eeden C., Restricted Parameter Space Estimation Problems (2006) · Zbl 1160.62018 · doi:10.1007/978-0-387-48809-7
[26] Wilhelmsen D. R., Mathematics of Computation 30 (133) pp 48– (1976)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.