×

Efficiency bounds for semiparametric models with singular score functions. (English) Zbl 1490.62089

Summary: This paper is concerned with asymptotic efficiency bounds for the estimation of the finite dimension parameter \(\theta \in \mathbb{R}^p\) of semiparametric models that have singular score function for \(\theta\) at the true value \(\theta_\ast\). The resulting singularity of the matrix of Fisher information means that the standard bound for \(\theta - \theta_\ast\) is not defined. We study the case of single rank deficiency of the score and focus on the case where the derivative of the root density in the direction of the last parameter component, \( \theta_2\), is nil while the derivatives in the \(p - 1\) other directions, \( \theta_1\), are linearly independent. We then distinguish two cases: (i) The second derivative of the root density in the direction of \(\theta_2\) and the first derivative in the direction of \(\theta_1\) are linearly independent and (ii) The second derivative of the root density in the direction of \(\theta_2\) is also nil but the third derivative in \(\theta_2\) is linearly independent of the first derivative in the direction of \(\theta_1\). We show that in both cases, efficiency bounds can be obtained for the estimation of \(\kappa_j (\theta) = (\theta_1 - \theta_{\ast 1}, (\theta_2 - \theta_{\ast 2})^j)\), with \(j = 2\) and 3, respectively and argue that an estimator \(\theta\) is efficient if \(\kappa_j (\hat{\theta})\) reaches its bound. We provide the bounds in form of convolution and asymptotic minimax theorems. For case (i), we propose a transformation of the Gaussian variable that appears in our convolution theorem to account for the restricted set of values of \(\kappa_2(\theta)\). This transformation effectively gives the efficiency bound for the estimation of \(\kappa_2(\theta)\) in the model configuration (i). We apply these results to locally under-identified moment condition models and show that the generalized method of moments (GMM) estimator using \(V_\ast^{-1}\) as weighting matrix, where \(V_\ast\) is the variance of the estimating function, is optimal even in these non standard settings. Examples of models are provided that fit the two configurations explored.

MSC:

62G05 Nonparametric estimation
62F12 Asymptotic properties of parametric estimators
62P20 Applications of statistics to economics

References:

[1] Atchadé, Y. F., A cautionary tale on the efficiency of some adaptive Monte Carlo schemes, The Annals of Applied Probability, 20, 3, 841-868 (2010) · Zbl 1222.60053 · doi:10.1214/09-AAP636
[2] Begun, J. M.; Hall, W. J.; Huang, W.-M.; Wellner, J., Information and asymptotic efficiency in parametric-nonparametric models, The Annals of Statistics, 11, 2, 432-452 (1983) · Zbl 0526.62045 · doi:10.1214/aos/1176346151
[3] Beran, R., Estimating a distribution function, The Annals of Statistics, 5, 2, 400-404 (1977) · Zbl 0379.62024 · doi:10.1214/aos/1176343806
[4] Beran, R., An efficient and robust adaptive estimator of location, The Annals of Statistics, 6, 2, 292-313 (1978) · Zbl 0378.62051 · doi:10.1214/aos/1176344125
[5] Bhattacharyya, A., On some analogues to the amount of information and their uses in statistical estimation, Sankhya, 8, 1-14 (1946)
[6] Bickel, P., Minimax estimation of the mean of a normal distribution when the parameter space is restricted, The Annals of Statistics, 9, 6, 1301-1309 (1981) · Zbl 0484.62013 · doi:10.1214/aos/1176345646
[7] Bickel, P., On adaptive estimation, The Annals of Statistics, 10, 3, 647-671 (1982) · Zbl 0489.62033 · doi:10.1214/aos/1176345863
[8] Bun, M.; Kleibergen, F., Identification and Inference in Moments Based Analysis of Linear Dynamic Panel Data Models. Technical Report (2016), Amsterdam: Department of Economics, University of Amsterdam, Amsterdam
[9] Chamberlain, G., Asymptotic efficiency in semiparametric models with censoring, Journal of Econometrics, 32, 2, 189-218 (1986) · Zbl 0604.62063 · doi:10.1016/0304-4076(86)90038-2
[10] Chamberlain, G., Asymptotic efficiency in estimation with conditional moment restrictions, Journal of Econometrics, 34, 3, 305-334 (1987) · Zbl 0618.62040 · doi:10.1016/0304-4076(87)90015-7
[11] Dalalyan, A. S.; Golubev, G. K.; Tsybakov, A. B., Penalized maximum likelihood and semiparametric second-order efficiency, The Annals of Statistics, 34, 1, 169-201 (2006) · Zbl 1091.62020 · doi:10.1214/009053605000000895
[12] Diebold, F.; Nerlove, M., The dynamics of exchange rate volatility: a multivariate latent factor ARCH model, Journal of Applied Econometrics, 4, 1, 1-21 (1989) · doi:10.1002/jae.3950040102
[13] Dovonon, P., Conditionally heteroskedastic factor models with skewness and leverage effects, Journal of Applied Econometrics, 28, 7, 1110-1137 (2013) · doi:10.1002/jae.2281
[14] Dovonon, P.; Gonçalves, S., Bootstrapping the GMM overidentification test under first-order underidentification, Journal of Econometrics, 201, 1, 43-71 (2017) · Zbl 1391.62052 · doi:10.1016/j.jeconom.2017.06.021
[15] Dovonon, P.; Hall, A. R., The asymptotic properties of GMM and indirect inference under second-order identification, Journal of Econometrics, 205, 1, 76-111 (2018) · Zbl 1452.62191 · doi:10.1016/j.jeconom.2018.03.006
[16] Dovonon, P.; Hall, A. R.; Kleibergen, F., Inference in second-order identified models, Journal of Econometrics (2019)
[17] Dovonon, P.; Renault, E., Testing for common conditionally heteroskedastic factors, Econometrica, 81, 2561-2586 (2013) · Zbl 1326.62224
[18] Dovonon, P.; Renault, E., GMM Overidentification Test with First-Order Underidentification. Technical Report (2019), Canada: Department of Economics, Concordia University, Canada
[19] Engle, R. F.; Kozicki, S., Testing for common features, Journal of Business & Economic Statistics, 11, 369-395 (1993) · doi:10.2307/1391623
[20] Engle, R. F.; Mistry, A., Priced risk and asymmetric volatility in the cross-section of skewness, Journal of Econometrics, 182, 1, 135-144 (2014) · Zbl 1311.91171 · doi:10.1016/j.jeconom.2014.04.013
[21] Fiorentini, G.; Sentana, E.; Shephard, N., Likelihood-based estimation of generalised ARCH structures, Econometrica, 72, 5, 1481-1517 (2004) · Zbl 1091.62071 · doi:10.1111/j.1468-0262.2004.00541.x
[22] Hahn, J., The efficiency bound of the mixed proportional hazard model, The Review of Economic Studies, 61, 4, 607-629 (1994) · Zbl 0807.62089 · doi:10.2307/2297911
[23] Hájek, J., Local asymptotic minimax and admissibility in estimation, Proceedings of Sixth Berkeley Symposium on Mathematical Statistics and Probability, 1, 245-261 (1972)
[24] Harvey, C. R.; Siddique, A., Autoregressive conditional skewness, The Journal of Financial and Quantitative Analysis, 34, 4, 465-487 (1999) · doi:10.2307/2676230
[25] Harvey, C. R.; Siddique, A., Conditional skewness in asset pricing tests, The Journal of Finance, 55, 3, 1263-1295 (2000) · doi:10.1111/0022-1082.00247
[26] Ishwaran, H., Uniform rates of estimation in the semiparametric weibull mixture model, The Annals of Statistics, 24, 1572-1585 (1996) · Zbl 0867.62011 · doi:10.1214/aos/1032298285
[27] King, M. A.; Sentana, E.; Wadhwani, S. B., Volatility and links between national stock markets, Econometrica, 62, 4, 901-933 (1994) · Zbl 0807.90037 · doi:10.2307/2951737
[28] Le Cam, L., Limits experiments, Proceedings of Sixth Berkeley Symposium on Mathematical Statistics and Probability, 1, 175-194 (1972)
[29] Lee, L.-F.; Chesher, A., Specification testing when score test statistics are identically zero, Journal of Econometrics, 31, 2, 121-149 (1986) · Zbl 0615.62146 · doi:10.1016/0304-4076(86)90045-X
[30] Levit, B. Y., On the efficiency of a class of non-parametric estimates, Theory of Probability & Its Applications, 20, 4, 723-740 (1976) · Zbl 0367.62041 · doi:10.1137/1120081
[31] Magnus, J. R.; Neudecker, H., Matrix Differential Calculus with Applications in Statistics and Econometrics (1988), Chichester: Wiley, Chichester · Zbl 0651.15001
[32] Millar, P. W., Asymptotic minimax theorems for the sample distribution function, Zeitschrift for Wahrscheinlichkeitstheorie Und Verwandte Gebiete, 48, 3, 233-252 (1979) · Zbl 0387.62029 · doi:10.1007/BF00537522
[33] Newey, K. W.; McFadden, D.; Engle, R. F.; McFadden, D. L., Handbook of Econometrics IV, Large sample estimation and hypothesis testing, 2112-2245 (1994)
[34] Powell, J. L.; Engle, R. F.; McFadden, D. L., Handbook of Econometrics IV, Estimation of semiparametric models, 2443-2521 (1994)
[35] Rotnitzky, A.; Cox, D. R.; Bottai, M.; Robins, J., Likelihood-based inference with singular information matrix, Bernoulli, 6, 2, 243-284 (2000) · Zbl 0976.62015 · doi:10.2307/3318576
[36] Sargan, J. D., Identification and lack of identification, Econometrica, 51, 6, 1605-1633 (1983) · Zbl 0555.62096 · doi:10.2307/1912109
[37] Schick, A., On asymptotically efficient estimation in semiparametric models, The Annals of Statistics, 14, 3, 1139-1151 (1986) · Zbl 0612.62062 · doi:10.1214/aos/1176350055
[38] Stein, C., Efficient nonparametric testing and estimation, Proceedings of Third Berkeley Symposium on Mathematical Statistics and Probability, 1, 187-195 (1956) · Zbl 0074.34801
[39] van der Vaart, A.; Wellner, J. A., Weak Convergence and Empirical Processes with Application to Statistics (1996), New York: Springer-Verlag, New York · Zbl 0862.60002
[40] Wellner, J. A., Asymptotic optimality of the product-limit estimator, The Annals of Statistics, 10, 2, 595-602 (1982) · Zbl 0489.62036 · doi:10.1214/aos/1176345800
[41] Wright, J. H., Detecting lack of identification in GMM, Econometric Theory, 19, 2, 322-330 (2003) · Zbl 1441.62905 · doi:10.1017/S0266466603192055
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.