×

Same root different leaves: time series and cross-sectional methods in panel data. (English) Zbl 1541.62381

Summary: One dominant approach to evaluate the causal effect of a treatment is through panel data analysis, whereby the behaviors of multiple units are observed over time. The information across time and units motivates two general approaches: (i) horizontal regression (i.e., unconfoundedness), which exploits time series patterns, and (ii) vertical regression (e.g., synthetic controls), which exploits cross-sectional patterns. Conventional wisdom often considers the two approaches to be different. We establish this position to be partly false for estimation but generally true for inference. In the absence of any assumptions, we show that both approaches yield algebraically equivalent point estimates for several standard estimators. However, the source of randomness assumed by each approach leads to a distinct estimand and quantification of uncertainty even for the same point estimate. This emphasizes that researchers should carefully consider where the randomness stems from in their data, as it has direct implications for the accuracy of inference.
© 2023 The Authors. Econometrica published by John Wiley & Sons Ltd on behalf of The Econometric Society

MSC:

62P20 Applications of statistics to economics
62D20 Causal inference from observational studies

Software:

estCI

References:

[1] Abadie, Alberto, and JavierGardeazabal (2003): “The Economic Costs of Conflict: A Case Study of the Basque Country,” American Economic Review, 93 (1), 113-132.
[2] Abadie, Alberto (2021): “Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects,” Journal of Economic Literature, 59 (2), 391-425.
[3] Abadie, Alberto, and JérémyL’Hour (2021): “A Penalized Synthetic Control Estimator for Disaggregated Data,” Journal of the American Statistical Association, 116 (536), 1817-1834. · Zbl 1506.62243
[4] Abadie, Alberto, SusanAthey, Guido W.Imbens, and Jeffrey M.Wooldridge (2020): “Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis,” Econometrica, 88 (1), 265-296. · Zbl 1467.62119
[5] Abadie, Alberto, AlexisDiamond, and JensHainmueller (2010): “Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California”s Tobacco Control Program,” Journal of the American Statistical Association, 105 (490), 493-505.
[6] Abadie, Alberto, AlexisDiamond, and JensHainmueller (2015): “Comparative Politics and the Synthetic Control Method,” American Journal of Political Science, 59 (2), 495-510.
[7] Agarwal, Anish, DevavratShah, and DennisShen (2021): “Synthetic Interventions,”. arXiv preprint arXiv:2006.07691.
[8] Amjad, Muhammad, VishalMisra, DevavratShah, and DennisShen (2019): “MRSC: Multi‐Dimensional Robust Synthetic Control,” Proc. ACM Meas. Anal. Comput. Syst., 3 (2), 37.
[9] Amjad, Muhammad, DevavratShah, and DennisShen (2018): “Robust Synthetic Control,” Journal of Machine Learning Research, 19 (22), 1-51. · Zbl 1445.62113
[10] Arkhangelsky, Dmitry, SusanAthey, David A.Hirshberg, Guido W.Imbens, and StefanWager (2021): “Synthetic Difference‐in‐Differences,” American Economic Review, 111 (12), 4088-4118.
[11] Ashenfelter, Orley (1978): “Estimating the Effect of Training Programs on Earnings,” The Review of Economics and Statistics, 60 (1), 47-57.
[12] Athey, Susan, and Guido W.Imbens (2017): “The State of Applied Econometrics: Causality and Policy Evaluation,” Journal of Economic Perspectives, 31 (2), 3-32.
[13] Athey, Susan, MohsenBayati, NikolayDoudchenko, GuidoImbens, and KhashayarKhosravi (2021): “Matrix Completion Methods for Causal Panel Data Models,” Journal of the American Statistical Association, 116 (536), 1716-1730. · Zbl 1506.15030
[14] Bartlett, Peter L., Philip M.Long, GáborLugosi, and AlexanderTsigler (2020): “Benign Overfitting in Linear Regression,” Proceedings of the National Academy of Sciences, 117 (48), 30063-30070. · Zbl 1485.62085
[15] Ben‐Michael, Eli, AviFeller, and JesseRothstein (2021): “The Augmented Synthetic Control Method,” Journal of the American Statistical Association, 116 (536), 1789-1803. · Zbl 1506.62484
[16] Bottmer, Lea, GuidoImbens, JannSpiess, and MerrillWarnick (2023): “A Design‐Based Perspective on Synthetic Control Methods,” Journal of Business & Economic Statistics, 0 (0), 1-12.
[17] Carvalho, Carlos, RicardoMasini, and Marcelo C.Medeiros (2018): “ArCo: An Artificial Counterfactual Approach for High‐Dimensional Panel Time‐Series Data,” Journal of Econometrics, 207 (2), 352-380. · Zbl 1452.62891
[18] Chernozhukov, Victor, KasparWüthrich, and YinchuZhu (2021): “An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls,” Journal of the American Statistical Association, 116 (536), 1849-1864. · Zbl 1506.62246
[19] Doudchenko, Nikolay, and Guido W.Imbens (2016): “Balancing, Regression, Difference‐in‐Differences and Synthetic Control Methods: A Synthesis,” Working Paper 22791, National Bureau of Economic Research.
[20] Gunasekar, Suriya, BlakeWoodworth, SrinadhBhojanapalli, BehnamNeyshabur, and NathanSrebro (2017): “Implicit Regularization in Matrix Factorization,” Advances in Neural Information Processing Systems.
[21] Hoff, Peter D. (2017): “Lasso, Fractional Norm and Structured Sparse Estimation Using a Hadamard Product Parametrization,” Computational Statistics & Data Analysis, 115 (C), 186-198. · Zbl 1466.62098
[22] Hsiao, Cheng, H. SteveChing, and Shui KiWan (2012): “A Panel Data Approach for Program Evaluation: Measuring the Benefits of Political and Economic Integration of Hong Kong With Mainland China,” Journal of Applied Econometrics, 27 (5), 705-740.
[23] Imbens, Guido W., and Donald B.Rubin (2015): Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. USA: Cambridge University Press. · Zbl 1355.62002
[24] Imbens, Guido W., and Jeffrey M.Wooldridge (2009): “Recent Developments in the Econometrics of Program Evaluation,” Journal of Economic Literature, 47 (1), 5-86.
[25] Lehmann, Erich L. (2000): Elements of Large‐Sample Theory. New York: Springer. · Zbl 0914.62001
[26] Li, Kathleen T. (2020): “Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods,” Journal of the American Statistical Association, 115 (532), 2068-2083. · Zbl 1453.62330
[27] Li, Kathleen T., and David R.Bell (2017): “Estimation of Average Treatment Effects With Panel Data: Asymptotic Theory and Implementation,” Journal of Econometrics, 197 (1), 65-75. · Zbl 1443.62488
[28] Neyshabur, Behnam, RyotaTomioka, and NathanSrebro (2015): “In Search of the Real Inductive Bias: on the Role of Implicit Regularization in Deep Learning,” in International Conference on Learning Representations.
[29] Robins, James, MarielaSued, QuanhongLei‐Gomez, and AndreaRotnitzky (2007): “Comment: Performance of Double‐Robust Estimators When “Inverse Probability” Weights Are Highly Variable,” Statistical Science, 22 (4), 544-559. · Zbl 1246.62076
[30] Rosenbaum, Paul, and DonaldRubin (1983): “The Central Role of the Propensity Score in Observational Studies for Causal Effects,” Biometrika, 70, 41-55. · Zbl 0522.62091
[31] Sekhon, Jasjeet S., and YotamShem‐Tov (2021): “Inference on a New Class of Sample Average Treatment Effects,” Journal of the American Statistical Association, 116 (534), 798-804. · Zbl 1464.62210
[32] Shen, Dennis, PengDing, JasjeetSekhon, and BinYu (2023): “Supplement to ‘Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data’,” Econometrica Supplemental Material, 91, https://doi.org/10.3982/ECTA21248. · Zbl 1541.62381 · doi:10.3982/ECTA21248
[33] Spiess, Jann, GuidoImbens, and AmarVenugopal (2023): Double and Single Descent in Causal Inference With an Application to High‐Dimensional Synthetic Control.
[34] Styan, George P. H. (1973): “Hadamard Products and Multivariate Statistical Analysis,” Linear Algebra and its Applications, 6, 217-240. · Zbl 0255.15002
[35] Tibshirani, Ryan J. (2013): “The Lasso Problem and Uniqueness,” Electronic Journal of Statistics, 7, 1456-1490. · Zbl 1337.62173
[36] Yu, Bin, and KarlKumbier (2020): “Veridical Data Science,” Proceedings of the National Academy of Sciences, 117 (8), 3920-3929. · Zbl 1456.62321
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.