Randomization inference for peer effects. (English) Zbl 1428.62134
Summary: Many previous causal inference studies require no interference, that is, the potential outcomes of a unit do not depend on the treatments of other units. However, this no-interference assumption becomes unreasonable when a unit interacts with other units in the same group or cluster. In a motivating application, a top Chinese university admits students through two channels: the college entrance exam (also known as Gaokao) and recommendation (often based on Olympiads in various subjects). The university randomly assigns students to dorms, each of which hosts four students. Students within the same dorm live together and have extensive interactions. Therefore, it is likely that peer effects exist and the no-interference assumption does not hold. It is important to understand peer effects, because they give useful guidance for future roommate assignment to improve the performance of students. We define peer effects using potential outcomes. We then propose a randomization-based inference framework to study peer effects with arbitrary numbers of peers and peer types. Our inferential procedure does not assume any parametric model on the outcome distribution. Our analysis gives useful practical guidance for policy makers of the university. for this article are available online.
Keywords:
causal inference; design-based inference; grade point average (GPA); interference; optimal treatment assignment; spillover effectReferences:
| [1] | Abadie, A., Athey, S., Imbens, G. W., and Wooldridge, J. (2017), “When Should You Adjust Standard Errors for Clustering?” arXiv: 1710.02926 · Zbl 07656086 |
| [2] | An, W.; Scott, J.; Carrington, P. J., The Sage Handbook of Social Network Analysis, “Models and Methods to Identify Peer Effects,”, 515-532 (2011), London: Sage, London |
| [3] | Angrist, J. D., “The Perils of Peer Effects,”, Labour Economics, 30, 98-108 (2014) · doi:10.1016/j.labeco.2014.05.008 |
| [4] | Aronow, P. M., “A General method for Detecting Interference between units in Randomized Experiments,”, Sociological Methods and Research, 41, 3-16 (2012) · doi:10.1177/0049124112437535 |
| [5] | Aronow, P. M.; Samii, C., “Estimating Average Causal Effects under Interference between Units,”, Annals of Applied Statistics, 11, 1912-1947 (2017) · Zbl 1383.62329 · doi:10.1214/16-AOAS1005 |
| [6] | Arpino, B.; Mattei, A., “Assessing the Causal Effects of Financial Aids to Firms in Tuscany Allowing for Interference,”, Annals of Applied Statistics, 10, 1170-1194 (2016) · Zbl 1416.62578 · doi:10.1214/15-AOAS902 |
| [7] | Athey, S.; Eckles, D.; Imbens, G. W., “Exact P-values for Network Interference,”, Journal of the American Statistical Association, 113, 230-240 (2018) · Zbl 1398.62140 · doi:10.1080/01621459.2016.1241178 |
| [8] | Basse, G.; Feller, A., “Analyzing Two-Stage Experiments in the Presence of Interference,”, Journal of the American Statistical Association, 113, 41-55 (2018) · Zbl 1398.62030 · doi:10.1080/01621459.2017.1323641 |
| [9] | Basse, G.; Feller, A.; Toulis, P., “Randomization tests of causal effects under interference,”, Biometrika (2019) · Zbl 1434.62094 · doi:10.1093/biomet/asy072 |
| [10] | Bhattacharya, D., “Inferring Optimal Peer Assignment from Experimental Data,”, Journal of the American Statistical Association, 104, 486-500 (2009) · Zbl 1388.90085 · doi:10.1198/jasa.2009.0015 |
| [11] | Bowers, J.; Fredrickson, M. M.; Panagopoulos, C., “Reasoning about Interference between Units: A General Framework,”, Political Analysis, 21, 97-124 (2013) · doi:10.1093/pan/mps038 |
| [12] | Carrell, S. E.; Sacerdote, B. I.; West, J. E., “From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation,”, Econometrica, 81, 855-882 (2013) · Zbl 1274.91357 |
| [13] | Choi, D. S., “Estimation of Monotone Treatment Effects in Network Experiments,”, Journal of the American Statistical Association, 112, 1147-1155 (2017) · doi:10.1080/01621459.2016.1194845 |
| [14] | Cox, D. R., Planning of Experiments (1958), Oxford, England: Wiley, Oxford, England · Zbl 0084.15802 |
| [15] | Dasgupta, T.; Pillai, N. S.; Rubin, D. B., “Causal Inference from \(####\) Factorial Designs by using Potential Outcomes,”, Journal of the Royal Statistical Society, Series B, 77, 727-753 (2015) · Zbl 1414.62337 · doi:10.1111/rssb.12085 |
| [16] | Fisher, R. A., The Design of Experiments (1935), Edinburgh, London: Oliver and Boyd, Edinburgh, London |
| [17] | Forastiere, L.; Airoldi, E. M.; Mealli, F., “Identification and Estimation of Treatment and Interference effects in Observational Studies on Networks,”, arXiv, 1609, 06245 (2016) |
| [18] | Goldsmith-Pinkham, P.; Imbens, G. W., “Social Networks and the Identification of Peer effects,”, Journal of Business and Economic Statistics, 31, 253-264 (2013) · doi:10.1080/07350015.2013.801251 |
| [19] | Graham, B. S., Imbens, G. W., and Ridder, G. (2010), “Measuring the Effects of Segregation in the Presence of Social Spillovers: A Nonparametric Approach,” National Bureau of Economic Research Working Paper 16499, National Bureau of Economic Research. |
| [20] | Halloran, M. E.; Struchiner, C. J., “Study Designs for Dependent Happenings,”, Epidemiology, 2, 331-338 (1991) |
| [21] | Halloran, M. E.; Struchiner, C. J., “Causal Inference in Infectious Diseases,”, Epidemiology, 6, 142-151 (1995) |
| [22] | Hong, G.; Raudenbush, S. W., “Evaluating Kindergarten Retention Policy: A Case Study of Causal Inference for Multilevel Observational Data,”, Journal of the American Statistical Association, 101, 901-910 (2006) · Zbl 1120.62347 · doi:10.1198/016214506000000447 |
| [23] | Hudgens, M. G.; Halloran, M. E., “Toward Causal Inference With Interference,”, Journal of the American Statistical Association, 103, 832-842 (2008) · Zbl 1471.62507 · doi:10.1198/016214508000000292 |
| [24] | Ichino, N.; Schündeln, M., “Deterring or Displacing Electoral Irregularities? Spillover Effects of Observers in a Randomized Field Experiment in Ghana,”, The Journal of Politics, 74, 292-307 (2012) · doi:10.1017/S0022381611001368 |
| [25] | Kwan, Y. K., “Asymptotic Bayesian Analysis based on a Limited Information Estimator,”, Journal of Econometrics, 88, 99-121 (1999) · Zbl 0933.62019 · doi:10.1016/S0304-4076(98)00024-4 |
| [26] | Langenskiöld, S.; Rubin, D. B., “Outcome-free Design of Observational Studies: Peer Influence on Smoking,”, Annales d’Économie et de Statistique, 91-92, 107-125 (2008) |
| [27] | Li, X.; Ding, P., “General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference,”, Journal of the American Statistical Association, 112, 1759-1769 (2017) · doi:10.1080/01621459.2017.1295865 |
| [28] | Lin, W., “Agnostic Notes on Regression Adjustments to Experimental Data: Reexamining Freedman’s Critique,”, The Annals of Applied Statistics, 7, 295-318 (2013) · Zbl 1454.62217 · doi:10.1214/12-AOAS583 |
| [29] | Liu, L.; Hudgens, M. G., “Large Sample Randomization Inference of Causal effects in the Presence of Interference,”, Journal of the American Statistical Association, 109, 288-301 (2014) · Zbl 1367.62239 · doi:10.1080/01621459.2013.844698 |
| [30] | Liu, L.; Hudgens, M. G.; Becker-Dreps, S., “On Inverse Probability-Weighted Estimators in the Presence of Interference,”, Biometrika, 103, 829-842 (2016) · Zbl 1506.62250 · doi:10.1093/biomet/asw047 |
| [31] | Luo, X.; Small, D. S.; Li, C. S. R.; Rosenbaum, P. R., “Inference with Interference between Units in an fMRI Experiment of Motor Inhibition,”, Journal of the American Statistical Association, 107, 530-541 (2012) · Zbl 1261.92008 · doi:10.1080/01621459.2012.655954 |
| [32] | Manski, C. F., “Identification of Endogenous Social Effects: The Reflection Problem,”, The Review of Economic Studies, 60, 531-542 (1993) · Zbl 0800.90377 · doi:10.2307/2298123 |
| [33] | Manski, C. F., “Identification of Treatment Response with Social Interactions,”, The Econometrics Journal, 16, S1-S23 (2013) · Zbl 1521.62217 |
| [34] | Miguel, E.; Kremer, M., “Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities,”, Econometrica, 72, 159-217 (2004) · Zbl 1137.92328 · doi:10.1111/j.1468-0262.2004.00481.x |
| [35] | Neyman, J. (1923), “On the Application of Probability Theory to Agricultural Experiments. Essay on Principles” (with discussion), Section 9 (translated), reprinted ed., Statistical Science, 5, 465-472. · Zbl 0955.01560 |
| [36] | Nickerson, D. W., “Is Voting Contagious? Evidence from two Field Experiments,”, American Political Science Review, 102, 49-57 (2008) · doi:10.1017/S0003055408080039 |
| [37] | Ogburn, E. L.; VanderWeele, T. J., “Causal Diagrams for Interference,”, Statistical Science, 29, 559-578 (2014) · Zbl 1331.62200 · doi:10.1214/14-STS501 |
| [38] | Perez-Heydrich, C.; Hudgens, M. G.; Halloran, M. E.; Clemens, J. D.; Ali, M.; Emch, M. E., “Assessing Effects of Cholera Vaccination in the Presence of Interference,”, Biometrics, 70, 731-741 (2014) · Zbl 1299.92032 · doi:10.1111/biom.12184 |
| [39] | Rigdon, J.; Hudgens, M. G., “Exact Confidence Intervals in the Presence of Interference,”, Statistics and Probability Letters, 105, 130-135 (2015) · Zbl 1396.62182 · doi:10.1016/j.spl.2015.06.011 |
| [40] | Rosenbaum, P. R., “Interference between units in Randomized Experiments,”, Journal of the American Statistical Association, 102, 191-200 (2007) · Zbl 1284.62494 · doi:10.1198/016214506000001112 |
| [41] | Rubin, D. B., “Comment, on “Randomization Analysis of Experimental Data: The Fisher Randomization test” by D. Basu,” Journal of American Statistical Association, 75, 591-593 (1980) · doi:10.1080/01621459.1980.10477517 |
| [42] | Rubin, D. B. (2005), “Causal Inference using Potential Outcomes: Design, Modeling, Decisions,” Journal of the American Statistical Association, 100, 322-331. · Zbl 1117.62418 |
| [43] | Sacerdote, B., “Peer Effects with Random Assignment: Results for Dartmouth Roommates,”, The Quarterly Journal of Economics, 116, 681-704 (2001) · Zbl 0996.91553 · doi:10.1162/00335530151144131 |
| [44] | Sävje, F.; Aronow, P. M.; Hudgens, M. G., “Average Treatment Effects in the Presence of Unknown Interference,”, arXiv, 1711, 06399 (2017) |
| [45] | Sims, C. A., Technical Report, “On An Example of Larry Wasserman,” (2006), Princeton University: Princeton University, available at |
| [46] | Sobel, M. E., “What do Randomized Studies of Housing Mobility Demonstrate? Causal Inference in, the Face of Interference,” Journal of the American Statistical Association, 101, 1398-1407 (2006) · Zbl 1171.62365 · doi:10.1198/016214506000000636 |
| [47] | Tchetgen, E. J. T.; VanderWeele, T. J., “On Causal Inference in the Presence of Interference,”, Statistical Methods in Medical Research, 21, 55-75 (2012) · doi:10.1177/0962280210386779 |
| [48] | Toulis, P., and Kao, E. (2013), “Estimation of Causal Peer Influence Effects,” in Proceedings of the 30th International Conference on Machine Learning, pp. 1489-1497. |
| [49] | VanderWeele, T. J.; An, W.; Morgan, S. L., Handbook of Causal Analysis for Social Research, “Social Networks and Causal Inference,”, 353-374 (2013), Netherlands: Springer, Netherlands |
| [50] | Vanderweele, T. J.; Hong, G.; Jones, S. M.; Brown, J. L., “Mediation and Spillover Effects in Group-Randomized Trials: A Case Study of the 4Rs Educational Intervention,”, Journal of the American Statistical Association, 108, 469-482 (2013) · Zbl 06195953 · doi:10.1080/01621459.2013.779832 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
