×
Grebennikov, Dmitry S.; Zheltkova, Valerya V.; Bocharov, Gennady A.

Application of minimum description length criterion to assess the complexity of models in mathematical immunology. (English) Zbl 07613687

Russ. J. Numer. Anal. Math. Model. 37, No. 5, 253-261 (2022).
Summary: Mathematical models in immunology differ enormously in the dimensionality of the state space, the number of parameters and the parameterizations used to describe the immune processes. The ongoing diversification of the models needs to be complemented by rigorous ways to evaluate their complexity and select the parsimonious ones in relation to the data available/used for their calibration. A broadly applied metrics for ranking the models in mathematical immunology with respect to their complexity/parsimony is provided by the Akaike information criterion. In the present study, a computational framework is elaborated to characterize the complexity of mathematical models in immunology using a more general approach, namely, the Minimum Description Length criterion. It balances the model goodness-of-fit with the dimensionality and geometrical complexity of the model. Four representative models of the immune response to acute viral infection formulated with either ordinary or delay differential equations are studied. Essential numerical details enabling the assessment and ranking of the viral infection models include: (1) the optimization of the likelihood function, (2) the computation of the model sensitivity functions, (3) the evaluation of the Fisher information matrix and (4) the estimation of multidimensional integrals over the model parameter space.

MSC:

65-XX Numerical analysis
92-08 Computational methods for problems pertaining to biology

Keywords:

model selection; information criteria; minimum description length; geometric complexity; maximum likelihood estimates; delay differential equations
Cite Review PDF
Full Text: DOI

References:

[1] S. M. Andrew, C. T. H. Baker, and G.y A. Bocharov, Rival approaches to mathematical modelling in immunology. Journal of Computational and Applied Mathematics 205 (2007), 669-686. · Zbl 1119.92037
[2] C. T. H. Baker and G. A. Bocharov, Computational aspects of time-lag models of Marchuk type that arise in immunology. Russian Journal of Numerical Analysis and Mathematical Modelling 20 (2005), 247-262. · Zbl 1081.65071
[3] C. T. H. Baker, G. A. Bocharov, J. M. Ford, P. M. Lumb, S. J. Norton, C. A. H. Paul, T. Junt, P. Krebs, and B. Ludewig, Computational approaches to parameter estimation and model selection in immunology. Journal of Computational and Applied Mathematics 184 (2005), 50-76. · Zbl 1072.92020
[4] V. Balasubramanian, MDL, Bayesian inference, and the geometry of the space of probability distributions. Advances in Minimum Description Length: Theory and Applications, MIT Press Cambridge, MA, USA, 2005, pp. 81-98.
[5] R. Blanco-Rodríguez, X. Du, and E. Hernández-Vargas, Computational simulations to dissect the cell immune response dynamics for severe and critical cases of SARS-CoV-2 infection. Computer Methods and Programs in Biomedicine 211 (2021), 106412.
[6] G. A. Bocharov, Modelling the dynamics of LCMV infection in mice: Conventional and exhaustive CTL responses. Journal of Theoretical Biology 192 (1998), 283-308.
[7] G. Bocharov, V. Volpert, B. Ludewig, and A. Meyerhans, Mathematical Immunology of Virus Infections. Springer International Publishing, Cham, 2018. · Zbl 1401.92002
[8] G. Bocharov, R. Züst, L. Cervantes-Barragan, T. Luzyanina, E. Chiglintsev, V. A. Chereshnev, V. Thiel, and B. Ludewig, A systems immunology approach to plasmacytoid dendritic cell function in cytopathic virus infections. PLoS Pathogens 6 (2010), e1001017.
[9] K. P. Burnham, D. R. Anderson, and K. P. Burnham, Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, 2nd ed ed. Springer, New York, 2002, OCLC: ocm48557578. · Zbl 1005.62007
[10] Forward mode automatic differentiation on Julia. https://juliadiff.org/ForwardDiff.jl/stable/
[11] D. Grebennikov, A. Karsonova, M. Loginova, V. Casella, A. Meyerhans, and G. Bocharov, Predicting the cross-coordinated immune response dynamics in SARS-CoV-2 infection: Implications for disease pathogenesis. Mathematics & Computer Science, Preprint, July 2022.
[12] P. D. Grunwald, In Jae Myung, and M. A. Pitt (Eds.), Advances in Minimum Description Length: Theory and Applications, Neural information processing series. MIT Press, Cambridge, Mass, 2005.
[13] M. Li and P. Vitányi, An Introduction to Kolmogorov Complexity and its Applications, Texts in Computer Science. Springer International Publishing, Cham, 2019. · Zbl 1423.68005
[14] T. Luzyanina, K. Engelborghs, S. Ehl, P. Klenerman, and G. Bocharov, Low level viral persistence after infection with LCMV: a quantitative insight through numerical bifurcation analysis. Mathematical Biosciences 173 (2001), 1-23. · Zbl 0988.92014
[15] A. Ly, M. Marsman, J. Verhagen, R. P. P. P. Grasman, and E.-J. Wagenmakers, A tutorial on Fisher information. Journal of Mathematical Psychology 80 (2017), 40-55. · Zbl 1402.62318
[16] G. I. Marchuk, V. Shutyaev, and G. Bocharov, Adjoint equations and analysis of complex systems: Application to virus infection modelling. Journal of Computational and Applied Mathematics 184 (2005), 177-204. · Zbl 1072.92026
[17] M. Ostaszewski et al., COVID19 Disease Map, a computational knowledge repository of virus-host interaction mechanisms. Molecular Systems Biology 17 (2021), e10387.
[18] M. A. Pitt and In Jae Myung, When a good fit can be bad. Trends in Cognitive Sciences 6 (2002), 421-425.
[19] F. A. Rihan, A. A. Azamov, and H. J. Al-Sakaji, An inverse problem for delay differential equations: Parameter estimation, nonlinearity, sensitivity. Applied Mathematics & Information Sciences 12 (2018), 63-74.
[20] J. J. Rissanen, Fisher information and stochastic complexity. IEEE Transactions on Information Theory 42 (1996), 40-47. · Zbl 0856.94006
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.