Introduction to the dynamics of disordered systems: equilibrium and gradient descent. (English) Zbl 07791850
Summary: This paper contains the lecture notes of the short courses given by one of us (F.Z.) at the summer school Fundamental Problems in Statistical Physics XV, held in Brunico, Italy, in July 2021, and, just before that, at the summer school Glassy Systems and Inter-Disciplinary Applications, held in Cargese, France, in June 2021. The course was a short introductory overview of the dynamics of disordered systems, focused in particular on the equilibrium dynamics (with the associated glass transition), and on the simplest case of off-equilibrium dynamics, namely gradient descent. A few selected topics (and references) are chosen, based on the authors’ own taste and competences, and on pedagogical reasons, without aiming at a complete review of the subject.
MSC:
| 82-XX | Statistical mechanics, structure of matter |
Keywords:
complex landscapes; gradient descent; glass transition; spin glasses; disordered systems; metastabilityReferences:
| [1] | Cavagna, A., Phys. Rep., 51 (2009) |
| [2] | Sciortino, F., J. Stat. Mech. Theory Exp., P05015 (2005) |
| [3] | Castellani, T.; Cavagna, A., J. Stat. Mech. Theory Exp., P05012 (2005) · Zbl 1456.82490 |
| [4] | Kirkpatrick, T. R.; Thirumalai, D., J. Phys. A: Math. Gen., L149 (1989) |
| [5] | O’Hern, C. S.; Langer, S. A.; Liu, A. J.; Nagel, S. R., Phys. Rev. Lett. (2002) |
| [6] | O’Hern, C. S.; Silbert, L. E.; Liu, A. J.; Nagel, S. R., Phys. Rev. E (2003) |
| [7] | Liu, A. J.; Nagel, S. R., Annu. Rev. Condens. Matter Phys., 347 (2010) |
| [8] | Liu, A.; Nagel, S.; Van Saarloos, W.; Wyart, M., arXiv:1006.2365 |
| [9] | Conway, J. H.; Sloane, N. J.A., Sphere Packings, Lattices and Groups (1993), Spriger-Verlag · Zbl 0785.11036 |
| [10] | Torquato, S.; Stillinger, F. H., Rev. Modern Phys., 2633 (2010) |
| [11] | MacWilliams, F. J.; Sloane, N. J.A., The Theory of Error Correcting Codes, Vol. 16 (1977), Elsevier · Zbl 0369.94008 |
| [12] | Huffman, W. C.; Pless, V., Fundamentals of Error-Correcting Codes (2010), Cambridge University Press · Zbl 1191.94107 |
| [13] | Altarelli, F.; Monasson, R.; Semerjian, G.; Zamponi, F., arXiv:0802.1829 |
| [14] | Franz, S.; Parisi, G., J. Phys. A (2016) |
| [15] | Applegate, D. L.; Bixby, R. E.; Chvataĺ, V.; Cook, W. J., The Traveling Salesman Problem: A Computational Study (2011), Princeton University Press |
| [16] | Several practical applications of the TSP and an interactive visualization for learning/teaching the problem can be found at http://www.math.uwaterloo.ca/tsp/index.html |
| [17] | Jensen, T. R.; Toft, B., Graph Coloring Problems (2011), John Wiley & Sons |
| [18] | Cheeseman, P. C.; Kanefsky, B.; Taylor, W. M., IJCAI, Vol. 91, 331-337 (1991) · Zbl 0747.68064 |
| [19] | Mitchell, D.; Selman, B.; Levesque, H., AAAI, Vol. 92, 459-465 (1992), Citeseer |
| [20] | Kirkpatrick, S.; Selman, B., Science, 1297 (1994) |
| [21] | Selman, B.; Kirkpatrick, S., Artificial Intelligence, 273 (1996) |
| [22] | Monasson, R.; Zecchina, R.; Kirkpatrick, S.; Selman, B.; Troyansky, L., Nature, 133 (1999) |
| [23] | Engel, A.; Van den Broeck, C., Statistical Mechanics of Learning (2001), Cambridge University Press · Zbl 0984.82034 |
| [24] | Carleo, G.; Cirac, I.; Cranmer, K.; Daudet, L.; Schuld, M.; Tishby, N.; Vogt-Maranto, L.; Zdeborová, L., Rev. Modern Phys. (2019) |
| [25] | Gardner, E., Europhys. Lett., 481 (1987) |
| [26] | M. Geiger, L. Petrini, M. Wyart, arXiv:2012.15110 |
| [27] | D’Ascoli, Stéphane; Refinetti, Maria; Biroli, Giulio; Krzakala, Florent, Double trouble in double descent: bias and variance(s) in the lazy regime. Proceedings of the 37th International Conference on Machine Learning. Proceedings of Machine Learning Research, 2280-2290 (2020), PMLR |
| [28] | Mignacco, F.; Krzakala, F.; Urbani, P.; Zdeborová, L., J. Stat. Mech. Theory Exp. (2021) |
| [29] | F. Mignacco, P. Urbani, arXiv:2112.10852 |
| [30] | Schneidman, E.; Berry, M. J.; Segev, R.; Bialek, W., Nature, 1007 (2006) |
| [31] | Cocco, S.; Leibler, S.; Monasson, R., Proc. Natl. Acad. Sci., 14058 (2009) |
| [32] | Morcos, F.; Pagnani, A.; Lunt, B.; Bertolino, A.; Marks, D. S.; Sander, C.; Zecchina, R.; Onuchic, J. N.; Hwa, T.; Weigt, M., Proc. Natl. Acad. Sci., E1293 (2011) |
| [33] | Zdeborová, L.; Krzakala, F., Adv. Phys., 453 (2016) |
| [34] | Cocco, S.; Feinauer, C.; Figliuzzi, M.; Monasson, R.; Weigt, M., Rep. Progr. Phys. (2018) |
| [35] | Ros, V.; Arous, G. B.; Biroli, G.; Cammarota, C., Phys. Rev. X (2019) |
| [36] | Mannelli, Stefano Sarao; Krzakala, Florent; Urbani, Pierfrancesco; Zdeborova, Lenka, Passed & spurious: descent algorithms and local minima in spiked matrix-tensor models. Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, 4333-4342 (2019), PMLR |
| [37] | Mannelli, S. S.; Biroli, G.; Cammarota, C.; Krzakala, F.; Urbani, P.; Zdeborová, L., Phys. Rev. X (2020) |
| [38] | Mignacco, F.; Urbani, P.; Zdeborová, L., Mach. Learn.: Sci. Technol. (2021) |
| [39] | Antenucci, F.; Franz, S.; Urbani, P.; Zdeborová, L., Phys. Rev. X (2019) |
| [40] | Trinquier, J.; Uguzzoni, G.; Pagnani, A.; Zamponi, F.; Weigt, M., Nature Commun., 1 (2021) |
| [41] | Cocco, S.; Monasson, R.; Posani, L.; Rosay, S.; Tubiana, J., Physica A, 45 (2018) |
| [42] | Kirkpatrick, S.; Gelatt, C. D.; Vecchi, M. P., Science, 671 (1983) |
| [43] | Cugliandolo, L. F.; Kurchan, J., Phys. Rev. Lett., 173 (1993) |
| [44] | Montanari, A.; Ricci-Tersenghi, F., Phys. Rev. B (2004) |
| [45] | Zdeborová, L.; Krzakala, F., Phys. Rev. B (2010) |
| [46] | Krzakala, F.; Zdeborová, L., J. Phys. Conf. Ser., 12022 (2013) |
| [47] | Folena, G.; Franz, S.; Ricci-Tersenghi, F., Phys. Rev. X (2020) |
| [48] | Cugliandolo, L., arXiv:cond-mat/0210312 |
| [49] | J. Kurchan, arXiv:0901.1271 |
| [50] | Kirkpatrick, T. R.; Wolynes, P. G., Phys. Rev. A, 3072 (1987) |
| [51] | Kirkpatrick, T. R.; Thirumalai, D., Phys. Rev. Lett., 2091 (1987) |
| [52] | Kirkpatrick, T. R.; Thirumalai, D., Phys. Rev. B, 5388 (1987) |
| [53] | Kirkpatrick, T. R.; Wolynes, P. G., Phys. Rev. B, 8552 (1987) |
| [54] | Derrida, B., Phys. Rev. B, 2613 (1981) |
| [55] | Gross, D. J.; Mézard, M., Nuclear Phys. B, 431 (1984) |
| [56] | Gross, D.; Kanter, I.; Sompolinsky, H., Phys. Rev. Lett., 304 (1985) |
| [57] | Gardner, E., Nuclear Phys. B, 747 (1985) |
| [58] | Kirkpatrick, T. R.; Thirumalai, D.; Wolynes, P. G., Phys. Rev. A, 1045 (1989) |
| [59] | Crisanti, A.; Sommers, H.-J., Z. Phys. B Condensed Matter, 341 (1992) |
| [60] | Crisanti, A.; Horner, H.; Sommers, H.-J., Z. Phys. B Condensed Matter, 257 (1993) |
| [61] | Folena, G., The mixed p-spin model : selecting, following and losing states (2020), https://tel.archives-ouvertes.fr/tel-02883385 |
| [62] | Sompolinsky, H.; Zippelius, A., Phys. Rev. Lett., 359 (1981) |
| [63] | Sompolinsky, H.; Zippelius, A., Phys. Rev. B, 6860 (1982) |
| [64] | Franz, S.; Tria, F., J. Stat. Phys., 313 (2006) |
| [65] | Auffinger, A.; Arous, G. B., Ann. Probab., 4214 (2013) |
| [66] | Auffinger, A.; Arous, G. B.; Cernỳ̌, J., Comm. Pure Appl. Math., 165 (2013) |
| [67] | Subag, E., Invent. Math., 135 (2017) |
| [68] | Auffinger, A.; Chen, W.-K., Adv. Math., 553 (2018) |
| [69] | Arous, G. B.; Subag, E.; Zeitouni, O., Comm. Pure Appl. Math., 1732 (2020) |
| [70] | Kosterlitz, J. M.; Thouless, D. J.; Jones, R. C., Phys. Rev. Lett., 1217 (1976) |
| [71] | Barbier, D.; Cugliandolo, L. F.; Lozano, G. S.; Nessi, N., Europhys. Lett., 50002 (2020) |
| [72] | Mézard, M.; Parisi, G.; Virasoro, M. A., Spin Glass Theory and beyond (1987), World Scientific · Zbl 0992.82500 |
| [73] | Sastry, S.; Debenedetti, P. G.; Stillinger, F. H., Nature, 554 (1998) |
| [74] | Franz, S.; Parisi, G., J. Physique I, 1401 (1995) |
| [75] | Monasson, R., Phys. Rev. Lett., 2847 (1995) |
| [76] | Götze, W., Complex Dynamics of Glass-Forming Liquids: A Mode-Coupling Theory, Vol. 143 (2008), OUP Oxford |
| [77] | Kurchan, J.; Parisi, G.; Virasoro, M. A., J. Physique I, 1819 (1993) |
| [78] | Crisanti, A.; Sommers, H.-J., J. Physique I, 805 (1995) |
| [79] | Folena, G.; Franz, S.; Ricci-Tersenghi, F., J. Stat. Mech. Theory Exp. (2021) |
| [80] | Barrat, A.; Franz, S.; Parisi, G., J. Phys. A: Math. Gen., 5593 (1997) |
| [81] | Barrat, A.; Burioni, R.; Mézard, M., J. Phys. A: Math. Gen., L81 (1996) · Zbl 0943.82586 |
| [82] | Cavagna, A.; Giardina, I.; Parisi, G., Phys. Rev. B, 11251 (1998) |
| [83] | Sun, Y.; Crisanti, A.; Krzakala, F.; Leuzzi, L.; Zdeborová, L., J. Stat. Mech. Theory Exp., P07002 (2012) |
| [84] | Bouchaud, J.-P., J. Physique I, 1705 (1992) |
| [85] | Bouchaud, J.; Cugliandolo, L.; Kurchan, J.; Mezard, M., arXiv.org:cond-mat/9702070 |
| [86] | Franz, S.; Marinari, E.; Parisi, G., J. Phys. A: Math. Gen., 5437 (1995) |
| [87] | Ozawa, M.; Kuroiwa, T.; Ikeda, A.; Miyazaki, K., Phys. Rev. Lett. (2012) |
| [88] | Charbonneau, P.; Morse, P. K., Phys. Rev. Lett. (2021) |
| [89] | Montanari, A.; Semerjian, G., J. Stat. Phys., 23 (2006) |
| [90] | Rosenblatt, F., Psychol. Rev., 386 (1958) |
| [91] | Block, H.-D., Rev. Modern Phys., 123 (1962) |
| [92] | Gardner, E.; Derrida, B., J. Phys. A: Math. Gen., 271 (1988) |
| [93] | Abbaras, Alia; Aubin, Benjamin; Krzakala, Florent; Zdeborová, Lenka, Rademacher complexity and spin glasses: a link between the replica and statistical theories of learning. Proceedings of The First Mathematical and Scientific Machine Learning Conference. Proceedings of Machine Learning Research, 27-54 (2020), PMLR |
| [94] | Franz, S.; Parisi, G.; Sevelev, M.; Urbani, P.; Zamponi, F.; Sevelev, M., SciPost Phys., 019 (2017) |
| [95] | Hwang, S.; Ikeda, H., Phys. Rev. E (2020) |
| [96] | Mézard, M., J. Phys. A: Math. Gen., 2181 (1989) |
| [97] | Altieri, A.; Franz, S.; Parisi, G., J. Stat. Mech. Theory Exp. (2016) |
| [98] | Altieri, A., Phys. Rev. E (2018) |
| [99] | Agoritsas, E.; Biroli, G.; Urbani, P.; Zamponi, F., J. Phys. A (2018) |
| [100] | Manacorda, A.; Zamponi, F., J. Phys. A (2022) |
| [101] | Maimbourg, T.; Kurchan, J.; Zamponi, F., Phys. Rev. Lett. (2016) |
| [102] | Franz, S.; Parisi, G.; Urbani, P.; Zamponi, F., Proc. Natl. Acad. Sci., 14539 (2015) |
| [103] | Wyart, M.; Nagel, S.; Witten, T., Europhys. Lett., 486 (2005) |
| [104] | DeGiuli, E.; Laversanne-Finot, A.; Düring, G.; Lerner, E.; Wyart, M., Soft Matter, 5628 (2014) |
| [105] | Sclocchi, A.; Urbani, P., Phys. Rev. E (2022) |
| [106] | Lerner, E.; Düring, G.; Wyart, M., Europhys. Lett., 58003 (2012) |
| [107] | Ikeda, A.; Kawasaki, T.; Berthier, L.; Saitoh, K.; Hatano, T., Phys. Rev. Lett. (2020) |
| [108] | Ikeda, H., J. Chem. Phys. (2020) |
| [109] | Nishikawa, Y.; Ikeda, A.; Berthier, L., J. Stat. Phys., 1 (2021) |
| [110] | Chacko, R. N.; Sollich, P.; Fielding, S. M., Phys. Rev. Lett. (2019) |
| [111] | Nishikawa, Y.; Ozawa, M.; Ikeda, A.; Chaudhuri, P.; Berthier, L., Phys. Rev. X (2022) |
| [112] | Wyart, M., Phys. Rev. Lett. (2012) |
| [113] | Charbonneau, P.; Kurchan, J.; Parisi, G.; Urbani, P.; Zamponi, F., Nature Commun., 3725 (2014) |
| [114] | Charbonneau, P.; Corwin, E. I.; Parisi, G.; Zamponi, F., Phys. Rev. Lett. (2015) |
| [115] | Kallus, Y., Phys. Rev. E (2016) |
| [116] | Charbonneau, P.; Kurchan, J.; Parisi, G.; Urbani, P.; Zamponi, F., Annu. Rev. Condens. Matter Phys., 265 (2017) |
| [117] | Franz, S.; Sclocchi, A.; Urbani, P., Phys. Rev. Lett. (2019) |
| [118] | Franz, S.; Sclocchi, A.; Urbani, P., SciPost Phys., 012 (2020) |
| [119] | Charbonneau, P.; Corwin, E. I.; Dennis, R. C.; Rojas, R. D.H.; Ikeda, H.; Parisi, G.; Ricci-Tersenghi, F., Phys. Rev. E (2021) |
| [120] | DeGiuli, E.; Lerner, E.; Brito, C.; Wyart, M., Proc. Natl. Acad. Sci., 17054 (2014) |
| [121] | Müller, M.; Wyart, M., Ann. Rev. Cond. Mat., 177 (2015) |
| [122] | Biroli, G.; Charbonneau, P.; Hu, Y.; Ikeda, H.; Szamel, G.; Zamponi, F., J. Phys. Chem. B, 6244 (2021) |
| [123] | Ikeda, H.; Urbani, P.; Zamponi, F., J. Phys. A (2019) |
| [124] | Brito, C.; Ikeda, H.; Urbani, P.; Wyart, M.; Zamponi, F., Proc. Natl. Acad. Sci., 11736 (2018) |
| [125] | Franz, S.; Sclocchi, A.; Urbani, P., J. Stat. Mech. Theory Exp. (2021) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
