Showing 1–50 of 215 results for author: Garrahan, J P

The quantum Newman-Moore model in a longitudinal field

Authors: Konstantinos Sfairopoulos, Juan P. Garrahan

Abstract: We study the quantum Newman-Moore model, or quantum triangular plaquette model (qTPM), in the presence of a longitudinal field (qTPMz). We present evidence that indicates that the ground state phase diagram of the qTPMz includes various frustrated phases breaking translational symmetries, dependent on the specific sequence of system sizes used to take the large-size limit. This phase diagram inclu… ▽ More We study the quantum Newman-Moore model, or quantum triangular plaquette model (qTPM), in the presence of a longitudinal field (qTPMz). We present evidence that indicates that the ground state phase diagram of the qTPMz includes various frustrated phases breaking translational symmetries, dependent on the specific sequence of system sizes used to take the large-size limit. This phase diagram includes the known first-order phase transition of the qTPM, but also additional first-order transitions due to the frustrated phases. Using the average longitudinal magnetization as an order parameter, we analyze the magnetization plateaus that characterize the ground state phases, describe their degeneracies, and obtain the qTPMz phase diagram using classical transfer matrix and quantum matrix product state techniques. We identify a region of parameter space which can be effectively described by a Rydberg blockade model on the triangular lattice and also find indications of $\mathbb{Z}_2$ topological order connecting the quantum paramagnetic and classical frustrated phases. △ Less

Submitted 13 September, 2024; originally announced September 2024.

Comments: 15 pages and figures

Efficient post-selection in light-cone correlations of monitored quantum circuits

Authors: Jimin Li, Robert L. Jack, Bruno Bertini, Juan P. Garrahan

Abstract: We consider how to target evolution conditioned on atypical measurement outcomes in monitored quantum circuits, i.e., the post-selection problem. We show that for a simple class of measurement schemes, post-selected light-cone dynamical correlation functions can be obtained efficiently from the averaged correlations of a different unitary circuit. This connects rare measurement outcomes in one cir… ▽ More We consider how to target evolution conditioned on atypical measurement outcomes in monitored quantum circuits, i.e., the post-selection problem. We show that for a simple class of measurement schemes, post-selected light-cone dynamical correlation functions can be obtained efficiently from the averaged correlations of a different unitary circuit. This connects rare measurement outcomes in one circuit to typical outcomes in another one. We derive conditions for the existence of this rare-to-typical mapping in brickwork quantum circuits made of XYZ gates. We illustrate these general results with a model system that exhibits a dynamical crossover (a smoothed dynamical transition) in event statistics, and discuss extensions to more general dynamical correlations. △ Less

Submitted 29 August, 2024; v1 submitted 23 August, 2024; originally announced August 2024.

Discrete generative diffusion models without stochastic differential equations: a tensor network approach

Authors: Luke Causer, Grant M. Rotskoff, Juan P. Garrahan

Abstract: Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard DMs, this is done by learning a ``score function'' that reverses the effect of adding diffusive noise to the distribution of interest. Here we consider the general… ▽ More Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard DMs, this is done by learning a ``score function'' that reverses the effect of adding diffusive noise to the distribution of interest. Here we consider the generalisation of DMs to lattice systems with discrete degrees of freedom, and where noise is added via Markov chain jump dynamics. We show how to use tensor networks (TNs) to efficiently define and sample such ``discrete diffusion models'' (DDMs) without explicitly having to solve a stochastic differential equation. We show the following: (i) by parametrising the data and evolution operators as TNs, the denoising dynamics can be represented exactly; (ii) the auto-regressive nature of TNs allows to generate samples efficiently and without bias; (iii) for sampling Boltzmann-like distributions, TNs allow to construct an efficient learning scheme that integrates well with Monte Carlo. We illustrate this approach to study the equilibrium of two models with non-trivial thermodynamics, the $d=1$ constrained Fredkin chain and the $d=2$ Ising model. △ Less

Submitted 15 July, 2024; originally announced July 2024.

Comments: 20 pages, 17 figures

Exact results on the dynamics of the stochastic Floquet-East model

Authors: Cecilia De Fazio, Juan P. Garrahan, Katja Klobas

Abstract: We introduce a stochastic generalisation of the classical deterministic Floquet-East model, a discrete circuit with the same kinetic constraint as the East model of glasses. We prove exactly that, in the limit of long time and large size, this model has a large deviation phase transition between active and inactive dynamical phases. We also compute the finite time and size scaling of general space… ▽ More We introduce a stochastic generalisation of the classical deterministic Floquet-East model, a discrete circuit with the same kinetic constraint as the East model of glasses. We prove exactly that, in the limit of long time and large size, this model has a large deviation phase transition between active and inactive dynamical phases. We also compute the finite time and size scaling of general space-time fluctuations, which for the case of inactive regions gives rise to dynamical hydrophobicity. We also discuss how, through the Trotter limit, these exact results also hold for the continuous-time East model, thus proving long-standing observations in kinetically constrained models. Our results here illustrate the applicability of exact tensor network methods for solving problems in many-body stochastic systems. △ Less

Submitted 25 June, 2024; originally announced June 2024.

Comments: 14 pages, 3 figures

Bounds on Fluctuations of First Passage Times for Counting Observables in Classical and Quantum Markov Processes

Authors: George Bakewell-Smith, Federico Girotti, Mădălin Guţă, Juan P. Garrahan

Abstract: We study the statistics of first passage times (FPTs) of trajectory observables in both classical and quantum Markov processes. We consider specifically the FPTs of counting observables, that is, the times to reach a certain threshold of a trajectory quantity which takes values in the positive integers and is non-decreasing in time. For classical continuous-time Markov chains we rigorously prove:… ▽ More We study the statistics of first passage times (FPTs) of trajectory observables in both classical and quantum Markov processes. We consider specifically the FPTs of counting observables, that is, the times to reach a certain threshold of a trajectory quantity which takes values in the positive integers and is non-decreasing in time. For classical continuous-time Markov chains we rigorously prove: (i) a large deviation principle (LDP) for FPTs, whose corollary is a strong law of large numbers; (ii) a concentration inequality for the FPT of the dynamical activity, which provides an upper bound to the probability of its fluctuations to all orders; and (iii) an upper bound to the probability of the tails for the FPT of an arbitrary counting observable. For quantum Markov processes we rigorously prove: (iv) the quantum version of the LDP, and subsequent strong law of large numbers, for the FPTs of generic counts of quantum jumps; (v) a concentration bound for the the FPT of total number of quantum jumps, which provides an upper bound to the probability of its fluctuations to all orders, together with a similar bound for the sub-class of quantum reset processes which requires less strict irreducibility conditions; and (vi) a tail bound for the FPT of arbitrary counts. Our results allow to extend to FPTs the so-called "inverse thermodynamic uncertainty relations" that upper bound the size of fluctuations in time-integrated quantities. We illustrate our results with simple examples. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Dynamical heterogeneity and large deviations in the open quantum East glass model from tensor networks

Authors: Luke Causer, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: We study the non-equilibrium dynamics of the dissipative quantum East model via numerical tensor networks. We use matrix product states to represent evolution under quantum-jump unravellings for sizes beyond those accessible to exact diagonalisation. This allows us to demonstrate that dynamical heterogeneity accompanies slow relaxation, in analogy with what is seen in classical glassy systems. Fur… ▽ More We study the non-equilibrium dynamics of the dissipative quantum East model via numerical tensor networks. We use matrix product states to represent evolution under quantum-jump unravellings for sizes beyond those accessible to exact diagonalisation. This allows us to demonstrate that dynamical heterogeneity accompanies slow relaxation, in analogy with what is seen in classical glassy systems. Furthermore, using variational matrix product operators we: (i) compute the spectral gap of the Lindbladian, and show that glassiness is enhanced in the presence of weak quantum fluctuations compared to the pure classical case, and (ii) obtain the dynamical large deviations by calculating the leading eigenvector of the tilted Lindbladian, and find clear evidence for a first-order active-inactive dynamical phase transition. We also show how to directly sample the rare quantum trajectories associated to the large deviations. △ Less

Submitted 18 July, 2024; v1 submitted 4 April, 2024; originally announced April 2024.

Comments: 5+11 pages, 4+6 figures, added SM

Quantum many-body scars and non-thermal behaviour in Fredkin spin chains

Authors: Luke Causer, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: We study the dynamics and thermalization of the Fredkin spin chain, a system with local three-body interactions, particle conservation and explicit kinetic constraints. We consider deformations away from its stochastic point in order to tune between regimes where kinetic energy dominates and those where potential energy does. By means of exact diagonalisation, perturbation theory and variational m… ▽ More We study the dynamics and thermalization of the Fredkin spin chain, a system with local three-body interactions, particle conservation and explicit kinetic constraints. We consider deformations away from its stochastic point in order to tune between regimes where kinetic energy dominates and those where potential energy does. By means of exact diagonalisation, perturbation theory and variational matrix product states, we show that the stochastic point is where a transition occurs between a phase of fast thermalization to one of slow metastable (prethermal) dynamics. This change in relaxation is connected to the emergence of additional kinetic constraints which lead to the fragmentation of Hilbert space in the limit of a large potential energy. We also show that this transition can lead to thermalization being evaded for special initial conditions due to non-thermal eigenstates (akin to quantum many-body scars). We provide clear evidence for the existence of these non-thermal states for large system sizes even when far from the large-potential-energy limit, and explain their connection to the emergent kinetic constraints. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 11+3 pages, 9+1 figures

Universal and nonuniversal probability laws in Markovian open quantum dynamics subject to generalized reset processes

Authors: Federico Carollo, Igor Lesanovsky, Juan P. Garrahan

Abstract: We consider quantum jump trajectories of Markovian open quantum systems subject to stochastic in time resets of their state to an initial configuration. The reset events provide a partitioning of quantum trajectories into consecutive time intervals, defining sequences of random variables from the values of a trajectory observable within each of the intervals. For observables related to functions o… ▽ More We consider quantum jump trajectories of Markovian open quantum systems subject to stochastic in time resets of their state to an initial configuration. The reset events provide a partitioning of quantum trajectories into consecutive time intervals, defining sequences of random variables from the values of a trajectory observable within each of the intervals. For observables related to functions of the quantum state, we show that the probability of certain orderings in the sequences obeys a universal law. This law does not depend on the chosen observable and, in case of Poissonian reset processes, not even on the details of the dynamics. When considering (discrete) observables associated with the counting of quantum jumps, the probabilities in general lose their universal character. Universality is only recovered in cases when the probability of observing equal outcomes in a same sequence is vanishingly small, which we can achieve in a weak reset rate limit. Our results extend previous findings on classical stochastic processes [N.~R.~Smith et al., EPL {\bf 142}, 51002 (2023)] to the quantum domain and to state-dependent reset processes, shedding light on relevant aspects for the emergence of universal probability laws. △ Less

Submitted 24 October, 2023; v1 submitted 10 October, 2023; originally announced October 2023.

Comments: 13 pages, 5 figures

Exact quench dynamics of the Floquet quantum East model at the deterministic point

Authors: Bruno Bertini, Cecilia De Fazio, Juan P. Garrahan, Katja Klobas

Abstract: We study the nonequilibrium dynamics of the Floquet quantum East model (a Trotterized version of the kinetically constrained quantum East spin chain) at its "deterministic point", where evolution is defined in terms of CNOT permutation gates. We solve exactly the thermalization dynamics for a broad class of initial product states by means of "space evolution". We prove: (i) the entanglement of a b… ▽ More We study the nonequilibrium dynamics of the Floquet quantum East model (a Trotterized version of the kinetically constrained quantum East spin chain) at its "deterministic point", where evolution is defined in terms of CNOT permutation gates. We solve exactly the thermalization dynamics for a broad class of initial product states by means of "space evolution". We prove: (i) the entanglement of a block of spins grows at most at one-half the maximal speed allowed by locality (i.e., half the speed of dual-unitary circuits); (ii) if the block of spins is initially prepared in a classical configuration, speed of entanglement is a quarter of the maximum; (iii) thermalization to the infinite temperature state is reached exactly in a time that scales with the size of the block. △ Less

Submitted 19 April, 2024; v1 submitted 9 October, 2023; originally announced October 2023.

Comments: 19 pages, 3 figures

Journal ref: Phys. Rev. Lett. 132, 120402 (2024)

Cellular automata in $d$ dimensions and ground states of spin models in $(d+1)$ dimensions

Authors: Konstantinos Sfairopoulos, Luke Causer, Jamie F. Mair, Juan P. Garrahan

Abstract: We show how the trajectories of $d$-dimensional cellular automata (CA) can be used to determine the ground states of $(d+1)$-dimensional classical spin models, and we characterise their quantum phase transition, when in the presence of a transverse magnetic field. For each of the 256 one-dimensional elementary CA we explicitly construct the simplest local two-dimensional classical spin model assoc… ▽ More We show how the trajectories of $d$-dimensional cellular automata (CA) can be used to determine the ground states of $(d+1)$-dimensional classical spin models, and we characterise their quantum phase transition, when in the presence of a transverse magnetic field. For each of the 256 one-dimensional elementary CA we explicitly construct the simplest local two-dimensional classical spin model associated to the given CA, and we also describe this method for $d>1$ through selected examples. We illustrate our general observations with detailed studies of: (i) the $d=1$ CA Rule 150 and its $d=2$ four-body plaquette spin model, (ii) the $d=2$ CA whose associated model is the $d=3$ square-pyramid plaquette model, and (iii) two counter-propagating $d=1$ Rule 60 CA that correspond to the two-dimensional Baxter-Wu spin model. For the quantum spin models, we show that the connection to CAs implies a sensitivity on the approach to the thermodynamic limit via finite size scaling for their quantum phase transitions. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Comments: 22 pages, 21 figures

Minibatch training of neural network ensembles via trajectory sampling

Authors: Jamie F. Mair, Luke Causer, Juan P. Garrahan

Abstract: Most iterative neural network training methods use estimates of the loss function over small random subsets (or minibatches) of the data to update the parameters, which aid in decoupling the training time from the (often very large) size of the training datasets. Here, we show that a minibatch approach can also be used to train neural network ensembles (NNEs) via trajectory methods in a highly eff… ▽ More Most iterative neural network training methods use estimates of the loss function over small random subsets (or minibatches) of the data to update the parameters, which aid in decoupling the training time from the (often very large) size of the training datasets. Here, we show that a minibatch approach can also be used to train neural network ensembles (NNEs) via trajectory methods in a highly efficient manner. We illustrate this approach by training NNEs to classify images in the MNIST datasets. This method gives an improvement to the training times, allowing it to scale as the ratio of the size of the dataset to that of the average minibatch size which, in the case of MNIST, gives a computational improvement typically of two orders of magnitude. We highlight the advantage of using longer trajectories to represent NNEs, both for improved accuracy in inference and reduced update cost in terms of the samples needed in minibatch updates. △ Less

Submitted 27 June, 2023; v1 submitted 23 June, 2023; originally announced June 2023.

Comments: 11 pages, 4 figures, 1 algorithm

Rejection-free quantum Monte Carlo in continuous time from transition path sampling

Authors: Luke Causer, Konstantinos Sfairopoulos, Jamie F. Mair, Juan P. Garrahan

Abstract: Continuous-time quantum Monte Carlo refers to a class of algorithms designed to sample the thermal distribution of a quantum Hamiltonian through exact expansions of the Boltzmann exponential in terms of stochastic trajectories which are periodic in imaginary time. Here, we show that for (sign-problem-free) quantum many-body systems with discrete degrees of freedom -- such as spins on a lattice --… ▽ More Continuous-time quantum Monte Carlo refers to a class of algorithms designed to sample the thermal distribution of a quantum Hamiltonian through exact expansions of the Boltzmann exponential in terms of stochastic trajectories which are periodic in imaginary time. Here, we show that for (sign-problem-free) quantum many-body systems with discrete degrees of freedom -- such as spins on a lattice -- this sampling can be done in a rejection-free manner using transition path sampling (TPS). The key idea is to converge the trajectory ensemble through updates where one individual degree of freedom is modified across all time while the remaining unaltered ones provide a time-dependent background. The ensuing single-body dynamics provides a way to generate trajectory updates exactly, allowing one to obtain the target ensemble efficiently via rejection-free TPS. We demonstrate our method on the transverse field Ising model in one and two dimensions, and on the quantum triangular plaquette (or Newman-Moore) model. We show that despite large autocorrelation times, our method is able to efficiently recover the respective quantum phase transition of each model. We also discuss the connection to rare event sampling in continuous-time Markov dynamics. △ Less

Submitted 16 July, 2024; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: 14+4 pages, 6+3 figures, updated to final version

Journal ref: Phys. Rev. B 109, 024307 (2024)

Exact pre-transition effects in kinetically constrained circuits: dynamical fluctuations in the Floquet-East model

Authors: Katja Klobas, Cecilia De Fazio, Juan P. Garrahan

Abstract: We study the dynamics of a classical circuit corresponding to a discrete-time kinetically constrained East model. We show that this classical "Floquet-East" model displays pre-transition behaviour which is a dynamical equivalent of the hydrophobic effect in water. For the deterministic version of the model we prove exactly: (i) a change in scaling with size in the probability of inactive space-tim… ▽ More We study the dynamics of a classical circuit corresponding to a discrete-time kinetically constrained East model. We show that this classical "Floquet-East" model displays pre-transition behaviour which is a dynamical equivalent of the hydrophobic effect in water. For the deterministic version of the model we prove exactly: (i) a change in scaling with size in the probability of inactive space-time regions (akin to the "energy-entropy" crossover of the solvation free energy in water), (ii) a first-order phase transition in the dynamical large deviations, (iii) the existence of the optimal geometry for local phase separation to accommodate space-time solutes, and (iv) a dynamical analog of "hydrophobic collapse". △ Less

Submitted 17 September, 2024; v1 submitted 12 May, 2023; originally announced May 2023.

Comments: 15 pages, 5 figures; v4 final version, as appears in Phys. Rev. E

Journal ref: Phys. Rev. E 110, L022101 (2024)

Quantum reaction-limited reaction-diffusion dynamics of annihilation processes

Authors: Gabriele Perfetto, Federico Carollo, Juan P. Garrahan, Igor Lesanovsky

Abstract: We investigate the quantum reaction-diffusion dynamics of fermionic particles which coherently hop in a one-dimensional lattice and undergo annihilation reactions. The latter are modelled as dissipative processes which involve losses of pairs $2A \to \emptyset$, triplets $3A \to \emptyset$, and quadruplets $4A \to \emptyset$ of neighbouring particles. When considering classical particles, the corr… ▽ More We investigate the quantum reaction-diffusion dynamics of fermionic particles which coherently hop in a one-dimensional lattice and undergo annihilation reactions. The latter are modelled as dissipative processes which involve losses of pairs $2A \to \emptyset$, triplets $3A \to \emptyset$, and quadruplets $4A \to \emptyset$ of neighbouring particles. When considering classical particles, the corresponding decay of their density in time follows an asymptotic power-law behavior. The associated exponent in one dimension is different from the mean-field prediction whenever diffusive mixing is not too strong and spatial correlations are relevant. This specifically applies to $2A\to \emptyset$, while the mean-field power-law prediction just acquires a logarithmic correction for $3A \to \emptyset$ and is exact for $4A \to \emptyset$. A mean-field approach is also valid, for all the three processes, when the diffusive mixing is strong, i.e., in the so-called reaction-limited regime. Here, we show that the picture is different for quantum systems. We consider the quantum reaction-limited regime and we show that for all the three processes power-law behavior beyond mean field is present as a consequence of quantum coherences, which are not related to space dimensionality. The decay in $3A\to \emptyset$ is further, highly intricate, since the power-law behavior therein only appears within an intermediate time window, while at long times the density decay is not power-law. Our results show that emergent critical behavior in quantum dynamics has a markedly different origin, based on quantum coherences, to that applying to classical critical phenomena, which is, instead, solely determined by the relevance of spatial correlations. △ Less

Submitted 28 December, 2023; v1 submitted 11 May, 2023; originally announced May 2023.

Comments: 17 pages: 10 pages main text, 5 pages appendices and 2 pages bibliography. 6 figures: 4 figures in main text, 2 figures in the appendices

Journal ref: Phys. Rev. E 108, 064104 (2023)

Slow heterogeneous relaxation due to constraints in dual XXZ models

Authors: Lenart Zadnik, Juan P. Garrahan

Abstract: With the aim to understand the role of the constraints in the thermalisation of quantum systems, we study the dynamics of a family of kinetically constrained models arising through duality from the XXZ spin chain. We find that integrable and nonintegrable deformations around the stochastic point give rise to ground state phase transitions between localised and delocalised phases, which in turn det… ▽ More With the aim to understand the role of the constraints in the thermalisation of quantum systems, we study the dynamics of a family of kinetically constrained models arising through duality from the XXZ spin chain. We find that integrable and nonintegrable deformations around the stochastic point give rise to ground state phase transitions between localised and delocalised phases, which in turn determine the nature of the relaxation dynamics at finite energy densities. While in the delocalised phase thermalisation is fast and homogeneous, in the localised phase relaxation is slow, temporal autocorrelations exhibit plateaus indicative of metastability, and the growth of entanglement is heterogeneous in space. Furthermore, by considering relaxation from initial product states, we demostrate that this slow thermalisation can be rationalised directly from the presence of constraints in the dynamics. △ Less

Submitted 20 April, 2023; originally announced April 2023.

Comments: 7 pages, 4 figures

Boundary conditions dependence of the phase transition in the quantum Newman-Moore model

Authors: Konstantinos Sfairopoulos, Luke Causer, Jamie F. Mair, Juan P. Garrahan

Abstract: We study the triangular plaquette model (TPM, also known as the Newman-Moore model) in the presence of a transverse magnetic field on a lattice with periodic boundaries in both spatial dimensions. We consider specifically the approach to the ground state phase transition of this quantum TPM (QTPM, or quantum Newman-Moore model) as a function of the system size and type of boundary conditions. Usin… ▽ More We study the triangular plaquette model (TPM, also known as the Newman-Moore model) in the presence of a transverse magnetic field on a lattice with periodic boundaries in both spatial dimensions. We consider specifically the approach to the ground state phase transition of this quantum TPM (QTPM, or quantum Newman-Moore model) as a function of the system size and type of boundary conditions. Using cellular automata methods, we obtain a full characterization of the minimum energy configurations of the TPM for arbitrary tori sizes. For the QTPM, we use these cycle patterns to obtain the symmetries of the model, which we argue determine its quantum phase transition: we find it to be a first-order phase transition, with the addition of spontaneous symmetry breaking for system sizes which have degenerate classical ground states. For sizes accessible to numerics, we also find that this classification is consistent with exact diagonalization, Matrix Product States and Quantum Monte Carlo simulations. △ Less

Submitted 28 March, 2023; v1 submitted 7 January, 2023; originally announced January 2023.

Comments: fixed unclear point, given the correct credit to citation

Inverse thermodynamic uncertainty relations: general upper bounds on the fluctuations of trajectory observables

Authors: George Bakewell-Smith, Federico Girotti, Mădălin Guţă, Juan P. Garrahan

Abstract: Thermodynamic uncertainty relations (TURs) are general lower bounds on the size of fluctutations of dynamical observables. They have important consequences, one being that the precision of estimation of a current is limited by the amount of entropy production. Here we prove the existence of general upper bounds on the size of fluctuations of any linear combination of fluxes (including all time-int… ▽ More Thermodynamic uncertainty relations (TURs) are general lower bounds on the size of fluctutations of dynamical observables. They have important consequences, one being that the precision of estimation of a current is limited by the amount of entropy production. Here we prove the existence of general upper bounds on the size of fluctuations of any linear combination of fluxes (including all time-integrated currents or dynamical activities) for continuous-time Markov chains. We obtain these general relations by means of concentration bound techniques. These ``inverse TURs'' are valid for all times and not only in the long time limit. We illustrate our analytical results with a simple model, and discuss wider implications of these new relations. △ Less

Submitted 10 October, 2022; originally announced October 2022.

MSC Class: 82C05; 60J27

Combining Reinforcement Learning and Tensor Networks, with an Application to Dynamical Large Deviations

Authors: Edward Gillman, Dominic C. Rose, Juan P. Garrahan

Abstract: We present a framework to integrate tensor network (TN) methods with reinforcement learning (RL) for solving dynamical optimisation tasks. We consider the RL actor-critic method, a model-free approach for solving RL problems, and introduce TNs as the approximators for its policy and value functions. Our "actor-critic with tensor networks" (ACTeN) method is especially well suited to problems with l… ▽ More We present a framework to integrate tensor network (TN) methods with reinforcement learning (RL) for solving dynamical optimisation tasks. We consider the RL actor-critic method, a model-free approach for solving RL problems, and introduce TNs as the approximators for its policy and value functions. Our "actor-critic with tensor networks" (ACTeN) method is especially well suited to problems with large and factorisable state and action spaces. As an illustration of the applicability of ACTeN we solve the exponentially hard task of sampling rare trajectories in two paradigmatic stochastic models, the East model of glasses and the asymmetric simple exclusion process (ASEP), the latter being particularly challenging to other methods due to the absence of detailed balance. With substantial potential for further integration with the vast array of existing RL methods, the approach introduced here is promising both for applications in physics and to multi-agent RL problems more generally. △ Less

Submitted 5 April, 2024; v1 submitted 28 September, 2022; originally announced September 2022.

Comments: [v1]: Combined main text of 6 pages, 3 figures and supplemental materials of 7 pages, 1 figure. [v2]: Accepted version, Phys. Rev. Lett. Combined main text of 8 pages, 4 figures and supplemental materials of 5 pages

Optimal sampling of dynamical large deviations in two dimensions via tensor networks

Authors: Luke Causer, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: We use projected entangled-pair states (PEPS) to calculate the large deviations (LD) statistics of the dynamical activity of the two dimensional East model, and the two dimensional symmetric simple exclusion process (SSEP) with open boundaries, in lattices of up to 40x40 sites. We show that at long-times both models have phase transitions between active and inactive dynamical phases. For the 2D Ea… ▽ More We use projected entangled-pair states (PEPS) to calculate the large deviations (LD) statistics of the dynamical activity of the two dimensional East model, and the two dimensional symmetric simple exclusion process (SSEP) with open boundaries, in lattices of up to 40x40 sites. We show that at long-times both models have phase transitions between active and inactive dynamical phases. For the 2D East model we find that this trajectory transition is of the first-order, while for the SSEP we find indications of a second order transition. We then show how the PEPS can be used to implement a trajectory sampling scheme capable of directly accessing rare trajectories. We also discuss how the methods described here can be extended to study rare events at finite times. △ Less

Submitted 18 July, 2024; v1 submitted 23 September, 2022; originally announced September 2022.

Comments: 6+7 pages, 4+9 figures, added most updated version and SM

Journal ref: Phys. Rev. Lett. 130, 147401 (2021)

Training neural network ensembles via trajectory sampling

Authors: Jamie F. Mair, Dominic C. Rose, Juan P. Garrahan

Abstract: In machine learning, there is renewed interest in neural network ensembles (NNEs), whereby predictions are obtained as an aggregate from a diverse set of smaller models, rather than from a single larger model. Here, we show how to define and train a NNE using techniques from the study of rare trajectories in stochastic systems. We define an NNE in terms of the trajectory of the model parameters un… ▽ More In machine learning, there is renewed interest in neural network ensembles (NNEs), whereby predictions are obtained as an aggregate from a diverse set of smaller models, rather than from a single larger model. Here, we show how to define and train a NNE using techniques from the study of rare trajectories in stochastic systems. We define an NNE in terms of the trajectory of the model parameters under a simple, and discrete in time, diffusive dynamics, and train the NNE by biasing these trajectories towards a small time-integrated loss, as controlled by appropriate counting fields which act as hyperparameters. We demonstrate the viability of this technique on a range of simple supervised learning tasks. We discuss potential advantages of our trajectory sampling approach compared with more conventional gradient based methods. △ Less

Submitted 10 May, 2023; v1 submitted 22 September, 2022; originally announced September 2022.

Comments: 12 pages, 5 figures, 1 appendix

Reaction-limited quantum reaction-diffusion dynamics

Authors: Gabriele Perfetto, Federico Carollo, Juan P. Garrahan, Igor Lesanovsky

Abstract: We consider the quantum nonequilibrium dynamics of systems where fermionic particles coherently hop on a one-dimensional lattice and are subject to dissipative processes analogous to those of classical reaction-diffusion models. Particles can either annihilate in pairs, $A+A \to \emptyset$, coagulate upon contact, $A+A \to A$, and possibly also branch, $A \to A+A$. In classical settings, the inter… ▽ More We consider the quantum nonequilibrium dynamics of systems where fermionic particles coherently hop on a one-dimensional lattice and are subject to dissipative processes analogous to those of classical reaction-diffusion models. Particles can either annihilate in pairs, $A+A \to \emptyset$, coagulate upon contact, $A+A \to A$, and possibly also branch, $A \to A+A$. In classical settings, the interplay between these processes and particle diffusion leads to critical dynamics as well as to absorbing-state phase transitions. Here, we analyze the impact of coherent hopping and of quantum superposition, focusing on the so-called reaction-limited regime. Here, spatial density fluctuations are quickly smoothed out due to fast hopping, which for classical systems is described by a mean-field approach. By exploiting the time-dependent generalized Gibbs ensemble method, we demonstrate that quantum coherence and destructive interference play a crucial role in these systems and are responsible for the emergence of locally protected dark states and collective behavior beyond mean-field. This can manifest both at stationarity and during the relaxation dynamics. Our results highlight fundamental differences between classical nonequilibrium dynamics and their quantum counterpart and show that quantum effects indeed change collective universal behavior. △ Less

Submitted 30 May, 2023; v1 submitted 20 September, 2022; originally announced September 2022.

Comments: 6+11 pages, 2+2 figures for main text and supplemental material, respectively. v3: close to published version. Selected as "Editors' Suggestion" in Physical Review Letters

Journal ref: Phys. Rev. Lett. 130, 210402 (2023)

Slow dynamics and non-ergodicity of the bosonic quantum East model in the semiclassical limit

Authors: Andreas Geißler, Juan P. Garrahan

Abstract: We study the unitary dynamics of the bosonic quantum East model, a kinetically constrained lattice model which generalises the quantum East model to arbitrary occupation per site. We consider the semiclassical limit of large (but finite) site occupancy, so that the dynamics are approximated by an evolution equation of the Gross-Pitaevskii kind. This allows us to numerically study in detail system… ▽ More We study the unitary dynamics of the bosonic quantum East model, a kinetically constrained lattice model which generalises the quantum East model to arbitrary occupation per site. We consider the semiclassical limit of large (but finite) site occupancy, so that the dynamics are approximated by an evolution equation of the Gross-Pitaevskii kind. This allows us to numerically study in detail system sizes of hundreds of sites. Like in the spin-$1/2$ case, we find two dynamical phases, an active one of fast thermalisation, and an inactive one of slow relaxation and absence of ergodicity on numerically accessible timescales. The location of this apparent ergodic to non-ergodic transition coincides with the localisation transition of the ground state. We further characterize states which are non-ergodic on all timescales in the otherwise ergodic regime. △ Less

Submitted 14 September, 2022; originally announced September 2022.

Comments: 7 pages, 4 figures

Concentration Inequalities for Output Statistics of Quantum Markov Processes

Authors: Federico Girotti, Juan P. Garrahan, Mădălin Guţă

Abstract: We derive new concentration bounds for time averages of measurement outcomes in quantum Markov processes. This generalizes well-known bounds for classical Markov chains which provide constraints on finite time fluctuations of time-additive quantities around their averages. We employ spectral, perturbation and martingale techniques, together with noncommutative $L_2$ theory, to derive: (i) a Bernst… ▽ More We derive new concentration bounds for time averages of measurement outcomes in quantum Markov processes. This generalizes well-known bounds for classical Markov chains which provide constraints on finite time fluctuations of time-additive quantities around their averages. We employ spectral, perturbation and martingale techniques, together with noncommutative $L_2$ theory, to derive: (i) a Bernstein-type concentration bound for time averages of the measurement outcomes of a quantum Markov chain, (ii) a Hoeffding-type concentration bound for the same process, (iii) a generalization of the Bernstein-type concentration bound for counting processes of continuous time quantum Markov processes, (iv) new concentration bounds for empirical fluxes of classical Markov chains which broaden the range of applicability of the corresponding classical bounds beyond empirical averages. We also suggest potential application of our results to parameter estimation and consider extensions to reducible quantum channels, multi-time statistics and time-dependent measurements, and comment on the connection to so-called thermodynamic uncertainty relations. △ Less

Submitted 10 October, 2022; v1 submitted 28 June, 2022; originally announced June 2022.

Anderson and many-body localization in the presence of spatially correlated classical noise

Authors: Stefano Marcantoni, Federico Carollo, Filippo M. Gambetta, Igor Lesanovsky, Ulrich Schneider, Juan P. Garrahan

Abstract: We study the effect of spatially correlated classical noise on both Anderson and many-body localization of a disordered fermionic chain. By analyzing the evolution of the particle density imbalance following a quench from an initial charge density wave state, we find prominent signatures of localization also in the presence of the time-dependent noise, even though the system eventually relaxes to… ▽ More We study the effect of spatially correlated classical noise on both Anderson and many-body localization of a disordered fermionic chain. By analyzing the evolution of the particle density imbalance following a quench from an initial charge density wave state, we find prominent signatures of localization also in the presence of the time-dependent noise, even though the system eventually relaxes to the infinite temperature state. In particular, for sufficiently strong static disorder we observe the onset of metastability, which becomes more prominent the stronger the spatial correlations of the noise. In this regime we find that the imbalance decays as a stretched-exponential - a behavior characteristic of glassy systems. We identify a simple scaling behavior of the relevant relaxation times in terms of the static disorder and of the noise correlation length. We discuss how our results could be exploited to extract information about the localization length in experimental setups. △ Less

Submitted 31 October, 2022; v1 submitted 25 May, 2022; originally announced May 2022.

Comments: 6 pages, 3 figures; v2 close to published version

Journal ref: Phys. Rev. B 106, 134211 (2022)

Stochastic strong zero modes and their dynamical manifestations

Authors: Katja Klobas, Paul Fendley, Juan P. Garrahan

Abstract: Strong zero modes (SZMs) are conserved operators localised at the edges of certain quantum spin chains, which give rise to long coherence times of edge spins. Here we define and analyse analogous operators in one-dimensional classical stochastic systems. For concreteness, we focus on chains with single occupancy and nearest-neighbour transitions, in particular particle hopping and pair creation an… ▽ More Strong zero modes (SZMs) are conserved operators localised at the edges of certain quantum spin chains, which give rise to long coherence times of edge spins. Here we define and analyse analogous operators in one-dimensional classical stochastic systems. For concreteness, we focus on chains with single occupancy and nearest-neighbour transitions, in particular particle hopping and pair creation and annihilation. For integrable choices of parameters we find the exact form of the SZM operators. Being in general non-diagonal in the classical basis, the dynamical consequences of stochastic SZMs are very different from those of their quantum counterparts. We show that the presence of a stochastic SZM is manifested through a class of exact relations between time-correlation functions, absent in the same system with periodic boundaries. △ Less

Submitted 3 May, 2023; v1 submitted 18 May, 2022; originally announced May 2022.

Comments: 5+8 pages, 4 figures; v2 published version

Journal ref: Phys. Rev. E 107 (4), L042104 (2023)

Trajectory phase transitions in non-interacting systems: all-to-all dynamics and the random energy model

Authors: Juan P. Garrahan, Chokri Manai, Simone Warzel

Abstract: We study the fluctuations of time-additive random observables in the stochastic dynamics of a system of $N$ non-interacting Ising spins. We mainly consider the case of all-to-all dynamics where transitions are possible between any two spin configurations with uniform rates. We show that the cumulant generating function of the time-integral of a normally distributed quenched random function of conf… ▽ More We study the fluctuations of time-additive random observables in the stochastic dynamics of a system of $N$ non-interacting Ising spins. We mainly consider the case of all-to-all dynamics where transitions are possible between any two spin configurations with uniform rates. We show that the cumulant generating function of the time-integral of a normally distributed quenched random function of configurations, i.e., the energy function of the random energy model (REM), has a phase transition in the large $N$ limit for trajectories of any time extent. We prove this by determining the exact limit of the scaled cumulant generating function. This is accomplished by connecting the dynamical problem to a spectral analysis of the all-to-all quantum REM. We also discuss finite $N$ corrections as observed in numerical simulations. △ Less

Submitted 16 May, 2022; originally announced May 2022.

MSC Class: 82C44; 60F10

Topological phases in the dynamics of the simple exclusion process

Authors: Juan P. Garrahan, Frank Pollmann

Abstract: We study the dynamical large deviations of the classical stochastic symmetric simple exclusion process (SSEP) by means of numerical matrix product states. We show that for half-filling, long-time trajectories with a large enough imbalance between the number hops in even and odd bonds of the lattice belong to distinct symmetry protected topological (SPT) phases. Using tensor network techniques, we… ▽ More We study the dynamical large deviations of the classical stochastic symmetric simple exclusion process (SSEP) by means of numerical matrix product states. We show that for half-filling, long-time trajectories with a large enough imbalance between the number hops in even and odd bonds of the lattice belong to distinct symmetry protected topological (SPT) phases. Using tensor network techniques, we obtain the large deviation (LD) phase diagram in terms of counting fields conjugate to the dynamical activity and the total hop imbalance. We show the existence of high activity trivial and non-trivial SPT phases (classified according to string-order parameters) separated by either a critical phase or a critical point. Using the leading eigenstate of the tilted generator, obtained from infinite-system density matrix renormalisation group (DMRG) simulations, we construct a near-optimal dynamics for sampling the LDs, and show that the SPT phases manifest at the level of rare stochastic trajectories. We also show how to extend these results to other filling fractions, and discuss generalizations to asymmetric SEPs. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Comments: 6 pages, 4 figures

Slow dynamics and large deviations in classical stochastic Fredkin chains

Authors: Luke Causer, Juan P. Garrahan, Austen Lamacraft

Abstract: The Fredkin spin chain serves as an interesting theoretical example of a quantum Hamiltonian whose ground state exhibits a phase transition between three distinct phases, one of which violates the area law. Here we consider a classical stochastic version of the Fredkin model, which can be thought of as a simple exclusion process subject to additional kinetic constraints, and study its classical st… ▽ More The Fredkin spin chain serves as an interesting theoretical example of a quantum Hamiltonian whose ground state exhibits a phase transition between three distinct phases, one of which violates the area law. Here we consider a classical stochastic version of the Fredkin model, which can be thought of as a simple exclusion process subject to additional kinetic constraints, and study its classical stochastic dynamics. The ground state phase transition of the quantum chain implies an equilibrium phase transition in the stochastic problem, whose properties we quantify in terms of numerical matrix product states (MPS). The stochastic model displays slow dynamics, including power law decaying autocorrelation functions and hierarchical relaxation processes due to exponential localization. Like in other kinetically constrained models, the Fredkin chain has a rich structure in its dynamical large deviations - which we compute accurately via numerical MPS - including an active-inactive phase transition, and a hierarchy of trajectory phases connected to particular equilibrium states of the model. We also propose, via its height field representation, a generalization of the Fredkin model to two dimensions in terms of constrained dimer coverings of the honeycomb lattice. △ Less

Submitted 23 April, 2024; v1 submitted 14 February, 2022; originally announced February 2022.

Comments: 14 pages, 8 figures, updated to match journal paper

Exact solution of the Rule 150 reversible cellular automaton

Authors: Joseph W. P. Wilkinson, Tomaž Prosen, Juan P. Garrahan

Abstract: We study the dynamics of the Rule 150 reversible cellular automaton (RCA). This is a one-dimensional lattice system of binary variables with synchronous (Floquet) dynamics, corresponding to a bulk deterministic and reversible discrete version of the kinetically constrained XOR-Fredrickson-Andersen model, whereby the local dynamics is restricted: a site flips if and only if the states of its neighb… ▽ More We study the dynamics of the Rule 150 reversible cellular automaton (RCA). This is a one-dimensional lattice system of binary variables with synchronous (Floquet) dynamics, corresponding to a bulk deterministic and reversible discrete version of the kinetically constrained XOR-Fredrickson-Andersen model, whereby the local dynamics is restricted: a site flips if and only if the states of its neighbouring sites are different from each other. Like other RCA which have been studied recently, such as Rule 54 and Rule 201, Rule 150 is integrable, however, in contrast is noninteracting. In particular, the emergent quasiparticles - the domain walls - behave as free fermions. This then allows us to solve the model by means of matrix product ansätze. We find the exact equilibrium and nonequilibrium stationary states for systems with closed (periodic) and open (stochastic) boundaries, respectively, resolve the full spectrum of the time evolution operator and, therefore, gain access to the relaxation dynamics, and obtain the exact large deviation statistics of dynamical observables in the long time limit. △ Less

Submitted 3 December, 2021; v1 submitted 28 October, 2021; originally announced October 2021.

Comments: 36 pages, 9 figures, 8 appendices

Random matrix theory for quantum and classical metastability in local Liouvillians

Authors: Jimin L. Li, Dominic C. Rose, Juan P. Garrahan, David J. Luitz

Abstract: We consider the effects of strong dissipation in quantum systems with a notion of locality, which induces a hierarchy of many-body relaxation timescales as shown in [Phys. Rev. Lett. 124, 100604 (2020)]. If the strength of the dissipation varies strongly in the system, additional separations of timescales can emerge, inducing a manifold of metastable states, to which observables relax first, befor… ▽ More We consider the effects of strong dissipation in quantum systems with a notion of locality, which induces a hierarchy of many-body relaxation timescales as shown in [Phys. Rev. Lett. 124, 100604 (2020)]. If the strength of the dissipation varies strongly in the system, additional separations of timescales can emerge, inducing a manifold of metastable states, to which observables relax first, before relaxing to the steady state. Our simple model, involving one or two "good" qubits with dissipation reduced by a factor $α<1$ compared to the other "bad" qubits, confirms this picture and admits a perturbative treatment. △ Less

Submitted 25 October, 2021; originally announced October 2021.

Comments: 5 pages, 3 figures plus supplementary material

Finite time large deviations via matrix product states

Authors: Luke Causer, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: Recent work has shown the effectiveness of tensor network methods for computing large deviation functions in constrained stochastic models in the infinite time limit. Here we show that these methods can also be used to study the statistics of dynamical observables at arbitrary finite time. This is a harder problem because, in contrast to the infinite time case where only the extremal eigenstate of… ▽ More Recent work has shown the effectiveness of tensor network methods for computing large deviation functions in constrained stochastic models in the infinite time limit. Here we show that these methods can also be used to study the statistics of dynamical observables at arbitrary finite time. This is a harder problem because, in contrast to the infinite time case where only the extremal eigenstate of a tilted Markov generator is relevant, for finite time the whole spectrum plays a role. We show that finite time dynamical partition sums can be computed efficiently and accurately in one dimension using matrix product states, and describe how to use such results to generate rare event trajectories on demand. We apply our methods to the Fredrickson-Andersen (FA) and East kinetically constrained models, and to the symmetric simple exclusion process (SSEP), unveiling dynamical phase diagrams in terms of counting field and trajectory time. We also discuss extensions of this method to higher dimensions. △ Less

Submitted 7 March, 2022; v1 submitted 25 August, 2021; originally announced August 2021.

Comments: 6+2 pages, 3+2 figures

Journal ref: Phys. Rev. Lett. 128, 090605 (2022)

Topographic control of order in quasi-2D granular phase transitions

Authors: J. G. Downs, N. D. Smith, K. K. Mandadapu, J. P. Garrahan, M. I. Smith

Abstract: We experimentally investigate the nature of 2D phase transitions in a quasi-2D granular fluid. Using a surface decorated with periodically spaced dimples we observe interfacial tension between coexisting liquid and crystal phases. Measurements of the orientational and translational order parameters and associated susceptibilities indicate that the surface topography alters the order of the phase t… ▽ More We experimentally investigate the nature of 2D phase transitions in a quasi-2D granular fluid. Using a surface decorated with periodically spaced dimples we observe interfacial tension between coexisting liquid and crystal phases. Measurements of the orientational and translational order parameters and associated susceptibilities indicate that the surface topography alters the order of the phase transition from a two-step continuous one to a first-order liquid-crystal one. The interplay of boundary inelasticity and geometry, either order-promoting or inhibiting, controls the wetting of the granular crystal / fluid. This order induced wetting has important consequences, determining how coexisting phases separate spatially. △ Less

Submitted 17 August, 2021; originally announced August 2021.

A solvable class of non-Markovian quantum multipartite dynamics

Authors: Adrián A. Budini, Juan P. Garrahan

Abstract: We study a class of multipartite open quantum dynamics for systems of arbitrary number of qubits. The non-Markovian quantum master equation can involve arbitrary single or multipartite and time-dependent dissipative coupling mechanisms, expressed in terms of strings of Pauli operators. We formulate the general constraints that guarantee the complete positivity of this dynamics. We characterize in… ▽ More We study a class of multipartite open quantum dynamics for systems of arbitrary number of qubits. The non-Markovian quantum master equation can involve arbitrary single or multipartite and time-dependent dissipative coupling mechanisms, expressed in terms of strings of Pauli operators. We formulate the general constraints that guarantee the complete positivity of this dynamics. We characterize in detail underlying mechanisms that lead to memory effects, together with properties of the dynamics encoded in the associated system rates. We specifically derive multipartite "eternal" non-Markovian master equations that we term hyperbolic and trigonometric due to the time dependence of their rates. For these models we identify a transition between positive and periodically divergent rates. We also study non-Markovian effects through an operational (measurement-based) memory witness approach. △ Less

Submitted 4 July, 2021; originally announced July 2021.

Comments: 12 pages, 2 figures

Journal ref: Phys. Rev. A 104, 032206 (2021)

Reinforcement learning of rare diffusive dynamics

Authors: Avishek Das, Dominic C. Rose, Juan P. Garrahan, David T. Limmer

Abstract: We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant in the study of reactive events, as well as trajectories exhibiting rare fluctuations of time-integrated quantities in the long time limit, like those relevant… ▽ More We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant in the study of reactive events, as well as trajectories exhibiting rare fluctuations of time-integrated quantities in the long time limit, like those relevant in the calculation of large deviation functions. In both cases, reinforcement learning techniques are used to optimize an added force that minimizes the Kullback-Leibler divergence between the conditioned trajectory ensemble and a driven one. Under the optimized added force, the system evolves the rare fluctuation as a typical one, affording a variational estimate of its likelihood in the original trajectory ensemble. Low variance gradients employing value functions are proposed to increase the convergence of the optimal force. The method we develop employing these gradients leads to efficient and accurate estimates of both the optimal force and the likelihood of the rare event for a variety of model systems. △ Less

Submitted 11 August, 2021; v1 submitted 10 May, 2021; originally announced May 2021.

Comments: 23 pages, 8 figures

Journal ref: J. Chem. Phys. 155, 134105 (2021)

Generalized Continuous Maxwell Demons

Authors: Juan P. Garrahan, Felix Ritort

Abstract: We introduce a family of Generalized Continuous Maxwell Demons (GCMDs) operating on idealized single-bit equilibrium devices that combine the single-measurement Szilard and the repeated measurements of the Continuous Maxwell Demon protocols. We derive the cycle distributions for extracted work, information-content, and time and compute the power and information-to-work efficiency fluctuations for… ▽ More We introduce a family of Generalized Continuous Maxwell Demons (GCMDs) operating on idealized single-bit equilibrium devices that combine the single-measurement Szilard and the repeated measurements of the Continuous Maxwell Demon protocols. We derive the cycle distributions for extracted work, information-content, and time and compute the power and information-to-work efficiency fluctuations for the different models. We show that the efficiency at maximum power is maximal for an opportunistic protocol of continuous type in the dynamical regime dominated by rare events. We also extend the analysis to finite-time work extracting protocols by mapping them to a three-state GCMD. We show that dynamical finite-time correlations in this model increase the information-to-work conversion efficiency, underlining the role of temporal correlations in optimizing information-to-energy conversion. The effect of finite-time work extraction and demon memory resetting is also analyzed. We conclude that GCMD models are thermodynamically more efficient than the single-measurement Szilard and preferred for describing biological processes in an information-redundant world. △ Less

Submitted 2 February, 2023; v1 submitted 26 April, 2021; originally announced April 2021.

Comments: 8 pages, 5 figures

Symmetry-induced fluctuation relations in open quantum systems

Authors: Stefano Marcantoni, Carlos Pérez-Espigares, Juan P. Garrahan

Abstract: We derive a general scheme to obtain quantum fluctuation relations for dynamical observables in open quantum systems. For concreteness we consider Markovian non-unitary dynamics that is unraveled in terms of quantum jump trajectories, and exploit techniques from the theory of large deviations like the tilted ensemble and the Doob transform. Our results here generalise to open quantum systems fluct… ▽ More We derive a general scheme to obtain quantum fluctuation relations for dynamical observables in open quantum systems. For concreteness we consider Markovian non-unitary dynamics that is unraveled in terms of quantum jump trajectories, and exploit techniques from the theory of large deviations like the tilted ensemble and the Doob transform. Our results here generalise to open quantum systems fluctuation relations previously obtained for classical Markovian systems, and add to the vast literature on fluctuation relations in the quantum domain, but without resorting to the standard two-point measurement scheme. We illustrate our findings with three examples in order to highlight and discuss the main features of our general result. △ Less

Submitted 11 March, 2021; originally announced March 2021.

Comments: 10 pages

Journal ref: Phys. Rev. E 104, 014108 (2021)

Optimal sampling of dynamical large deviations via matrix product states

Authors: Luke Causer, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: The large deviation (LD) statistics of dynamical observables is encoded in the spectral properties of deformed Markov generators. Recent works have shown that tensor network methods are well suited to compute the relevant leading eigenvalues and eigenvectors accurately. However, the efficient generation of the corresponding rare trajectories is a harder task. Here we show how to exploit the MPS ap… ▽ More The large deviation (LD) statistics of dynamical observables is encoded in the spectral properties of deformed Markov generators. Recent works have shown that tensor network methods are well suited to compute the relevant leading eigenvalues and eigenvectors accurately. However, the efficient generation of the corresponding rare trajectories is a harder task. Here we show how to exploit the MPS approximation of the dominant eigenvector to implement an efficient sampling scheme which closely resembles the optimal (so-called "Doob") dynamics that realises the rare events. We demonstrate our approach on three well-studied lattice models, the Fredrickson-Andersen and East kinetically constrained models (KCMs), and the symmetric simple exclusion process (SSEP). We discuss how to generalise our approach to higher dimensions. △ Less

Submitted 6 May, 2021; v1 submitted 1 March, 2021; originally announced March 2021.

Comments: 13 pages, 3 figures

Journal ref: Phys. Rev. E 103, 062144 (2021)

Large deviations at level 2.5 for Markovian open quantum systems: quantum jumps and quantum state diffusion

Authors: Federico Carollo, Juan P. Garrahan, Robert L. Jack

Abstract: We consider quantum stochastic processes and discuss a level 2.5 large deviation formalism providing an explicit and complete characterisation of fluctuations of time-averaged quantities, in the large-time limit. We analyse two classes of quantum stochastic dynamics, within this framework. The first class consists of the quantum jump trajectories related to photon detection; the second is quantum… ▽ More We consider quantum stochastic processes and discuss a level 2.5 large deviation formalism providing an explicit and complete characterisation of fluctuations of time-averaged quantities, in the large-time limit. We analyse two classes of quantum stochastic dynamics, within this framework. The first class consists of the quantum jump trajectories related to photon detection; the second is quantum state diffusion related to homodyne detection. For both processes, we present the level 2.5 functional starting from the corresponding quantum stochastic Schrödinger equation and we discuss connections of these functionals to optimal control theory. △ Less

Submitted 7 July, 2021; v1 submitted 11 January, 2021; originally announced January 2021.

Comments: 45 pages, 4 figures

Journal ref: J. Stat. Phys. 184, 13 (2021)

Hierarchical classical metastability in an open quantum East model

Authors: Dominic C. Rose, Katarzyna Macieszczak, Igor Lesanovsky, Juan P. Garrahan

Abstract: We study in detail an open quantum generalisation of a classical kinetically constrained model -- the East model -- known to exhibit slow glassy dynamics stemming from a complex hierarchy of metastable states with distinct lifetimes. Using the recently introduced theory of classical metastability for open quantum systems, we show that the driven open quantum East model features a hierarchy of clas… ▽ More We study in detail an open quantum generalisation of a classical kinetically constrained model -- the East model -- known to exhibit slow glassy dynamics stemming from a complex hierarchy of metastable states with distinct lifetimes. Using the recently introduced theory of classical metastability for open quantum systems, we show that the driven open quantum East model features a hierarchy of classical metastabilities at low temperature and weak driving field. We find that the effective long-time description of its dynamics is not only classical, but shares many properties with the classical East model, such as obeying an effective detailed balance condition, and lacking static interactions between excitations, but with this occurring within a modified set of metastable phases which are coherent, and with an effective temperature that is dependent on the coherent drive. △ Less

Submitted 28 October, 2020; originally announced October 2020.

Comments: 14 pages (30 pages with Appendix), 12 figures

Dynamics and large deviation transitions of the XOR-Fredrickson-Andersen kinetically constrained model

Authors: Luke Causer, Igor Lesanovsky, Mari Carmen Bañuls, Juan P. Garrahan

Abstract: We study a one-dimensional classical stochastic kinetically constrained model (KCM) inspired by Rydberg atoms in their "facilitated" regime, where sites can flip only if a single of their nearest neighbours is excited. We call this model "XOR-FA" to distinguish it from the standard Fredrickson-Andersen (FA) model. We describe the dynamics of the XOR-FA model, including its relation to simple exclu… ▽ More We study a one-dimensional classical stochastic kinetically constrained model (KCM) inspired by Rydberg atoms in their "facilitated" regime, where sites can flip only if a single of their nearest neighbours is excited. We call this model "XOR-FA" to distinguish it from the standard Fredrickson-Andersen (FA) model. We describe the dynamics of the XOR-FA model, including its relation to simple exclusion processes in its domain wall representation. The interesting relaxation dynamics of the XOR-FA is related to the prominence of large dynamical fluctuations that lead to phase transitions between active and inactive dynamical phases as in other KCMs. By means of numerical tensor network methods we study in detail such transitions in the dynamical large deviation regime. △ Less

Submitted 4 November, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: 13+2 pages, 7+1 figures

Exact solution of the Floquet-PXP cellular automaton

Authors: Joseph W. P. Wilkinson, Katja Klobas, Tomaž Prosen, Juan P. Garrahan

Abstract: We study the dynamics of a bulk deterministic Floquet model, the Rule 201 synchronous one-dimensional reversible cellular automaton (RCA201). The system corresponds to a deterministic, reversible, and discrete version of the PXP model, whereby a site flips only if both its nearest neighbours are unexcited. We show that the RCA201/Floquet-PXP model exhibits ballistic propagation of interacting quas… ▽ More We study the dynamics of a bulk deterministic Floquet model, the Rule 201 synchronous one-dimensional reversible cellular automaton (RCA201). The system corresponds to a deterministic, reversible, and discrete version of the PXP model, whereby a site flips only if both its nearest neighbours are unexcited. We show that the RCA201/Floquet-PXP model exhibits ballistic propagation of interacting quasiparticles - or solitons - corresponding to the domain walls between non-trivial three-fold vacuum states. Starting from the quasiparticle picture, we find the exact matrix product state form of the non-equilibrium stationary state for a range of boundary conditions, including both periodic and stochastic. We discuss further implications of the integrability of the model. △ Less

Submitted 11 June, 2020; originally announced June 2020.

Comments: 15 pages, 8 figures

Journal ref: Phys. Rev. E 102, 062107 (2020)

Theory of classical metastability in open quantum systems

Authors: Katarzyna Macieszczak, Dominic C. Rose, Igor Lesanovsky, Juan P. Garrahan

Abstract: We present a general theory of classical metastability in open quantum systems. Metastability is a consequence of a large separation in timescales in the dynamics, leading to the existence of a regime when states of the system appear stationary, before eventual relaxation toward a true stationary state at much larger times. In this work, we focus on the emergence of classical metastability, i.e.,… ▽ More We present a general theory of classical metastability in open quantum systems. Metastability is a consequence of a large separation in timescales in the dynamics, leading to the existence of a regime when states of the system appear stationary, before eventual relaxation toward a true stationary state at much larger times. In this work, we focus on the emergence of classical metastability, i.e., when metastable states of an open quantum system with separation of timescales can be approximated as probabilistic mixtures of a finite number of states. We find that a number of classical features follow from this approximation, for the manifold of metastable states, long-time dynamics between them, and symmetries of the dynamics. Namely, those states are approximately disjoint and thus play the role of metastable phases, the relaxation toward the stationary state is approximated by a classical stochastic dynamics between them, and weak symmetries correspond to their permutations. Importantly, the classical dynamics is observed not only on average, but also at the level of individual quantum trajectories: We show that time coarse-grained continuous measurement records can be viewed as noisy classical trajectories, while their statistics can be approximated by that of the classical dynamics. Among others, this explains how first-order dynamical phase transitions arise from metastability. Finally, to verify the presence of classical metastability in a given open quantum system, we develop an efficient numerical approach that delivers the set of metastable phases together with the effective classical dynamics. Since the proximity to a first-order dissipative phase transition manifests as metastability, the theory and tools introduced in this work can be used to investigate such transitions through the metastable behavior of many-body systems of moderate sizes accessible to numerics. △ Less

Submitted 19 July, 2021; v1 submitted 1 June, 2020; originally announced June 2020.

Comments: 28 pages (89 pages with Supplemental Material), 7 figures

Journal ref: Phys. Rev. Research 3, 033047 (2021)

A reinforcement learning approach to rare trajectory sampling

Authors: Dominic C. Rose, Jamie F. Mair, Juan P. Garrahan

Abstract: Very often when studying non-equilibrium systems one is interested in analysing dynamical behaviour that occurs with very low probability, so called rare events. In practice, since rare events are by definition atypical, they are often difficult to access in a statistically significant way. What are required are strategies to "make rare events typical" so that they can be generated on demand. Here… ▽ More Very often when studying non-equilibrium systems one is interested in analysing dynamical behaviour that occurs with very low probability, so called rare events. In practice, since rare events are by definition atypical, they are often difficult to access in a statistically significant way. What are required are strategies to "make rare events typical" so that they can be generated on demand. Here we present such a general approach to adaptively construct a dynamics that efficiently samples atypical events. We do so by exploiting the methods of reinforcement learning (RL), which refers to the set of machine learning techniques aimed at finding the optimal behaviour to maximise a reward associated with the dynamics. We consider the general perspective of dynamical trajectory ensembles, whereby rare events are described in terms of ensemble reweighting. By minimising the distance between a reweighted ensemble and that of a suitably parametrised controlled dynamics we arrive at a set of methods similar to those of RL to numerically approximate the optimal dynamics that realises the rare behaviour of interest. As simple illustrations we consider in detail the problem of excursions of a random walker, for the case of rare events with a finite time horizon; and the problem of a studying current statistics of a particle hopping in a ring geometry, for the case of an infinite time horizon. We discuss natural extensions of the ideas presented here, including to continuous-time Markov systems, first passage time problems and non-Markovian dynamics. △ Less

Submitted 25 November, 2020; v1 submitted 26 May, 2020; originally announced May 2020.

Comments: 55+6 pages, 7+1 figures

Journal ref: New J. Phys. (2020)

Symmetry-induced fluctuation relations for dynamical observables irrespective of their behaviour under time-reversal

Authors: Stefano Marcantoni, Carlos Pérez-Espigares, Juan P. Garrahan

Abstract: We extend previous work to describe a class of fluctuation relations (FRs) that emerge as a consequence of symmetries at the level of stochastic trajectories in Markov chains. We prove that given such a symmetry, and for a suitable dynamical observable, it is always possible to obtain a FR under a biased dynamics corresponding to the so-called generalized Doob transform. The general transformation… ▽ More We extend previous work to describe a class of fluctuation relations (FRs) that emerge as a consequence of symmetries at the level of stochastic trajectories in Markov chains. We prove that given such a symmetry, and for a suitable dynamical observable, it is always possible to obtain a FR under a biased dynamics corresponding to the so-called generalized Doob transform. The general transformations of the dynamics that we consider go beyond time-reversal or spatial isometries, and an implication is the existence of FRs for observables irrespective of their behaviour under time-reversal, for example for time-symmetric observables rather than currents. We further show how to deduce in the long-time limit these FRs from the symmetry properties of the generator of the dynamics. We illustrate our results with four examples that highlight the novel features of our work. △ Less

Submitted 2 July, 2020; v1 submitted 13 April, 2020; originally announced April 2020.

Comments: 14 pages, 4 figures; v2 close to published version

Journal ref: Phys. Rev. E 101, 062142 (2020)

A Tensor Network Approach to Finite Markov Decision Processes

Authors: Edward Gillman, Dominic C. Rose, Juan P. Garrahan

Abstract: Tensor network (TN) techniques - often used in the context of quantum many-body physics - have shown promise as a tool for tackling machine learning (ML) problems. The application of TNs to ML, however, has mostly focused on supervised and unsupervised learning. Yet, with their direct connection to hidden Markov chains, TNs are also naturally suited to Markov decision processes (MDPs) which provid… ▽ More Tensor network (TN) techniques - often used in the context of quantum many-body physics - have shown promise as a tool for tackling machine learning (ML) problems. The application of TNs to ML, however, has mostly focused on supervised and unsupervised learning. Yet, with their direct connection to hidden Markov chains, TNs are also naturally suited to Markov decision processes (MDPs) which provide the foundation for reinforcement learning (RL). Here we introduce a general TN formulation of finite, episodic and discrete MDPs. We show how this formulation allows us to exploit algorithms developed for TNs for policy optimisation, the key aim of RL. As an application we consider the issue - formulated as an RL problem - of finding a stochastic evolution that satisfies specific dynamical conditions, using the simple example of random walk excursions as an illustration. △ Less

Submitted 12 February, 2020; originally announced February 2020.

Comments: 10 pages, 2 figures

A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations

Authors: Tom H. E. Oakes, Adam Moss, Juan P. Garrahan

Abstract: In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to access these rare events is by means of an auxiliary dynamics obtained from the original one through the so-called ``generalised Doob transformation''. While th… ▽ More In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to access these rare events is by means of an auxiliary dynamics obtained from the original one through the so-called ``generalised Doob transformation''. While this optimal dynamics is guaranteed to exist its use is often impractical, as to define it requires the often impossible task of diagonalising a (tilted) dynamical generator. While approximate schemes have been devised to overcome this issue they are difficult to automate as they tend to require knowledge of the systems under study. Here we address this problem from the perspective of deep learning. We devise an iterative semi-supervised learning scheme which converges to the optimal or Doob dynamics with the clear advantage of requiring no prior knowledge of the system. We test our method in a paradigmatic statistical mechanics model with non-trivial dynamical fluctuations, the fully packed classical dimer model on the square lattice, showing that it compares favourably with more traditional approaches. We discuss broader implications of our results for the study of rare dynamical trajectories. △ Less

Submitted 27 January, 2020; originally announced January 2020.

Comments: 12 pages, 5 figures

Journal ref: Mach. Learn.: Sci. Technol. 1, 035004 (2020)

Matrix product state of multi-time correlations

Authors: Katja Klobas, Matthieu Vanicat, Juan P. Garrahan, Tomaž Prosen

Abstract: For an interacting spatio-temporal lattice system we introduce a formal way of expressing multi-time correlation functions of local observables located at the same spatial point with a time state, i.e. a statistical distribution of configurations observed along a time lattice. Such a time state is defined with respect to a particular equilibrium state that is invariant under space and time transla… ▽ More For an interacting spatio-temporal lattice system we introduce a formal way of expressing multi-time correlation functions of local observables located at the same spatial point with a time state, i.e. a statistical distribution of configurations observed along a time lattice. Such a time state is defined with respect to a particular equilibrium state that is invariant under space and time translations. The concept is developed within the Rule 54 reversible cellular automaton, for which we explicitly construct a matrix product form of the time state, with matrices that act on the 3-dimensional auxiliary space. We use the matrix-product state to express equal-space time-dependent density-density correlation function, which, for special maximum-entropy values of equilibrium parameters, agrees with the previous results. Additionally, we obtain an explicit expression for the probabilities of observing all multi-time configurations, which enables us to study distributions of times between consecutive excitations and prove the absence of decoupling of timescales in the Rule 54 model. △ Less

Submitted 27 May, 2020; v1 submitted 20 December, 2019; originally announced December 2019.

Comments: 17 pages, 3 figures

Journal ref: J. Phys. A: Math. Theor. 53 335001 (2020)

A non-equilibrium quantum many-body Rydberg atom engine

Authors: Federico Carollo, Filippo M. Gambetta, Kay Brandner, Juan P. Garrahan, Igor Lesanovsky

Abstract: The standard approach to quantum engines is based on equilibrium systems and on thermodynamic transformations between Gibbs states. However, non-equilibrium quantum systems offer enhanced experimental flexibility in the control of their parameters and, if used as engines, a more direct interpretation of the type of work they deliver. Here we introduce an out-of-equilibrium quantum engine inspired… ▽ More The standard approach to quantum engines is based on equilibrium systems and on thermodynamic transformations between Gibbs states. However, non-equilibrium quantum systems offer enhanced experimental flexibility in the control of their parameters and, if used as engines, a more direct interpretation of the type of work they deliver. Here we introduce an out-of-equilibrium quantum engine inspired by recent experiments with cold atoms. Our system is connected to a single environment and produces mechanical work from many-body interparticle interactions arising between atoms in highly excited Rydberg states. As such, it is not a heat engine but an isothermal one. We perform many-body simulations to show that this system can produce work. The setup we introduce and investigate represents a promising platform for devising new types of microscopic machines and for exploring quantum effects in thermodynamic processes. △ Less

Submitted 3 December, 2019; originally announced December 2019.

Comments: 10 pages, 5 figures

Journal ref: Phys. Rev. Lett. 124, 170602 (2020)

Trajectory phase transitions in non-interacting spin systems

Authors: Loredana M. Vasiloiu, Tom H. E. Oakes, Federico Carollo, Juan P. Garrahan

Abstract: We show that a collection of independent Ising spins evolving stochastically can display surprisingly large fluctuations towards ordered behaviour, as quantified by certain types of time-integrated plaquette observables, despite the underlying dynamics being non-interacting. In the large deviation (LD) regime of long times and large system size, this can give rise to a phase transition in trajecto… ▽ More We show that a collection of independent Ising spins evolving stochastically can display surprisingly large fluctuations towards ordered behaviour, as quantified by certain types of time-integrated plaquette observables, despite the underlying dynamics being non-interacting. In the large deviation (LD) regime of long times and large system size, this can give rise to a phase transition in trajectory space. As a non-interacting system we consider a collection of spins undergoing single spin-flip dynamics at infinite-temperature. For the dynamical observables we study, the associated tilted generators have an exact and explicit spin-plaquette duality. Such setup suggests the existence of a transition (in the large size limit) at the self-dual point of the tilted generator. The nature of the LD transition depends on the observable. We consider explicitly two situations: (i) for a pairwise bond observable the LD transition is continuous, and equivalent to that of the transverse field Ising model; (ii) for a higher order plaquette observable, in contrast, the LD transition is first order. Case (i) is easy to prove analytically, while we confirm case (ii) numerically via an efficient trajectory sampling scheme that exploits the non-interacting nature of the original dynamics. △ Less

Submitted 26 November, 2019; originally announced November 2019.

Comments: 11 pages, 6 figures

Journal ref: Phys. Rev. E 101, 042115 (2020)

Quantum East model: localization, non-thermal eigenstates and slow dynamics

Authors: Nicola Pancotti, Giacomo Giudice, J. Ignacio Cirac, Juan P. Garrahan, Mari Carmen Bañuls

Abstract: We study in detail the properties of the quantum East model, an interacting quantum spin chain inspired by simple kinetically-constrained models of classical glasses. Through a combination of analytics, exact diagonalization and tensor-network methods we show the existence of a transition, from a fast to a slow thermalization regime, which manifests itself throughout the spectrum. On the slow side… ▽ More We study in detail the properties of the quantum East model, an interacting quantum spin chain inspired by simple kinetically-constrained models of classical glasses. Through a combination of analytics, exact diagonalization and tensor-network methods we show the existence of a transition, from a fast to a slow thermalization regime, which manifests itself throughout the spectrum. On the slow side, by exploiting the localization of the ground state and the form of the Hamiltonian, we explicitly construct a large (exponential in size) number of non-thermal states which become exact finite-energy-density eigenstates in the large-size limit, as expected for a true phase transition. A ``super-spin'' generalization allows us to find a further large class of area-law states proved to display very slow relaxation. These states retain memory of their initial conditions for extremely long times. Our numerical analysis reveals that the localization properties are not limited to the ground state and that} many eigenstates have large overlap with product states and can be approximated well by matrix product states at arbitrary energy densities. The mechanism that induces localization to the ground state, and hence the non-thermal behavior of the system, can be extended to a wide range of models including a number of simple spin chains. We discuss implications of our results for slow thermalization and non-ergodicity more generally in disorder-free systems with constraints and we give numerical evidence that these results may be extended to two dimensional systems. △ Less

Submitted 6 June, 2020; v1 submitted 15 October, 2019; originally announced October 2019.

Comments: 21 pages, 16 figures

Journal ref: Phys. Rev. X 10, 021051 (2020)