-
Learning how to find targets in the micro-world: The case of intermittent active Brownian particles
Authors:
Michele Caraglio,
Harpreet Kaur,
Lukas J. Fiderer,
Andrea López-Incera,
Hans J. Briegel,
Thomas Franosch,
Gorka Muñoz-Gil
Abstract:
Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and active Brownian motion, here we focus on developing effective target-search behavioral policies for microswimmers navigating a homogeneous environment and sear…
▽ More
Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and active Brownian motion, here we focus on developing effective target-search behavioral policies for microswimmers navigating a homogeneous environment and searching for targets of unknown position. We exploit Projective Simulation, a reinforcement learning algorithm, to acquire an efficient stochastic policy represented by the probability of switching the phase, i.e. the navigation mode, in response to the type and the duration of the current phase. Our findings reveal that the target-search efficiency increases with the particle's self-propulsion during the active phase and that, while the optimal duration of the passive case decreases monotonically with the activity, the optimal duration of the active phase displays a non-monotonic behavior.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Optimal foraging strategies can be learned
Authors:
Gorka Muñoz-Gil,
Andrea López-Incera,
Lukas J. Fiderer,
Hans J. Briegel
Abstract:
The foraging behavior of animals is a paradigm of target search in nature. Understanding which foraging strategies are optimal and how animals learn them are central challenges in modeling animal foraging. While the question of optimality has wide-ranging implications across fields such as economy, physics, and ecology, the question of learnability is a topic of ongoing debate in evolutionary biol…
▽ More
The foraging behavior of animals is a paradigm of target search in nature. Understanding which foraging strategies are optimal and how animals learn them are central challenges in modeling animal foraging. While the question of optimality has wide-ranging implications across fields such as economy, physics, and ecology, the question of learnability is a topic of ongoing debate in evolutionary biology. Recognizing the interconnected nature of these challenges, this work addresses them simultaneously by exploring optimal foraging strategies through a reinforcement learning framework. To this end, we model foragers as learning agents. We first prove theoretically that maximizing rewards in our reinforcement learning model is equivalent to optimizing foraging efficiency. We then show with numerical experiments that, in the paradigmatic model of non-destructive search, our agents learn foraging strategies which outperform the efficiency of some of the best known strategies such as Lévy walks. These findings highlight the potential of reinforcement learning as a versatile framework not only for optimizing search strategies but also to model the learning process, thus shedding light on the role of learning in natural optimization processes.
△ Less
Submitted 3 August, 2023; v1 submitted 10 March, 2023;
originally announced March 2023.
-
Towards interpretable quantum machine learning via single-photon quantum walks
Authors:
Fulvio Flamini,
Marius Krumm,
Lukas J. Fiderer,
Thomas Müller,
Hans J. Briegel
Abstract:
Variational quantum algorithms represent a promising approach to quantum machine learning where classical neural networks are replaced by parametrized quantum circuits. However, both approaches suffer from a clear limitation, that is a lack of interpretability. Here, we present a variational method to quantize projective simulation (PS), a reinforcement learning model aimed at interpretable artifi…
▽ More
Variational quantum algorithms represent a promising approach to quantum machine learning where classical neural networks are replaced by parametrized quantum circuits. However, both approaches suffer from a clear limitation, that is a lack of interpretability. Here, we present a variational method to quantize projective simulation (PS), a reinforcement learning model aimed at interpretable artificial intelligence. Decision making in PS is modeled as a random walk on a graph describing the agent's memory. To implement the quantized model, we consider quantum walks of single photons in a lattice of tunable Mach-Zehnder interferometers trained via variational algorithms. Using an example from transfer learning, we show that the quantized PS model can exploit quantum interference to acquire capabilities beyond those of its classical counterpart. Finally, we discuss the role of quantum interference for training and tracing the decision making process, paving the way for realizations of interpretable quantum learning agents.
△ Less
Submitted 16 October, 2023; v1 submitted 31 January, 2023;
originally announced January 2023.
-
The Min-Entropy of Classical-Quantum Combs for Measurement-Based Applications
Authors:
Isaac D. Smith,
Marius Krumm,
Lukas J. Fiderer,
Hendrik Poulsen Nautrup,
Hans J. Briegel
Abstract:
Learning a hidden property of a quantum system typically requires a series of interactions. In this work, we formalise such multi-round learning processes using a generalisation of classical-quantum states, called classical-quantum combs. Here, "classical" refers to a random variable encoding the hidden property to be learnt, and "quantum" refers to the quantum comb describing the behaviour of the…
▽ More
Learning a hidden property of a quantum system typically requires a series of interactions. In this work, we formalise such multi-round learning processes using a generalisation of classical-quantum states, called classical-quantum combs. Here, "classical" refers to a random variable encoding the hidden property to be learnt, and "quantum" refers to the quantum comb describing the behaviour of the system. The optimal strategy for learning the hidden property can be quantified by applying the comb min-entropy (Chiribella and Ebler, NJP, 2016) to classical-quantum combs. To demonstrate the power of this approach, we focus attention on an array of problems derived from measurement-based quantum computation (MBQC) and related applications. Specifically, we describe a known blind quantum computation (BQC) protocol using the combs formalism and thereby leverage the min-entropy to provide a proof of single-shot security for multiple rounds of the protocol, extending the existing result in the literature. Furthermore, we consider a range of operationally motivated examples related to the verification of a partially unknown MBQC device. These examples involve learning the features of the device necessary for its correct use, including learning its internal reference frame for measurement calibration. We also introduce a novel connection between MBQC and quantum causal models that arises in this context.
△ Less
Submitted 6 December, 2023; v1 submitted 1 December, 2022;
originally announced December 2022.
-
Quantum machine learning beyond kernel methods
Authors:
Sofiene Jerbi,
Lukas J. Fiderer,
Hendrik Poulsen Nautrup,
Jonas M. Kübler,
Hans J. Briegel,
Vedran Dunjko
Abstract:
Machine learning algorithms based on parametrized quantum circuits are prime candidates for near-term applications on noisy quantum computers. In this direction, various types of quantum machine learning models have been introduced and studied extensively. Yet, our understanding of how these models compare, both mutually and to classical models, remains limited. In this work, we identify a constru…
▽ More
Machine learning algorithms based on parametrized quantum circuits are prime candidates for near-term applications on noisy quantum computers. In this direction, various types of quantum machine learning models have been introduced and studied extensively. Yet, our understanding of how these models compare, both mutually and to classical models, remains limited. In this work, we identify a constructive framework that captures all standard models based on parametrized quantum circuits: that of linear quantum models. In particular, we show using tools from quantum information theory how data re-uploading circuits, an apparent outlier of this framework, can be efficiently mapped into the simpler picture of linear models in quantum Hilbert spaces. Furthermore, we analyze the experimentally-relevant resource requirements of these models in terms of qubit number and amount of data needed to learn. Based on recent results from classical machine learning, we prove that linear quantum models must utilize exponentially more qubits than data re-uploading models in order to solve certain learning tasks, while kernel methods additionally require exponentially more data points. Our results provide a more comprehensive view of quantum machine learning models as well as insights on the compatibility of different models with NISQ constraints.
△ Less
Submitted 1 February, 2023; v1 submitted 25 October, 2021;
originally announced October 2021.
-
Witnessing Bell violations through probabilistic negativity
Authors:
Benjamin Morris,
Lukas J. Fiderer,
Ben Lang,
Daniel Goldwater
Abstract:
Bell's theorem shows that no hidden-variable model can explain the measurement statistics of a quantum system shared between two parties, thus ruling out a classical (local) understanding of nature. In this work we demonstrate that by relaxing the positivity restriction in the hidden-variable probability distribution it is possible to derive quasiprobabilistic Bell inequalities whose sharp upper b…
▽ More
Bell's theorem shows that no hidden-variable model can explain the measurement statistics of a quantum system shared between two parties, thus ruling out a classical (local) understanding of nature. In this work we demonstrate that by relaxing the positivity restriction in the hidden-variable probability distribution it is possible to derive quasiprobabilistic Bell inequalities whose sharp upper bound is written in terms of a negativity witness of said distribution. This provides an analytic solution for the amount of negativity necessary to violate the CHSH inequality by an arbitrary amount, therefore revealing the amount of negativity required to emulate the quantum statistics in a Bell test.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
General expressions for the quantum Fisher information matrix with applications to discrete quantum imaging
Authors:
Lukas J. Fiderer,
Tommaso Tufarelli,
Samanta Piano,
Gerardo Adesso
Abstract:
The quantum Fisher information matrix is a central object in multiparameter quantum estimation theory. It is usually challenging to obtain analytical expressions for it because most calculation methods rely on the diagonalization of the density matrix. In this paper, we derive general expressions for the quantum Fisher information matrix which bypass matrix diagonalization and do not require the e…
▽ More
The quantum Fisher information matrix is a central object in multiparameter quantum estimation theory. It is usually challenging to obtain analytical expressions for it because most calculation methods rely on the diagonalization of the density matrix. In this paper, we derive general expressions for the quantum Fisher information matrix which bypass matrix diagonalization and do not require the expansion of operators on an orthonormal set of states. Additionally, we can tackle density matrices of arbitrary rank. The methods presented here simplify analytical calculations considerably when, for example, the density matrix is more naturally expressed in terms of non-orthogonal states, such as coherent states. Our derivation relies on two matrix inverses which, in principle, can be evaluated analytically even when the density matrix is not diagonalizable in closed form. We demonstrate the power of our approach by deriving novel results in the timely field of discrete quantum imaging: the estimation of positions and intensities of incoherent point sources. We find analytical expressions for the full estimation problem of two point sources with different intensities, and for specific examples with three point sources. We expect that our method will become standard in quantum metrology.
△ Less
Submitted 6 May, 2021; v1 submitted 2 December, 2020;
originally announced December 2020.
-
Neural-Network Heuristics for Adaptive Bayesian Quantum Estimation
Authors:
Lukas J. Fiderer,
Jonas Schuff,
Daniel Braun
Abstract:
Quantum metrology promises unprecedented measurement precision but suffers in practice from the limited availability of resources such as the number of probes, their coherence time, or non-classical quantum states. The adaptive Bayesian approach to parameter estimation allows for an efficient use of resources thanks to adaptive experiment design. For its practical success fast numerical solutions…
▽ More
Quantum metrology promises unprecedented measurement precision but suffers in practice from the limited availability of resources such as the number of probes, their coherence time, or non-classical quantum states. The adaptive Bayesian approach to parameter estimation allows for an efficient use of resources thanks to adaptive experiment design. For its practical success fast numerical solutions for the Bayesian update and the adaptive experiment design are crucial. Here we show that neural networks can be trained to become fast and strong experiment-design heuristics using a combination of an evolutionary strategy and reinforcement learning. Neural-network heuristics are shown to outperform established heuristics for the technologically important example of frequency estimation of a qubit that suffers from dephasing. Our method of creating neural-network heuristics is very general and complements the well-studied sequential Monte-Carlo method for Bayesian updates to form a complete framework for adaptive Bayesian quantum estimation.
△ Less
Submitted 7 April, 2021; v1 submitted 4 March, 2020;
originally announced March 2020.
-
Improving the dynamics of quantum sensors with reinforcement learning
Authors:
Jonas Schuff,
Lukas J. Fiderer,
Daniel Braun
Abstract:
Recently proposed quantum-chaotic sensors achieve quantum enhancements in measurement precision by applying nonlinear control pulses to the dynamics of the quantum sensor while using classical initial states that are easy to prepare. Here, we use the cross-entropy method of reinforcement learning to optimize the strength and position of control pulses. Compared to the quantum-chaotic sensors with…
▽ More
Recently proposed quantum-chaotic sensors achieve quantum enhancements in measurement precision by applying nonlinear control pulses to the dynamics of the quantum sensor while using classical initial states that are easy to prepare. Here, we use the cross-entropy method of reinforcement learning to optimize the strength and position of control pulses. Compared to the quantum-chaotic sensors with periodic control pulses in the presence of superradiant damping, we find that decoherence can be fought even better and measurement precision can be enhanced further by optimizing the control. In some examples, we find enhancements in sensitivity by more than an order of magnitude. By visualizing the evolution of the quantum state, the mechanism exploited by the reinforcement learning method is identified as a kind of spin-squeezing strategy that is adapted to the superradiant damping.
△ Less
Submitted 10 March, 2020; v1 submitted 22 August, 2019;
originally announced August 2019.
-
Maximal Quantum Fisher Information for Mixed States
Authors:
Lukas J. Fiderer,
Julien M. E. Fraïsse,
Daniel Braun
Abstract:
We study quantum metrology for unitary dynamics. Analytic solutions are given for both the optimal unitary state preparation starting from an arbitrary mixed state and the corresponding optimal measurement precision. This represents a rigorous generalization of known results for optimal initial states and upper bounds on measurement precision which can only be saturated if pure states are availabl…
▽ More
We study quantum metrology for unitary dynamics. Analytic solutions are given for both the optimal unitary state preparation starting from an arbitrary mixed state and the corresponding optimal measurement precision. This represents a rigorous generalization of known results for optimal initial states and upper bounds on measurement precision which can only be saturated if pure states are available. In particular, we provide a generalization to mixed states of an upper bound on measurement precision for time-dependent Hamiltonians that can be saturated with optimal Hamiltonian control. These results make precise and reveal the full potential of mixed states for quantum metrology.
△ Less
Submitted 27 December, 2019; v1 submitted 15 May, 2019;
originally announced May 2019.
-
A quantum-chaotic cesium-vapor magnetometer
Authors:
Lukas J. Fiderer,
Daniel Braun
Abstract:
Quantum-enhanced measurements represent the path towards the best measurement precision allowed by the laws of quantum mechanics. Known protocols usually rely on the preparation of entangled states and promise high or even optimal precision, but fall short in real-word applications because of the difficulty to generate entangled states and to protect them against decoherence. Here, we refrain from…
▽ More
Quantum-enhanced measurements represent the path towards the best measurement precision allowed by the laws of quantum mechanics. Known protocols usually rely on the preparation of entangled states and promise high or even optimal precision, but fall short in real-word applications because of the difficulty to generate entangled states and to protect them against decoherence. Here, we refrain from the preparation of entangled states but supplement the integrable parameter-encoding dynamics by non-linear kicks driving the system in the dynamical regime of quantum chaos. We show that large improvements in measurement precision are possible by modeling a spin-exchange relaxation-free alkali-vapor magnetometer where the non-linear kicks are realized by exploiting the ac Stark effect.
△ Less
Submitted 6 March, 2019;
originally announced March 2019.
-
Quantum metrology with a quantum-chaotic sensor
Authors:
Lukas J. Fiderer,
Daniel Braun
Abstract:
Quantum metrology promises high-precision measurements of classical parameters with far reaching implications for science and technology. So far, research has concentrated almost exclusively on quantum-enhancements in integrable systems, such as precessing spins or harmonic oscillators prepared in non-classical states. Here we show that large benefits can be drawn from rendering integrable quantum…
▽ More
Quantum metrology promises high-precision measurements of classical parameters with far reaching implications for science and technology. So far, research has concentrated almost exclusively on quantum-enhancements in integrable systems, such as precessing spins or harmonic oscillators prepared in non-classical states. Here we show that large benefits can be drawn from rendering integrable quantum sensors chaotic, both in terms of achievable sensitivity as well as robustness to noise, while avoiding the challenge of preparing and protecting large-scale entanglement. We apply the method to spin-precession magnetometry and show in particular that the sensitivity of state-of-the-art magnetometers can be further enhanced by subjecting the spin-precession to non-linear kicks that renders the dynamics chaotic.
△ Less
Submitted 1 March, 2018;
originally announced March 2018.
-
Quantum-phase synchronization
Authors:
Lukas J. Fiderer,
Marek Kuś,
Daniel Braun
Abstract:
We study mechanisms that allow one to synchronize the quantum phase of two qubits relative to a fixed basis. Starting from one qubit in a fixed reference state and the other in an unknown state, we find that contrary to the impossibility of perfect quantum cloning, the quantum-phase can be synchronized perfectly through a joined unitary operation. When both qubits are initially in a pure unknown s…
▽ More
We study mechanisms that allow one to synchronize the quantum phase of two qubits relative to a fixed basis. Starting from one qubit in a fixed reference state and the other in an unknown state, we find that contrary to the impossibility of perfect quantum cloning, the quantum-phase can be synchronized perfectly through a joined unitary operation. When both qubits are initially in a pure unknown state, perfect quantum-phase synchronization through unitary operations becomes impossible. In this situation we determine the maximum average quantum-phase synchronization fidelity, the distribution of relative phases and fidelities, and identify optimal quantum circuits that achieve this maximum fidelity. A subset of these optimal quantum circuits enable perfect quantum-phase synchronization for a class of unknown initial states restricted to the equatorial plane of the Bloch sphere.
△ Less
Submitted 3 November, 2016; v1 submitted 13 November, 2015;
originally announced November 2015.