Skip to main content

Showing 1–18 of 18 results for author: Morel, R

  1. arXiv:2406.02585  [pdf, other

    cs.LG cs.AI stat.ML

    Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task

    Authors: Siavash Golkar, Alberto Bietti, Mariel Pettee, Michael Eickenberg, Miles Cranmer, Keiya Hirashima, Geraud Krawezik, Nicholas Lourie, Michael McCabe, Rudy Morel, Ruben Ohana, Liam Holden Parker, Bruno Régaldo-Saint Blancard, Kyunghyun Cho, Shirley Ho

    Abstract: Transformers have revolutionized machine learning across diverse domains, yet understanding their behavior remains crucial, particularly in high-stakes applications. This paper introduces the contextual counting task, a novel toy problem aimed at enhancing our understanding of Transformers in quantitative and scientific contexts. This task requires precise localization and computation within datas… ▽ More

    Submitted 30 May, 2024; originally announced June 2024.

  2. arXiv:2404.16467  [pdf, other

    q-fin.GN q-fin.TR

    Riding Wavelets: A Method to Discover New Classes of Price Jumps

    Authors: Cecilia Aubrun, Rudy Morel, Michael Benzaquen, Jean-Philippe Bouchaud

    Abstract: Cascades of events and extreme occurrences have garnered significant attention across diverse domains such as financial markets, seismology, and social physics. Such events can stem either from the internal dynamics inherent to the system (endogenous), or from external shocks (exogenous). The possibility of separating these two classes of events has critical implications for professionals in those… ▽ More

    Submitted 25 April, 2024; originally announced April 2024.

    Comments: 12 pages and 11 pages of appendices, 26 figures

  3. arXiv:2401.16215  [pdf, other

    cs.LG cs.AI cs.LO

    Learning big logical rules by joining small rules

    Authors: Céline Hocquette, Andreas Niskanen, Rolf Morel, Matti Järvisalo, Andrew Cropper

    Abstract: A major challenge in inductive logic programming is learning big rules. To address this challenge, we introduce an approach where we join small rules to learn big rules. We implement our approach in a constraint-driven system and use constraint solvers to efficiently join rules. Our experiments on many domains, including game playing and drug design, show that our approach can (i) learn rules with… ▽ More

    Submitted 29 January, 2024; originally announced January 2024.

  4. arXiv:2308.01486  [pdf, other

    q-fin.MF q-fin.CP q-fin.PR q-fin.ST

    Path Shadowing Monte-Carlo

    Authors: Rudy Morel, Stéphane Mallat, Jean-Philippe Bouchaud

    Abstract: We introduce a Path Shadowing Monte-Carlo method, which provides prediction of future paths, given any generative model. At any given date, it averages future quantities over generated price paths whose past history matches, or `shadows', the actual (observed) history. We test our approach using paths generated from a maximum entropy model of financial prices, based on a recently proposed multi-sc… ▽ More

    Submitted 2 August, 2023; originally announced August 2023.

  5. arXiv:2306.17210  [pdf, other

    physics.data-an astro-ph.IM cs.CV cs.LG

    Scattering Spectra Models for Physics

    Authors: Sihao Cheng, Rudy Morel, Erwan Allys, Brice Ménard, Stéphane Mallat

    Abstract: Physicists routinely need probabilistic models for a number of tasks such as parameter inference or the generation of new realizations of a field. Establishing such models for highly non-Gaussian fields is a challenge, especially when the number of samples is limited. In this paper, we introduce scattering spectra models for stationary fields and we show that they provide accurate and robust stati… ▽ More

    Submitted 4 October, 2024; v1 submitted 29 June, 2023; originally announced June 2023.

    Comments: 11 pages, 6 figures, plus appendices, updated to published version

    Journal ref: PNAS Nexus, Volume 3, Issue 4, April 2024, pgae103

  6. arXiv:2305.16189  [pdf, other

    cs.LG astro-ph.EP stat.ML

    Martian time-series unraveled: A multi-scale nested approach with factorial variational autoencoders

    Authors: Ali Siahkoohi, Rudy Morel, Randall Balestriero, Erwan Allys, Grégory Sainton, Taichi Kawamura, Maarten V. de Hoop

    Abstract: Unsupervised source separation involves unraveling an unknown set of source signals recorded through a mixing operator, with limited prior knowledge about the sources, and only access to a dataset of signal mixtures. This problem is inherently ill-posed and is further challenged by the variety of timescales exhibited by sources in time series data from planetary space missions. As such, a systemat… ▽ More

    Submitted 30 July, 2024; v1 submitted 25 May, 2023; originally announced May 2023.

  7. arXiv:2301.11981  [pdf, other

    cs.LG astro-ph.EP eess.SP

    Unearthing InSights into Mars: Unsupervised Source Separation with Limited Data

    Authors: Ali Siahkoohi, Rudy Morel, Maarten V. de Hoop, Erwan Allys, Grégory Sainton, Taichi Kawamura

    Abstract: Source separation involves the ill-posed problem of retrieving a set of source signals that have been observed through a mixing operator. Solving this problem requires prior knowledge, which is commonly incorporated by imposing regularity conditions on the source signals, or implicitly learned through supervised or unsupervised methods from existing data. While data-driven methods have shown great… ▽ More

    Submitted 31 May, 2023; v1 submitted 27 January, 2023; originally announced January 2023.

    Comments: ICML 2023

  8. arXiv:2204.10177  [pdf, other

    physics.data-an cond-mat.dis-nn cs.LG eess.SP q-fin.MF stat.ML

    Scale Dependencies and Self-Similar Models with Wavelet Scattering Spectra

    Authors: Rudy Morel, Gaspar Rochette, Roberto Leonarduzzi, Jean-Philippe Bouchaud, Stéphane Mallat

    Abstract: We introduce the wavelet scattering spectra which provide non-Gaussian models of time-series having stationary increments. A complex wavelet transform computes signal variations at each scale. Dependencies across scales are captured by the joint correlation across time and scales of wavelet coefficients and their modulus. This correlation matrix is nearly diagonalized by a second wavelet transform… ▽ More

    Submitted 19 June, 2023; v1 submitted 19 April, 2022; originally announced April 2022.

  9. arXiv:2109.07132  [pdf, ps, other

    cs.AI cs.LG

    Parallel Constraint-Driven Inductive Logic Programming

    Authors: Andrew Cropper, Oghenejokpeme Orhobor, Cristian Dinu, Rolf Morel

    Abstract: Multi-core machines are ubiquitous. However, most inductive logic programming (ILP) approaches use only a single core, which severely limits their scalability. To address this limitation, we introduce parallel techniques based on constraint-driven ILP where the goal is to accumulate constraints to restrict the hypothesis space. Our experiments on two domains (program synthesis and inductive genera… ▽ More

    Submitted 15 September, 2021; originally announced September 2021.

    Comments: Paper under review

  10. arXiv:2104.14426  [pdf, ps, other

    cs.AI

    Predicate Invention by Learning From Failures

    Authors: Andrew Cropper, Rolf Morel

    Abstract: Discovering novel high-level concepts is one of the most important steps needed for human-level AI. In inductive logic programming (ILP), discovering novel high-level concepts is known as predicate invention (PI). Although seen as crucial since the founding of ILP, PI is notoriously difficult and most ILP systems do not support it. In this paper, we introduce POPPI, an ILP system that formulates t… ▽ More

    Submitted 29 April, 2021; originally announced April 2021.

    Comments: Rejected manuscript for IJCAI21

  11. arXiv:2104.07946  [pdf

    cond-mat.mtrl-sci

    Target domains in nanometric Permalloy disks with columnar structure

    Authors: Svetlana Ponomareva, Robert Morel, Hélène Joisten, Philippe Sabon, Bernard Dieny

    Abstract: We conducted a thorough experimental and numerical study of the micromagnetic properties of Permalloy (Ni$_{80}$Fe$_{20}$) microdisks exhibiting target domain structures at remanence. Vortex configurations are quite common in such microdisks and correspond to an in-plane flux closure configuration of cylindrical symmetry with an out-of-plane magnetized core. In contrast, target domain configuratio… ▽ More

    Submitted 16 April, 2021; originally announced April 2021.

    Comments: 17 pages, 11 figures

  12. arXiv:2102.12553  [pdf, ps, other

    cs.AI cs.LO

    Refinement Type Directed Search for Meta-Interpretive-Learning of Higher-Order Logic Programs

    Authors: Rolf Morel

    Abstract: The program synthesis problem within the Inductive Logic Programming (ILP) community has typically been seen as untyped. We consider the benefits of user provided types on background knowledge. Building on the Meta-Interpretive Learning (MIL) framework, we show that type checking is able to prune large parts of the hypothesis space of programs. The introduction of polymorphic type checking to the… ▽ More

    Submitted 18 February, 2021; originally announced February 2021.

    Comments: Oxford 2018 MSc thesis; 82 pages

  13. arXiv:2102.12551  [pdf, other

    cs.AI cs.LO

    Learning logic programs by explaining their failures

    Authors: Rolf Morel, Andrew Cropper

    Abstract: Scientists form hypotheses and experimentally test them. If a hypothesis fails (is refuted), scientists try to explain the failure to eliminate other hypotheses. The more precise the failure analysis the more hypotheses can be eliminated. Thus inspired, we introduce failure explanation techniques for inductive logic programming. Given a hypothesis represented as a logic program, we test it on exam… ▽ More

    Submitted 24 May, 2023; v1 submitted 18 February, 2021; originally announced February 2021.

    Comments: 26 pages; under review at the Machine Learning journal since February 2022

  14. arXiv:2005.02259  [pdf, ps, other

    cs.AI cs.LG

    Learning programs by learning from failures

    Authors: Andrew Cropper, Rolf Morel

    Abstract: We describe an inductive logic programming (ILP) approach called learning from failures. In this approach, an ILP system (the learner) decomposes the learning problem into three separate stages: generate, test, and constrain. In the generate stage, the learner generates a hypothesis (a logic program) that satisfies a set of hypothesis constraints (constraints on the syntactic form of hypotheses).… ▽ More

    Submitted 25 November, 2020; v1 submitted 5 May, 2020; originally announced May 2020.

    Comments: Accepted for the machine learning journal

  15. arXiv:1907.10953  [pdf, other

    cs.LG cs.AI stat.ML

    Learning higher-order logic programs

    Authors: Andrew Cropper, Rolf Morel, Stephen H. Muggleton

    Abstract: A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher-order programs by allowing for \emph{higher-order definitions} to be used as ba… ▽ More

    Submitted 25 July, 2019; originally announced July 2019.

    Comments: Submitted to the MLJ

  16. arXiv:1806.10513  [pdf, other

    cs.CC cs.DS

    Lower Bounds for Dynamic Programming on Planar Graphs of Bounded Cutwidth

    Authors: Bas A. M. van Geffen, Bart M. P. Jansen, Arnoud A. W. M. de Kroon, Rolf Morel

    Abstract: Many combinatorial problems can be solved in time $O^*(c^{tw})$ on graphs of treewidth $tw$, for a problem-specific constant $c$. In several cases, matching upper and lower bounds on $c$ are known based on the Strong Exponential Time Hypothesis (SETH). In this paper we investigate the complexity of solving problems on graphs of bounded cutwidth, a graph parameter that takes larger values than tree… ▽ More

    Submitted 27 June, 2018; originally announced June 2018.

    MSC Class: 68R10; 05C10; 05C69; 05C85 ACM Class: F.2.2; G.2.2

  17. Single-particle Mass Spectrometry with arrays of frequency-addressed nanomechanical resonators

    Authors: Eric Sage, Marc Sansa, Shawn Fostner, Martial Defoort, Marc Gély, Akshay K. Naik, Robert Morel, Laurent Duraffourg, Michael L. Roukes, Thomas Alava, Guillaume Jourdan, Eric Colinet, Christophe Masselon, Ariel Brenac, Sébastien Hentz

    Abstract: One of the main challenges to overcome to perform nanomechanical Mass Spectrometry (NEMS-MS) analysis in a practical time frame stems from the size mismatch between the analyte beam and the extremely small nanomechanical detector area. We report here the demonstration of NEMS-MS with arrays of 20 individually addressed nanomechanical resonators where the number of inputs-outputs for the whole arra… ▽ More

    Submitted 12 December, 2017; originally announced December 2017.

  18. arXiv:1405.7281  [pdf

    physics.ins-det

    Neutral particle Mass Spectrometry with Nanomechanical Systems

    Authors: Eric Sage, Ariel Brenac, Thomas Alava, Robert Morel, Cécilia Dupré, Mehmet Selim Hanay, Michael L. Roukes, Laurent Duraffourg, Christophe Masselon, Sébastien Hentz

    Abstract: Current approaches to Mass Spectrometry (MS) require ionization of the analytes of interest. For high-mass species, the resulting charge state distribution can be complex and difficult to interpret correctly. In this article, using a setup comprising both conventional time-of-flight MS (TOF-MS) and Nano-Electro-Mechanical-Systems-based MS (NEMS-MS) in situ, we show directly that NEMS-MS analysis i… ▽ More

    Submitted 2 February, 2015; v1 submitted 28 May, 2014; originally announced May 2014.