Skip to main content

Showing 1–18 of 18 results for author: Scherlis, A

  1. arXiv:2210.01892  [pdf, other

    cs.NE cs.AI cs.LG

    Polysemanticity and Capacity in Neural Networks

    Authors: Adam Scherlis, Kshitij Sachan, Adam S. Jermyn, Joe Benton, Buck Shlegeris

    Abstract: Individual neurons in neural networks often represent a mixture of unrelated features. This phenomenon, called polysemanticity, can make interpreting neural networks more difficult and so we aim to understand its causes. We propose doing so through the lens of feature \emph{capacity}, which is the fractional dimension each feature consumes in the embedding space. We show that in a toy model the op… ▽ More

    Submitted 11 July, 2023; v1 submitted 4 October, 2022; originally announced October 2022.

    Comments: 22 pages, 7 figures. Corrected typos in Figure 7, improved notation to distinguish column and row vectors, corrected proof in Appendix A, and other misc changes

  2. arXiv:2205.01663  [pdf, other

    cs.LG cs.AI cs.CL

    Adversarial Training for High-Stakes Reliability

    Authors: Daniel M. Ziegler, Seraphina Nix, Lawrence Chan, Tim Bauman, Peter Schmidt-Nielsen, Tao Lin, Adam Scherlis, Noa Nabeshima, Ben Weinstein-Raun, Daniel de Haas, Buck Shlegeris, Nate Thomas

    Abstract: In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to generate examples to train on in order to achieve better worst-case performance. In this work, we used a safe language generation task (``avoid injuries'') as a t… ▽ More

    Submitted 9 November, 2022; v1 submitted 3 May, 2022; originally announced May 2022.

    Comments: 30 pages, 7 figures, NeurIPS camera-ready

  3. arXiv:2104.12513  [pdf, other

    cond-mat.soft

    Water Self-Dissociation is Insensitive to Nanoscale Environments

    Authors: Solana Di Pino, Yamila A. Perez Sirkin, Uriel N. Morzan, Verónica M. Sánchez, Ali Hassanali, Damian A. Scherlis

    Abstract: Nanoconfinement effects on water dissociation and reactivity remain controversial, despite their importance to understand the aqueous chemistry at interfaces, pores, or aerosols. The pKw in confined environments has been assessed from experiments and simulations in a few specific cases, leading to dissimilar conclusions. Here, with the use of carefully designed \textit{ab-initio} simulations, we d… ▽ More

    Submitted 6 July, 2023; v1 submitted 26 April, 2021; originally announced April 2021.

  4. On Preheating in Higgs Inflation

    Authors: Yuta Hamada, Kiyoharu Kawana, Adam Scherlis

    Abstract: Recently, the problem of unitarity violation during the preheating stage of Higgs inflation with a large non-minimal coupling has been much discussed in the literature. We point out that this problem can be translated into a strong coupling problem for the dimensionless effective coupling, and that the existence of these problems is highly dependent on the choice of higher-dimensional operators be… ▽ More

    Submitted 8 February, 2021; v1 submitted 9 July, 2020; originally announced July 2020.

    Comments: 28 pages, 9 figures; version to appear in JCAP (v2)

    Report number: KEK-TH-2233

  5. arXiv:1905.04393  [pdf, other

    cond-mat.mes-hall

    Driven Liouville-von Neumann Equation for Quantum Transport and Multiple-Probe Green's Functions

    Authors: Francisco Ramírez, Daniel Dundas, Cristián G. Sánchez, Damian A. Scherlis, Tchavdar N. Todorov

    Abstract: The so called Driven Liouville-von Neumann equation is a dynamical formulation to simulate a voltage bias across a molecular system and to model a time-dependent current in a grand-canonical framework. This approach introduces a damping term in the equation of motion that drives the charge to a reference, out of equilibrium density. Originally proposed by Horsfield and co-workers, further work on… ▽ More

    Submitted 10 May, 2019; originally announced May 2019.

    Comments: 40 pages, 15 figures

    Journal ref: The Journal of Physical Chemistry C 2019

  6. arXiv:1807.02581  [pdf, other

    cs.LG cs.NE stat.ML

    The Goldilocks zone: Towards better understanding of neural network loss landscapes

    Authors: Stanislav Fort, Adam Scherlis

    Abstract: We explore the loss landscape of fully-connected and convolutional neural networks using random, low-dimensional hyperplanes and hyperspheres. Evaluating the Hessian, $H$, of the loss function on these hypersurfaces, we observe 1) an unusual excess of the number of positive eigenvalues of $H$, and 2) a large value of $\mathrm{Tr}(H) / ||H||$ at a well defined range of configuration space radii, co… ▽ More

    Submitted 12 November, 2018; v1 submitted 6 July, 2018; originally announced July 2018.

    Comments: 8 pages, 15 figures. Accepted for publication at the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19). A subset of the paper accepted at Modern Trends in Nonconvex Optimization for Machine Learning workshop at the 35th International Conference on Machine Learning (ICML 2018), and BayLearn 2018

  7. The Stochastic Axion Scenario

    Authors: Peter W. Graham, Adam Scherlis

    Abstract: For the minimal QCD axion model it is generally believed that overproduction of dark matter constrains the axion mass to be above a certain threshold, or at least that the initial misalignment angle must be tuned if the mass is below that threshold. We demonstrate that this is incorrect. During inflation, if the Hubble scale is low, the axion tends toward an equilibrium. This means the minimal QCD… ▽ More

    Submitted 15 August, 2018; v1 submitted 18 May, 2018; originally announced May 2018.

    Comments: 19 pages, 3 figures. v2: minor changes made to agree with published version

    Journal ref: Phys. Rev. D 98, 035017 (2018)

  8. arXiv:1604.08894  [pdf, other

    cond-mat.mtrl-sci physics.chem-ph

    A Quantum-Mechanics Molecular-Mechanics scheme for extended systems

    Authors: Diego Hunt, Veronica M. Sanchez, Damian A. Scherlis

    Abstract: We introduce and discuss a hybrid quantum-mechanics molecular-mechanics (QM-MM) approach for Car-Parrinello DFT simulations with pseudopotentials and planewaves basis, designed for the treatment of periodic systems. In this implementation the MM atoms are considered as additional QM ions having fractional charges of either sign, which provides conceptual and computational simplicity by exploiting… ▽ More

    Submitted 29 April, 2016; originally announced April 2016.

  9. arXiv:1604.06863  [pdf, other

    cond-mat.mtrl-sci

    Electron transport in real time from first-principles

    Authors: Uriel N. Morzan, Francisco F. Ramirez, Mariano C. Gonzalez Lebrero, Damian A. Scherlis

    Abstract: While the vast majority of calculations reported on molecular conductance have been based on the static non-equilibrium Green's function formalism combined with density functional theory, in recent years a few time-depedent approaches to transport have started to emerge. Among these, the driven Liouville-von Neumann equation (J. Chem. Phys. 124, 214708 (2006)) is a simple and appealing route relyi… ▽ More

    Submitted 23 April, 2016; originally announced April 2016.

  10. arXiv:1510.07777  [pdf, other

    math.CO

    Cluster Algebras and Symmetries of Regular Tilings

    Authors: Adam Scherlis

    Abstract: The classification of Grassmannian cluster algebras resembles that of regular polygonal tilings. We conjecture that this resemblance may indicate a deeper connection between these seemingly unrelated structures.

    Submitted 27 October, 2015; originally announced October 2015.

    Comments: 3 pages, 2 tables, 2 figures

  11. arXiv:1507.01950  [pdf, other

    hep-th math.AG math.CO

    Hedgehog Bases for A_n Cluster Polylogarithms and An Application to Six-Point Amplitudes

    Authors: Daniel E. Parker, Adam Scherlis, Marcus Spradlin, Anastasia Volovich

    Abstract: Multi-loop scattering amplitudes in N=4 Yang-Mills theory possess cluster algebra structure. In order to develop a computational framework which exploits this connection, we show how to construct bases of Goncharov polylogarithm functions, at any weight, whose symbol alphabet consists of cluster coordinates on the $A_n$ cluster algebra. Using such a basis we present a new expression for the 2-loop… ▽ More

    Submitted 27 October, 2015; v1 submitted 7 July, 2015; originally announced July 2015.

    Comments: 32 pages; v2: minor corrections and clarifications

  12. arXiv:0904.4887  [pdf, ps, other

    physics.chem-ph physics.comp-ph

    First-principles molecular dynamics simulations at solid-liquid interfaces with a continuum solvent

    Authors: Veronica M. Sanchez, Mariela Sued, Damian A. Scherlis

    Abstract: Continuum solvent models have become a standard technique in the context of electronic structure calculations, yet, no implementations have been reported capable to perform molecular dynamics at solid-liquid interfaces. We propose here such a continuum approach in a DFT framework, using plane-waves basis sets and periodic boundary conditions. Our work stems from a recent model designed for Car-P… ▽ More

    Submitted 30 April, 2009; originally announced April 2009.

    Comments: 36 pages, 7 figures

  13. arXiv:0705.2743  [pdf, ps, other

    cond-mat.soft

    Simulation of Heme using DFT+U: a step toward accurate spin-state energetics

    Authors: Damian A. Scherlis, Matteo Cococcioni, Patrick Sit, Nicola Marzari

    Abstract: We investigate the DFT+U approach as a viable solution to describe the low-lying states of ligated and unligated iron heme complexes. Besides their central role in organometallic chemistry, these compounds represent a paradigmatic case where LDA, GGA, and common hybrid functionals fail to reproduce the experimental magnetic splittings. In particular, the imidazole pentacoordinated heme is incorr… ▽ More

    Submitted 18 May, 2007; originally announced May 2007.

    Comments: To be published in The Journal of Physical Chemistry B 30 pages, 15 figures

  14. arXiv:cond-mat/0609722  [pdf

    cond-mat.mtrl-sci

    The Effect of Counterions on the Interactions of Charged Oligothiophenes

    Authors: Nicholas E. Singh-Miller, Damian A. Scherlis, Nicola Marzari

    Abstract: The functionality of conjugated polymer systems often relies on oxidations or reductions, in most cases mediated by the presence of counterions. The effect that the common counterion hexafluorophosphate (PF6-) has on the intermolecular interactions between charged oligothiophenes is investigated here using ab initio quantum chemistry methods. Counterions are explicitly included in the simulation… ▽ More

    Submitted 28 September, 2006; originally announced September 2006.

    Comments: 16 pages, 5 figures to be published in Journal of Physical Chemistry B (accepted)

  15. arXiv:cond-mat/0608285  [pdf, ps, other

    cond-mat.soft cond-mat.mtrl-sci

    Density functional theory in transition-metal chemistry: a self-consistent Hubbard U approach

    Authors: Heather J. Kulik, Matteo Cococcioni, Damian A. Scherlis, Nicola Marzari

    Abstract: Transition-metal centers are the active sites for many biological and inorganic chemical reactions. Notwithstanding this central importance, density-functional theory calculations based on generalized-gradient approximations often fail to describe energetics, multiplet structures, reaction barriers, and geometries around the active sites. We suggest here an alternative approach, derived from the… ▽ More

    Submitted 12 August, 2006; originally announced August 2006.

    Comments: 5 pages, 3 figures, Phys. Rev. Lett., in press

  16. arXiv:cond-mat/0512203  [pdf, ps, other

    cond-mat.mtrl-sci

    Stacking of oligo and polythiophenes cations in solution: surface tension and dielectric saturation

    Authors: Damian A. Scherlis, Jean-Luc Fattebert, Nicola Marzari

    Abstract: The stacking of positively charged (or doped) terthiophene oligomers and quaterthiophene polymers in solution is investigated applying a recently developed unified electrostatic and cavitation model for first-principles calculations in a continuum solvent. The thermodynamic and structural patterns of the dimerization are explored in different solvents, and the distinctive roles of polarity and s… ▽ More

    Submitted 9 December, 2005; originally announced December 2005.

  17. arXiv:cond-mat/0510157  [pdf, ps, other

    cond-mat.mtrl-sci cond-mat.soft

    A unified electrostatic and cavitation model for first-principles molecular dynamics in solution

    Authors: Damian A. Scherlis, Jean-Luc Fattebert, Francois Gygi, Matteo Cococcioni, Nicola Marzari

    Abstract: The electrostatic continuum solvent model developed by Fattebert and Gygi is combined with a first-principles formulation of the cavitation energy based on a natural quantum-mechanical definition for the surface of a solute. Despite its simplicity, the cavitation contribution calculated by this approach is found to be in remarkable agreement with that obtained by more complex algorithms relying… ▽ More

    Submitted 6 October, 2005; originally announced October 2005.

  18. arXiv:cond-mat/0409328  [pdf

    cond-mat.mtrl-sci cond-mat.soft

    Pi-stacking in charged thiophene oligomers

    Authors: Damian A. Scherlis, Nicola Marzari

    Abstract: The pi-stacking of oxidized thiophene oligomers is investigated using ab-initio quantum chemistry methods. Dimers of singly-charged oligothiophenes are found to be unstable in the gas phase, but can be stabilized as bound dications in the singlet state by a polarizable solvent such as acetonitrile. Our calculations provide a detailed description of the mechanisms and the energetics involved in t… ▽ More

    Submitted 13 September, 2004; originally announced September 2004.

    Comments: 17 pages, 6 figures. Accepted for publication in the Journal of Physical Chemistry B