-
Chemical transformer compression for accelerating both training and inference of molecular modeling
Authors:
Yi Yu,
Karl Borjesson
Abstract:
Transformer models have been developed in molecular science with excellent performance in applications including quantitative structure-activity relationship (QSAR) and virtual screening (VS). Compared with other types of models, however, they are large, which results in a high hardware requirement to abridge time for both training and inference processes. In this work, cross-layer parameter shari…
▽ More
Transformer models have been developed in molecular science with excellent performance in applications including quantitative structure-activity relationship (QSAR) and virtual screening (VS). Compared with other types of models, however, they are large, which results in a high hardware requirement to abridge time for both training and inference processes. In this work, cross-layer parameter sharing (CLPS), and knowledge distillation (KD) are used to reduce the sizes of transformers in molecular science. Both methods not only have competitive QSAR predictive performance as compared to the original BERT model, but also are more parameter efficient. Furthermore, by integrating CLPS and KD into a two-state chemical network, we introduce a new deep lite chemical transformer model, DeLiCaTe. DeLiCaTe captures general-domains as well as task-specific knowledge, which lead to a 4x faster rate of both training and inference due to a 10- and 3-times reduction of the number of parameters and layers, respectively. Meanwhile, it achieves comparable performance in QSAR and VS modeling. Moreover, we anticipate that the model compression strategy provides a pathway to the creation of effective generative transformer models for organic drug and material design.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
Organic charged polaritons in the ultrastrong coupling regime
Authors:
Mao Wang,
Suman Mallick,
Anton Frisk Kockum,
Karl Börjesson
Abstract:
We embedded an all-hydrocarbon-based carbocation in a metallic microcavity that was tuned to resonance with an electronic transition of the carbocation. The measured Rabi splitting was 41% of the excitation energy, putting the system well into the ultrastrong coupling regime. Importantly, due to the intrinsic charge on the carbocation, the polaritons that form carry a significant charge fraction…
▽ More
We embedded an all-hydrocarbon-based carbocation in a metallic microcavity that was tuned to resonance with an electronic transition of the carbocation. The measured Rabi splitting was 41% of the excitation energy, putting the system well into the ultrastrong coupling regime. Importantly, due to the intrinsic charge on the carbocation, the polaritons that form carry a significant charge fraction $0.55 e_0$ and a large charge-to-mass ratio ($\sim 2400 e_0 / m_0$). Moreover, the ground state of the ultrastrongly coupled system is calculated to carry about one percent of one elementary charge, implying a potentially enhanced charge transport across the molecules. These unique properties of our system, together with its convenient preparation, provide a practical platform to study charged polaritons in the ultrastrong coupling regime.
△ Less
Submitted 31 August, 2021;
originally announced August 2021.
-
Enhancing vibrational light-matter coupling strength beyond the molecular concentration limit using plasmonic arrays
Authors:
Manuel Hertzog,
Battulga Munkhbat,
Denis G. Baranov,
Timur O. Shegai,
Karl Börjesson
Abstract:
Vibrational strong coupling is emerging as a promising tool to modify molecular properties, by making use of hybrid light-matter states known as polaritons. Fabry-Perot cavities filled with organic molecules are typically used, and the molecular concentration limits the maximum reachable coupling strength. Developing methods to increase the coupling strength beyond the molecular concentration limi…
▽ More
Vibrational strong coupling is emerging as a promising tool to modify molecular properties, by making use of hybrid light-matter states known as polaritons. Fabry-Perot cavities filled with organic molecules are typically used, and the molecular concentration limits the maximum reachable coupling strength. Developing methods to increase the coupling strength beyond the molecular concentration limit are highly desirable. In this letter, we investigate the effect of adding a gold nanorod array into a cavity containing pure organic molecules, using FT-IR microscopy and numerical modeling. Incorporation of the plasmonic nanorod array, that acts as artificial molecules, leads to an order of magnitude increase in the total coupling strength for the cavity filled with organic molecules. Additionally, we observe a significant narrowing of the plasmon linewidth inside the cavity. We anticipate that these results will be a step forward in exploring vibropolaritonic chemistry and may be used in plasmon based bio-sensors.
△ Less
Submitted 15 December, 2020; v1 submitted 11 October, 2020;
originally announced October 2020.
