-
Potential Distribution Theory of Alchemical Transfer
Authors:
Solmaz Azimi,
Emilio Gallicchio
Abstract:
We present an analytical description of the Alchemical Transfer Method (ATM) for molecular binding using the Potential Distribution Theory (PDT) formalism. ATM models the binding free energy by mapping the bound and unbound states of the complex by translating the ligand coordinates. PDT relates the free energy and the probability densities of the perturbation energy along the alchemical path to t…
▽ More
We present an analytical description of the Alchemical Transfer Method (ATM) for molecular binding using the Potential Distribution Theory (PDT) formalism. ATM models the binding free energy by mapping the bound and unbound states of the complex by translating the ligand coordinates. PDT relates the free energy and the probability densities of the perturbation energy along the alchemical path to the probability density at the initial state, which is the unbound state of the complex in the case of a binding process. Hence, the ATM probability density of the transfer energy at the unbound state is first related by a convolution operation of the probability densities for coupling the ligand to the solvent and coupling it to the solvated receptor--for which analytical descriptions are available--with parameters obtained from maximum likelihood analysis of data from double-decoupling alchemical calculations. PDT is then used to extend this analytical description along the alchemical transfer pathway. We tested the theory on the alchemical binding of five guests to the TEMOA host from the SAMPL8 benchmark set. In each case, the probability densities of the perturbation energy for transfer along the alchemical transfer pathway obtained from numerical calculations match those predicted from the theory and double-decoupling simulations. The work provides a solid theoretical foundation for alchemical transfer, offers physical insights on the form of the probability densities observed in alchemical transfer calculations, and confirms the conceptual and numerical equivalence between the alchemical transfer and double-decoupling processes.
△ Less
Submitted 11 October, 2024; v1 submitted 19 July, 2024;
originally announced July 2024.
-
Binding Selectivity Analysis from Alchemical Receptor Hopping and Swapping Free Energy Calculations
Authors:
Solmaz Azimi,
Emilio Gallicchio
Abstract:
We present receptor hopping and receptor swapping free energy estimation protocols based on the Alchemical Transfer Method (ATM) to model the binding selectivity of a set of ligands to two arbitrary receptors. The receptor hopping protocol, where a ligand is alchemically transferred from one receptor to another in one simulation, directly yields the ligand's binding selectivity free energy for the…
▽ More
We present receptor hopping and receptor swapping free energy estimation protocols based on the Alchemical Transfer Method (ATM) to model the binding selectivity of a set of ligands to two arbitrary receptors. The receptor hopping protocol, where a ligand is alchemically transferred from one receptor to another in one simulation, directly yields the ligand's binding selectivity free energy for the two receptors, which is the difference between the two individual binding free energies. In the receptor swapping protocol, the first ligand of a pair is transferred from one receptor to another while the second ligand is simultaneously transferred in the opposite direction. The receptor swapping free energy yields the differences in binding selectivity free energies of a set of ligands, which, when combined using a generalized DiffNet algorithm, yield the binding selectivity free energies of the ligands. We test these algorithms on host-guest systems and show that they yield results that agree with experimental data and are consistent with differences in absolute and relative binding free energies obtained by conventional methods. Preliminary applications to the selectivity analysis of molecular fragments binding to the trypsin and thrombin serine protease confirm the potential of the receptor swapping technology in structure-based drug discovery. The novel methodologies presented in this work are a first step toward streamlined and computationally efficient protocols for ligand selectivity optimization across protein receptors with potentially low sequence identity.
△ Less
Submitted 26 August, 2024; v1 submitted 10 February, 2024;
originally announced February 2024.
-
Drones4Good: Supporting Disaster Relief Through Remote Sensing and AI
Authors:
Nina Merkle,
Reza Bahmanyar,
Corentin Henry,
Seyed Majid Azimi,
Xiangtian Yuan,
Simon Schopferer,
Veronika Gstaiger,
Stefan Auer,
Anne Schneibel,
Marc Wieland,
Thomas Kraft
Abstract:
In order to respond effectively in the aftermath of a disaster, emergency services and relief organizations rely on timely and accurate information about the affected areas. Remote sensing has the potential to significantly reduce the time and effort required to collect such information by enabling a rapid survey of large areas. To achieve this, the main challenge is the automatic extraction of re…
▽ More
In order to respond effectively in the aftermath of a disaster, emergency services and relief organizations rely on timely and accurate information about the affected areas. Remote sensing has the potential to significantly reduce the time and effort required to collect such information by enabling a rapid survey of large areas. To achieve this, the main challenge is the automatic extraction of relevant information from remotely sensed data. In this work, we show how the combination of drone-based data with deep learning methods enables automated and large-scale situation assessment. In addition, we demonstrate the integration of onboard image processing techniques for the deployment of autonomous drone-based aid delivery. The results show the feasibility of a rapid and large-scale image analysis in the field, and that onboard image processing can increase the safety of drone-based aid deliveries.
△ Less
Submitted 9 August, 2023;
originally announced August 2023.
-
Taming Multiple Binding Poses in Alchemical Binding Free Energy Prediction: the $β$-cyclodextrin Host-Guest SAMPL9 Blinded Challenge
Authors:
Sheenam Khuttan,
Solmaz Azimi,
Joe Z. Wu,
Sebastian Dick,
Chuanjie Wu,
Huafeng Xu,
Emilio Gallicchio
Abstract:
We apply the Alchemical Transfer Method (ATM) and a bespoke fixed partial charge force field to the SAMPL9 bCD host-guest binding free energy prediction challenge that comprises a combination of complexes formed between five phenothiazine guests and two cyclodextrin hosts. Multiple chemical forms, competing binding poses, and computational modeling challenges pose significant obstacles to obtainin…
▽ More
We apply the Alchemical Transfer Method (ATM) and a bespoke fixed partial charge force field to the SAMPL9 bCD host-guest binding free energy prediction challenge that comprises a combination of complexes formed between five phenothiazine guests and two cyclodextrin hosts. Multiple chemical forms, competing binding poses, and computational modeling challenges pose significant obstacles to obtaining reliable computational predictions for these systems. The phenothiazine guests exist in solution as racemic mixtures of enantiomers related by nitrogen inversions that bind the hosts in various binding poses, each requiring an individual free energy analysis. Due to the large size of the guests and the conformational reorganization of the hosts, which prevent a direct absolute binding free energy route, binding free energies are obtained by a series of absolute and relative binding alchemical steps for each chemical species in each binding pose. Metadynamics-accelerated conformational sampling was found to be necessary to address the poor convergence of some numerical estimates affected by conformational trapping. Despite these challenges, our blinded predictions quantitatively reproduced the experimental affinities for the $β$-cyclodextrin host, less one case of the methylated derivative being an outlier. The work illustrates the challenges of obtaining reliable free energy data in in-silico drug design for even seemingly simple systems and introduces some of the technologies available to tackle them.
△ Less
Submitted 25 February, 2023; v1 submitted 16 February, 2023;
originally announced February 2023.
-
Identifying gender bias in blockbuster movies through the lens of machine learning
Authors:
Muhammad Junaid Haris,
Aanchal Upreti,
Melih Kurtaran,
Filip Ginter,
Sebastien Lafond,
Sepinoud Azimi
Abstract:
The problem of gender bias is highly prevalent and well known. In this paper, we have analysed the portrayal of gender roles in English movies, a medium that effectively influences society in shaping people's beliefs and opinions. First, we gathered scripts of films from different genres and derived sentiments and emotions using natural language processing techniques. Afterwards, we converted the…
▽ More
The problem of gender bias is highly prevalent and well known. In this paper, we have analysed the portrayal of gender roles in English movies, a medium that effectively influences society in shaping people's beliefs and opinions. First, we gathered scripts of films from different genres and derived sentiments and emotions using natural language processing techniques. Afterwards, we converted the scripts into embeddings, i.e. a way of representing text in the form of vectors. With a thorough investigation, we found specific patterns in male and female characters' personality traits in movies that align with societal stereotypes. Furthermore, we used mathematical and machine learning techniques and found some biases wherein men are shown to be more dominant and envious than women, whereas women have more joyful roles in movies. In our work, we introduce, to the best of our knowledge, a novel technique to convert dialogues into an array of emotions by combining it with Plutchik's wheel of emotions. Our study aims to encourage reflections on gender equality in the domain of film and facilitate other researchers in analysing movies automatically instead of using manual approaches.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
SimuShips -- A High Resolution Simulation Dataset for Ship Detection with Precise Annotations
Authors:
Minahil Raza,
Hanna Prokopova,
Samir Huseynzade,
Sepinoud Azimi,
Sebastien Lafond
Abstract:
Obstacle detection is a fundamental capability of an autonomous maritime surface vessel (AMSV). State-of-the-art obstacle detection algorithms are based on convolutional neural networks (CNNs). While CNNs provide higher detection accuracy and fast detection speed, they require enormous amounts of data for their training. In particular, the availability of domain-specific datasets is a challenge fo…
▽ More
Obstacle detection is a fundamental capability of an autonomous maritime surface vessel (AMSV). State-of-the-art obstacle detection algorithms are based on convolutional neural networks (CNNs). While CNNs provide higher detection accuracy and fast detection speed, they require enormous amounts of data for their training. In particular, the availability of domain-specific datasets is a challenge for obstacle detection. The difficulty in conducting onsite experiments limits the collection of maritime datasets. Owing to the logistic cost of conducting on-site operations, simulation tools provide a safe and cost-efficient alternative for data collection. In this work, we introduce SimuShips, a publicly available simulation-based dataset for maritime environments. Our dataset consists of 9471 high-resolution (1920x1080) images which include a wide range of obstacle types, atmospheric and illumination conditions along with occlusion, scale and visible proportion variations. We provide annotations in the form of bounding boxes. In addition, we conduct experiments with YOLOv5 to test the viability of simulation data. Our experiments indicate that the combination of real and simulated images improves the recall for all classes by 2.9%.
△ Less
Submitted 22 September, 2022;
originally announced November 2022.
-
On the Achievability of Coded Multicasting Fronthaul Delivery in Fog-Aided Networks
Authors:
Seyyed Mohammadreza Azimi
Abstract:
Fog networks benefit from content caching at edge nodes (ENs) as well as fronthaul connectivity to the cloud. In previous works, both dedicated and multicast fronthaul links has been considered under different assumptions with Normalized Delivery Time (NDT) as a standard to measure the performance. While dedicated links has been studied extensively in different caching scenarios, multicast links h…
▽ More
Fog networks benefit from content caching at edge nodes (ENs) as well as fronthaul connectivity to the cloud. In previous works, both dedicated and multicast fronthaul links has been considered under different assumptions with Normalized Delivery Time (NDT) as a standard to measure the performance. While dedicated links has been studied extensively in different caching scenarios, multicast links has been developed under assumption of 2-by-2 fog network where cloud is connected to two ENs serving two users. The extension to arbitrary number of ENs and users only provides the lower bound on the achievable performance. In contrast, this letter proposes an achievable coded multicasting scheme for a general M-by-K fog network with M ENs and K users. The optimality of the proposed scheme is evaluated using both comparison with theoretical lower bound as well as using numerical analysis.
△ Less
Submitted 26 February, 2022;
originally announced February 2022.
-
Application of the Alchemical Transfer and Potential of Mean Force Methods to the SAMPL8 Host-Guest Blinded Challenge
Authors:
Solmaz Azimi,
Joe Z. Wu,
Sheenam Khuttan,
Tom Kurtzman,
Nanjie Deng,
Emilio Gallicchio
Abstract:
We report the results of our participation in the SAMPL8 GDCC Blind Challenge for host-guest binding affinity predictions. Absolute binding affinity prediction is of central importance to the biophysics of molecular association and pharmaceutical discovery. The blinded SAMPL series have provided an important forum for assessing the reliability of binding free energy methods in an objective way. In…
▽ More
We report the results of our participation in the SAMPL8 GDCC Blind Challenge for host-guest binding affinity predictions. Absolute binding affinity prediction is of central importance to the biophysics of molecular association and pharmaceutical discovery. The blinded SAMPL series have provided an important forum for assessing the reliability of binding free energy methods in an objective way. In this blinded challenge, we employed two binding free energy methods, the newly developed alchemical transfer method (ATM) and the well-established potential of mean force (PMF) physical pathway method, using the same setup and force field model. The calculated binding free energies from the two methods are in excellent quantitative agreement. Importantly, the results from the two methods were also found to agree well with the experimental binding affinities released subsequently, with an $R^2$ of 0.89 (ATM) and 0.83 (PMF). Given that the two free energy methods are based on entirely different thermodynamic pathways, the close agreement between the results from the two methods and their general agreement with the experimental binding free energies are a testament to the high quality achieved by theory and methods. The study provides further validation of the novel ATM binding free energy estimation protocol and it paves the way to further extensions of the method to more complex systems.
△ Less
Submitted 11 July, 2021;
originally announced July 2021.
-
Relative Binding Free Energy Calculations for Ligands with Diverse Scaffolds with the Alchemical Transfer Method
Authors:
Solmaz Azimi,
Sheenam Khuttan,
Joe Z. Wu,
Rajat K. Pal,
Emilio Gallicchio
Abstract:
We present an extension of Alchemical Transfer Method (ATM) for the estimation of relative binding free energies of molecular complexes applicable to conventional as well as scaffold-hopping alchemical transformations. The method, named ATM-RBFE, implemented in the free and open-source OpenMM molecular simulation package, aims to provide a simpler and more generally applicable route to the calcula…
▽ More
We present an extension of Alchemical Transfer Method (ATM) for the estimation of relative binding free energies of molecular complexes applicable to conventional as well as scaffold-hopping alchemical transformations. The method, named ATM-RBFE, implemented in the free and open-source OpenMM molecular simulation package, aims to provide a simpler and more generally applicable route to the calculation of relative binding free energies than is currently available. The method is based on sound statistical mechanics theory and a novel coordinate perturbation scheme designed to swap the positions of a pair of ligands such that one is transferred from the bulk solvent to the receptor binding site while the other moves simultaneously in the opposite direction. The calculation is conducted directly using a single solvent box prepared using conventional setup tools, without splitting of electrostatic and non-electrostatic transformations, and without pairwise soft-core potentials. ATM-RBFE is validated here against the absolute binding free energies of the SAMPL8 GDCC host-guest benchmark set and against a benchmark set of estrogen receptor $α$ complexes. In each case, the method yields self-consistent and converged relative binding free energy estimates in agreement with absolute binding free energies, reference literature values as well as experimental measurements.
△ Less
Submitted 11 July, 2021;
originally announced July 2021.
-
Intelligent Monitoring of Stress Induced by Water Deficiency in Plants using Deep Learning
Authors:
Shiva Azimi,
Rohan Wadhawan,
Tapan K. Gandhi
Abstract:
In the recent decade, high-throughput plant phenotyping techniques, which combine non-invasive image analysis and machine learning, have been successfully applied to identify and quantify plant health and diseases. However, these techniques usually do not consider the progressive nature of plant stress and often require images showing severe signs of stress to ensure high confidence detection, the…
▽ More
In the recent decade, high-throughput plant phenotyping techniques, which combine non-invasive image analysis and machine learning, have been successfully applied to identify and quantify plant health and diseases. However, these techniques usually do not consider the progressive nature of plant stress and often require images showing severe signs of stress to ensure high confidence detection, thereby reducing the feasibility for early detection and recovery of plants under stress. To overcome the problem mentioned above, we propose a deep learning pipeline for the temporal analysis of the visual changes induced in the plant due to stress and apply it to the specific water stress identification case in Chickpea plant shoot images. For this, we have considered an image dataset of two chickpea varieties JG-62 and Pusa-372, under three water stress conditions; control, young seedling, and before flowering, captured over five months. We have employed a variant of Convolutional Neural Network - Long Short Term Memory (CNN-LSTM) network to learn spatio-temporal patterns from the chickpea plant dataset and use them for water stress classification. Our model has achieved ceiling level classification performance of 98.52% on JG-62 and 97.78% on Pusa-372 chickpea plant data and has outperformed the best reported time-invariant technique by at least 14% for both JG-62 and Pusa-372 species, to the best of our knowledge. Furthermore, our CNN-LSTM model has demonstrated robustness to noisy input, with a less than 2.5% dip in average model accuracy and a small standard deviation about the mean for both species. Lastly, we have performed an ablation study to analyze the performance of the CNN-LSTM model by decreasing the number of temporal session data used for training.
△ Less
Submitted 3 September, 2021; v1 submitted 16 April, 2021;
originally announced April 2021.
-
Evolutionary computational platform for the automatic discovery of nanocarriers for cancer treatment
Authors:
Namid Stillman,
Igor Balaz,
Antisthenis Tsompanas,
Marina Kovacevic,
Sepinoud Azimi,
Sebastien Lafond,
Andrew Adamatzky,
Sabine Hauert
Abstract:
We present the EVONANO platform for the evolution of nanomedicines with application to anti-cancer treatments. EVONANO includes a simulator to grow tumours, extract representative scenarios, and then simulate nanoparticle transport through these scenarios to predict nanoparticle distribution. The nanoparticle designs are optimised using machine learning to efficiently find the most effective anti-…
▽ More
We present the EVONANO platform for the evolution of nanomedicines with application to anti-cancer treatments. EVONANO includes a simulator to grow tumours, extract representative scenarios, and then simulate nanoparticle transport through these scenarios to predict nanoparticle distribution. The nanoparticle designs are optimised using machine learning to efficiently find the most effective anti-cancer treatments. We demonstrate our platform with two examples optimising the properties of nanoparticles and treatment to selectively kill cancer cells over a range of tumour environments.
△ Less
Submitted 1 February, 2021;
originally announced February 2021.
-
Alchemical Transfer Approach to Absolute Binding Free Energy Estimation
Authors:
Joe Z. Wu,
Solmaz Azimi,
Sheenam Khuttan,
Nanjie Deng,
Emilio Gallicchio
Abstract:
The Alchemical Transfer Method (ATM) for the calculation of standard binding free energies of non-covalent molecular complexes is presented. The method is based on a coordinate displacement perturbation of the ligand between the receptor binding site and the explicit solvent bulk, and a thermodynamic cycle connected by a symmetric intermediate in which the ligand interacts with the receptor and so…
▽ More
The Alchemical Transfer Method (ATM) for the calculation of standard binding free energies of non-covalent molecular complexes is presented. The method is based on a coordinate displacement perturbation of the ligand between the receptor binding site and the explicit solvent bulk, and a thermodynamic cycle connected by a symmetric intermediate in which the ligand interacts with the receptor and solvent environments with equal strength. While the approach is alchemical, the implementation of ATM is as straightforward as for physical pathway methods of binding. The method is applicable in principle with any force field, it does not require splitting the alchemical transformations into electrostatic and non-electrostatic steps, and it does not require soft-core pair potentials. We have implemented ATM as a freely available and open-source plugin of the OpenMM molecular dynamics library. The method and its implementation are validated on the SAMPL6 SAMPLing host-guest benchmark set. The work paves the way to streamlined alchemical relative and absolute binding free energy implementations on many molecular simulation packages and with arbitrary energy functions including polarizable, quantum-mechanical, and artificial neural network potentials.
△ Less
Submitted 19 January, 2021;
originally announced January 2021.
-
On the Verification and Validation of AI Navigation Algorithms
Authors:
Ivan Porres,
Sepinoud Azimi,
Sébastien Lafond,
Johan Lilius,
Johanna Salokannel,
Mirva Salokorpi
Abstract:
This paper explores the state of the art on to methods to verify and validate navigation algorithms for autonomous surface ships. We perform a systematic mapping study to find research works published in the last 10 years proposing new algorithms for autonomous navigation and collision avoidance and we have extracted what verification and validation approaches have been applied on these algorithms…
▽ More
This paper explores the state of the art on to methods to verify and validate navigation algorithms for autonomous surface ships. We perform a systematic mapping study to find research works published in the last 10 years proposing new algorithms for autonomous navigation and collision avoidance and we have extracted what verification and validation approaches have been applied on these algorithms. We observe that most research works use simulations to validate their algorithms. However, these simulations often involve just a few scenarios designed manually. This raises the question if the algorithms have been validated properly. To remedy this, we propose the use of a systematic scenario-based testing approach to validate navigation algorithms extensively.
△ Less
Submitted 15 January, 2021;
originally announced January 2021.
-
Improving Students Performance in Small-Scale Online Courses -- A Machine Learning-Based Intervention
Authors:
Sepinoud Azimi,
Carmen-Gabriela Popa,
Tatjana Cucić
Abstract:
The birth of massive open online courses (MOOCs) has had an undeniable effect on how teaching is being delivered. It seems that traditional in class teaching is becoming less popular with the young generation, the generation that wants to choose when, where and at what pace they are learning. As such, many universities are moving towards taking their courses, at least partially, online. However, o…
▽ More
The birth of massive open online courses (MOOCs) has had an undeniable effect on how teaching is being delivered. It seems that traditional in class teaching is becoming less popular with the young generation, the generation that wants to choose when, where and at what pace they are learning. As such, many universities are moving towards taking their courses, at least partially, online. However, online courses, although very appealing to the younger generation of learners, come at a cost. For example, the dropout rate of such courses is higher than that of more traditional ones, and the reduced in person interaction with the teachers results in less timely guidance and intervention from the educators. Machine learning (ML) based approaches have shown phenomenal successes in other domains. The existing stigma that applying ML based techniques requires a large amount of data seems to be a bottleneck when dealing with small scale courses with limited amounts of produced data. In this study, we show not only that the data collected from an online learning management system could be well utilized in order to predict students overall performance but also that it could be used to propose timely intervention strategies to boost the students performance level. The results of this study indicate that effective intervention strategies could be suggested as early as the middle of the course to change the course of students progress for the better. We also present an assistive pedagogical tool based on the outcome of this study, to assist in identifying challenging students and in suggesting early intervention strategies.
△ Less
Submitted 23 November, 2020;
originally announced December 2020.
-
Multiple Pedestrians and Vehicles Tracking in Aerial Imagery: A Comprehensive Study
Authors:
Seyed Majid Azimi,
Maximilian Kraus,
Reza Bahmanyar,
Peter Reinartz
Abstract:
In this paper, we address various challenges in multi-pedestrian and vehicle tracking in high-resolution aerial imagery by intensive evaluation of a number of traditional and Deep Learning based Single- and Multi-Object Tracking methods. We also describe our proposed Deep Learning based Multi-Object Tracking method AerialMPTNet that fuses appearance, temporal, and graphical information using a Sia…
▽ More
In this paper, we address various challenges in multi-pedestrian and vehicle tracking in high-resolution aerial imagery by intensive evaluation of a number of traditional and Deep Learning based Single- and Multi-Object Tracking methods. We also describe our proposed Deep Learning based Multi-Object Tracking method AerialMPTNet that fuses appearance, temporal, and graphical information using a Siamese Neural Network, a Long Short-Term Memory, and a Graph Convolutional Neural Network module for a more accurate and stable tracking. Moreover, we investigate the influence of the Squeeze-and-Excitation layers and Online Hard Example Mining on the performance of AerialMPTNet. To the best of our knowledge, we are the first in using these two for a regression-based Multi-Object Tracking. Additionally, we studied and compared the L1 and Huber loss functions. In our experiments, we extensively evaluate AerialMPTNet on three aerial Multi-Object Tracking datasets, namely AerialMPT and KIT AIS pedestrian and vehicle datasets. Qualitative and quantitative results show that AerialMPTNet outperforms all previous methods for the pedestrian datasets and achieves competitive results for the vehicle dataset. In addition, Long Short-Term Memory and Graph Convolutional Neural Network modules enhance the tracking performance. Moreover, using Squeeze-and-Excitation and Online Hard Example Mining significantly helps for some cases while degrades the results for other cases. In addition, according to the results, L1 yields better results with respect to Huber loss for most of the scenarios. The presented results provide a deep insight into challenges and opportunities of the aerial Multi-Object Tracking domain, paving the way for future research.
△ Less
Submitted 19 October, 2020;
originally announced October 2020.
-
Adjoint-based variational method for constructing periodic orbits of high-dimensional chaotic systems
Authors:
Sajjad Azimi,
Omid Ashtari,
Tobias M. Schneider
Abstract:
Chaotic dynamics in systems ranging from low-dimensional nonlinear differential equations to high-dimensional spatio-temporal systems including fluid turbulence is supported by non-chaotic, exactly recurring time-periodic solutions of the governing equations. These unstable periodic orbits capture key features of the turbulent dynamics and sufficiently large sets of orbits promise a framework to p…
▽ More
Chaotic dynamics in systems ranging from low-dimensional nonlinear differential equations to high-dimensional spatio-temporal systems including fluid turbulence is supported by non-chaotic, exactly recurring time-periodic solutions of the governing equations. These unstable periodic orbits capture key features of the turbulent dynamics and sufficiently large sets of orbits promise a framework to predict the statistics of the chaotic flow. Computing periodic orbits for high-dimensional spatio-temporally chaotic systems remains challenging as known methods either show poor convergence properties because they are based on time-marching of a chaotic system causing exponential error amplification; or they require constructing Jacobian matrices which is prohibitively expensive. We propose a new matrix-free method that is unaffected by exponential error amplification, is globally convergent and can be applied to high-dimensional systems. The adjoint-based variational method constructs an initial value problem in the space of closed loops such that periodic orbits are attracting fixed points for the loop-dynamics. We introduce the method for general autonomous systems. An implementation for the one-dimensional Kuramoto-Sivashinsky equation demonstrates the robust convergence of periodic orbits underlying spatio-temporal chaos. Convergence does not require accurate initial guesses and is independent of the period of the respective orbit.
△ Less
Submitted 13 July, 2020;
originally announced July 2020.
-
EAGLE: Large-scale Vehicle Detection Dataset in Real-World Scenarios using Aerial Imagery
Authors:
Seyed Majid Azimi,
Reza Bahmanyar,
Corenin Henry,
Franz Kurz
Abstract:
Multi-class vehicle detection from airborne imagery with orientation estimation is an important task in the near and remote vision domains with applications in traffic monitoring and disaster management. In the last decade, we have witnessed significant progress in object detection in ground imagery, but it is still in its infancy in airborne imagery, mostly due to the scarcity of diverse and larg…
▽ More
Multi-class vehicle detection from airborne imagery with orientation estimation is an important task in the near and remote vision domains with applications in traffic monitoring and disaster management. In the last decade, we have witnessed significant progress in object detection in ground imagery, but it is still in its infancy in airborne imagery, mostly due to the scarcity of diverse and large-scale datasets. Despite being a useful tool for different applications, current airborne datasets only partially reflect the challenges of real-world scenarios. To address this issue, we introduce EAGLE (oriEnted vehicle detection using Aerial imaGery in real-worLd scEnarios), a large-scale dataset for multi-class vehicle detection with object orientation information in aerial imagery. It features high-resolution aerial images composed of different real-world situations with a wide variety of camera sensor, resolution, flight altitude, weather, illumination, haze, shadow, time, city, country, occlusion, and camera angle. The annotation was done by airborne imagery experts with small- and large-vehicle classes. EAGLE contains 215,986 instances annotated with oriented bounding boxes defined by four points and orientation, making it by far the largest dataset to date in this task. It also supports researches on the haze and shadow removal as well as super-resolution and in-painting applications. We define three tasks: detection by (1) horizontal bounding boxes, (2) rotated bounding boxes, and (3) oriented bounding boxes. We carried out several experiments to evaluate several state-of-the-art methods in object detection on our dataset to form a baseline. Experiments show that the EAGLE dataset accurately reflects real-world situations and correspondingly challenging applications.
△ Less
Submitted 23 November, 2020; v1 submitted 12 July, 2020;
originally announced July 2020.
-
SkyScapes -- Fine-Grained Semantic Understanding of Aerial Scenes
Authors:
Seyed Majid Azimi,
Corentin Henry,
Lars Sommer,
Arne Schumann,
Eleonora Vig
Abstract:
Understanding the complex urban infrastructure with centimeter-level accuracy is essential for many applications from autonomous driving to mapping, infrastructure monitoring, and urban management. Aerial images provide valuable information over a large area instantaneously; nevertheless, no current dataset captures the complexity of aerial scenes at the level of granularity required by real-world…
▽ More
Understanding the complex urban infrastructure with centimeter-level accuracy is essential for many applications from autonomous driving to mapping, infrastructure monitoring, and urban management. Aerial images provide valuable information over a large area instantaneously; nevertheless, no current dataset captures the complexity of aerial scenes at the level of granularity required by real-world applications. To address this, we introduce SkyScapes, an aerial image dataset with highly-accurate, fine-grained annotations for pixel-level semantic labeling. SkyScapes provides annotations for 31 semantic categories ranging from large structures, such as buildings, roads and vegetation, to fine details, such as 12 (sub-)categories of lane markings. We have defined two main tasks on this dataset: dense semantic segmentation and multi-class lane-marking prediction. We carry out extensive experiments to evaluate state-of-the-art segmentation methods on SkyScapes. Existing methods struggle to deal with the wide range of classes, object sizes, scales, and fine details present. We therefore propose a novel multi-task model, which incorporates semantic edge detection and is better tuned for feature extraction from a wide range of scales. This model achieves notable improvements over the baselines in region outlines and level of detail on both tasks.
△ Less
Submitted 12 July, 2020;
originally announced July 2020.
-
AerialMPTNet: Multi-Pedestrian Tracking in Aerial Imagery Using Temporal and Graphical Features
Authors:
Maximilian Kraus,
Seyed Majid Azimi,
Emec Ercelik,
Reza Bahmanyar,
Peter Reinartz,
Alois Knoll
Abstract:
Multi-pedestrian tracking in aerial imagery has several applications such as large-scale event monitoring, disaster management, search-and-rescue missions, and as input into predictive crowd dynamic models. Due to the challenges such as the large number and the tiny size of the pedestrians (e.g., 4 x 4 pixels) with their similar appearances as well as different scales and atmospheric conditions of…
▽ More
Multi-pedestrian tracking in aerial imagery has several applications such as large-scale event monitoring, disaster management, search-and-rescue missions, and as input into predictive crowd dynamic models. Due to the challenges such as the large number and the tiny size of the pedestrians (e.g., 4 x 4 pixels) with their similar appearances as well as different scales and atmospheric conditions of the images with their extremely low frame rates (e.g., 2 fps), current state-of-the-art algorithms including the deep learning-based ones are unable to perform well. In this paper, we propose AerialMPTNet, a novel approach for multi-pedestrian tracking in geo-referenced aerial imagery by fusing appearance features from a Siamese Neural Network, movement predictions from a Long Short-Term Memory, and pedestrian interconnections from a GraphCNN. In addition, to address the lack of diverse aerial pedestrian tracking datasets, we introduce the Aerial Multi-Pedestrian Tracking (AerialMPT) dataset consisting of 307 frames and 44,740 pedestrians annotated. We believe that AerialMPT is the largest and most diverse dataset to this date and will be released publicly. We evaluate AerialMPTNet on AerialMPT and KIT AIS, and benchmark with several state-of-the-art tracking methods. Results indicate that AerialMPTNet significantly outperforms other methods on accuracy and time-efficiency.
△ Less
Submitted 27 June, 2020;
originally announced June 2020.
-
Online Caching with Wireless Fronthauling and Delivery in Fog-Aided Networks
Authors:
Seyyed Mohammadreza Azimi
Abstract:
Fog Radio Access Network (F-RAN) exploits cached contents at edge nodes (ENs) and fronthaul connection to the cloud for content delivery. Assuming dedicated fronthaul links between cloud and each EN, previous works focused on analyses of F-RANs using offline or online caching depending whether the content popularity is time-invariant or time-variant. Extension has been done for multicast fronthaul…
▽ More
Fog Radio Access Network (F-RAN) exploits cached contents at edge nodes (ENs) and fronthaul connection to the cloud for content delivery. Assuming dedicated fronthaul links between cloud and each EN, previous works focused on analyses of F-RANs using offline or online caching depending whether the content popularity is time-invariant or time-variant. Extension has been done for multicast fronthaul link connecting cloud to only two ENs and time-invariant popularity. In contrast, the scope of this work is on the case where multicast fronthaul link connects arbitrary number of ENs to the cloud and content popularity is time-variant. Normalized Delivery Time (NDT) is used as a performance measure and by investigating proactive online caching, analytical results reveal that the power scaling of fronthaul transmission sets a limit on the performance of F-RAN.
△ Less
Submitted 12 June, 2020;
originally announced June 2020.
-
Alchemical Transformations for Concerted Hydration Free Energy Estimation with Explicit Solvation
Authors:
Sheenam Khuttan,
Solmaz Azimi,
Joe Z. Wu,
Emilio Gallicchio
Abstract:
We present a family of alchemical perturbation potentials that enable the calculation of hydration free energies of small to medium-sized molecules in a concerted single alchemical coupling step instead of the commonly used sequence of two distinct coupling steps for Lennard-Jones and electrostatic interactions. The perturbation potentials are based on the softplus function of the solute-solvent i…
▽ More
We present a family of alchemical perturbation potentials that enable the calculation of hydration free energies of small to medium-sized molecules in a concerted single alchemical coupling step instead of the commonly used sequence of two distinct coupling steps for Lennard-Jones and electrostatic interactions. The perturbation potentials are based on the softplus function of the solute-solvent interaction energy designed to focus sampling near entropic bottlenecks along the alchemical pathway. We present a general framework to optimize the parameters of alchemical perturbation potentials of this kind. The optimization procedure is based on the $λ$-function formalism and the maximum-likelihood parameter estimation procedure we developed earlier to avoid the occurrence of multi-modal distributions of the coupling energy along the alchemical path. A novel soft-core function applied to the overall solute-solvent interaction energy rather than individual interatomic pair potentials critical for this result is also presented. Because it does not require modifications of core force and energy routines, the soft-core formulation can be easily deployed in molecular dynamics simulation codes. We illustrate the method by applying it to the estimation of the hydration free energy in water droplets of compounds of varying size and complexity. In each case, we show that convergence of the hydration free energy is achieved rapidly. This work paves the way for the ongoing development of more streamlined algorithms to estimate free energies of molecular binding with explicit solvation.
△ Less
Submitted 2 November, 2020; v1 submitted 13 May, 2020;
originally announced May 2020.
-
Self-sustained large-scale motions in the asymptotic suction boundary layer
Authors:
Sajjad Azimi,
Carlo Cossu,
Tobias M. Schneider
Abstract:
Large-scale motions, also known as superstructures, are dynamically relevant coherent structures in a wall-bounded turbulent flow, that span the entire domain in wall-normal direction and significantly contribute to the global energy and momentum transport. Recent investigations in channel and Couette flow, suggest that these large-scale motions are self-sustained, implying they are not driven by…
▽ More
Large-scale motions, also known as superstructures, are dynamically relevant coherent structures in a wall-bounded turbulent flow, that span the entire domain in wall-normal direction and significantly contribute to the global energy and momentum transport. Recent investigations in channel and Couette flow, suggest that these large-scale motions are self-sustained, implying they are not driven by small-scale motions at the wall. Whether large-scale motions are self-sustained has however not yet been answered for open boundary layers, which are relevant for many applications. Here, using the asymptotic suction boundary layer flow at the friction Reynolds number $Re_τ= 1\,168$ as a testbed, we show that large-scale motions are self-sustained also in boundary layers. Together with the previous investigations in confined flows, this observation provides strong evidence of the robust and general nature of coherent self-sustained processes in turbulent wall-bounded flows. The dynamics of the large-scale self-sustained process involving the growth, breakdown and regeneration of quasi-streamwise coherent streaks and vortices within the boundary layer shows temporal phase relations reminiscent of bursting as observed in buffer layer structures. The dynamics however differs from the quasi-periodic large-scale streak-vortex regeneration cycle observed in confined flows. Based on the similarity of the dynamics of large-scale motions in boundary layers and of small-scale buffer layer structures, we conjecture that the bursting behaviour is associated with the dynamical relevance of only one wall, while two confining walls lead to the quasi-periodic cycle.
△ Less
Submitted 19 April, 2020;
originally announced April 2020.
-
Modified snaking in plane Couette flow with wall-normal suction
Authors:
Sajjad Azimi,
Tobias M. Schneider
Abstract:
A specific family of spanwise-localised invariant solutions of plane Couette flow exhibits homoclinic snaking, a process by which spatially localised invariant solutions of a nonlinear partial differential equation smoothly grow additional structure at their fronts while undergoing a sequence of saddle-node bifurcations. Homoclinic snaking is well understood in the context of simpler pattern formi…
▽ More
A specific family of spanwise-localised invariant solutions of plane Couette flow exhibits homoclinic snaking, a process by which spatially localised invariant solutions of a nonlinear partial differential equation smoothly grow additional structure at their fronts while undergoing a sequence of saddle-node bifurcations. Homoclinic snaking is well understood in the context of simpler pattern forming systems such as the one-dimensional Swift-Hohenberg equation with cubic-quintic nonlinearity, whose solutions remarkably well resemble the snaking solutions of plane Couette flow. We study the structural stability of the characteristic snakes-and-ladders structure associated with homoclinic snaking for flow modifications that break symmetries of plane Couette flow. We demonstrate that wall-normal suction modifies the bifurcation structure of three-dimensional plane Couette solutions in the same way, a symmetry-breaking quadratic term modifies solutions of the one-dimensional Swift-Hohenberg equation. These modifications are related to the breaking of the discrete rotational symmetry. At large amplitudes of the symmetry-breaking wall-normal suction the connected snakes-and-ladders structure is destroyed. Previously unknown solution branches are created and can be parametrically continued to vanishing suction. This yields new localised solutions of plane Couette flow that exist in a wide range of Reynolds number.
△ Less
Submitted 31 March, 2020;
originally announced April 2020.
-
Self-similar invariant solution in the near-wall region of a turbulent boundary layer at asymptotically high Reynolds numbers
Authors:
Sajjad Azimi,
Tobias M. Schneider
Abstract:
At sufficiently high Reynolds numbers, shear-flow turbulence close to a wall acquires universal properties. When length and velocity are rescaled by appropriate characteristic scales of the turbulent flow and thereby measured in \emph{inner units}, the statistical properties of the flow become independent of the Reynolds number. We demonstrate the existence of a wall-attached non-chaotic exact inv…
▽ More
At sufficiently high Reynolds numbers, shear-flow turbulence close to a wall acquires universal properties. When length and velocity are rescaled by appropriate characteristic scales of the turbulent flow and thereby measured in \emph{inner units}, the statistical properties of the flow become independent of the Reynolds number. We demonstrate the existence of a wall-attached non-chaotic exact invariant solution of the fully nonlinear 3D Navier-Stokes equations for a parallel boundary layer that captures the characteristic self-similar scaling of near-wall turbulent structures. The branch of travelling wave solutions can be followed up to $Re=1,000,000$. Combined theoretical and numerical evidence suggests that the solution is asymptotically self-similar and exactly scales in inner units for Reynolds numbers tending to infinity. Demonstrating the existence of invariant solutions that capture the self-similar scaling properties of turbulence in the near-wall region is a step towards extending the dynamical systems approach to turbulence from the transitional regime to fully developed boundary layers.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Mechanistic insight into the limiting factors of graphene-based environmental sensors
Authors:
Jean-Michel Guay,
Ranjana Rautela,
Samantha Scarfe,
Petr Lazar,
Saied Azimi,
Cedric Grenapin,
Alexei Halpin,
Weixang Wang,
Lukasz Andrzejewski,
Ryan Plumadore,
Jeongwon Park,
Michal Otyepka,
Jean-Michel Menard,
Adina Luican-Mayer
Abstract:
Graphene has demonstrated great promise for technological use, yet control over material growth and understanding of how material imperfections affect the performance of devices are challenges that hamper the development of applications. In this work we reveal new insight into the connections between the performance of the graphene devices as environmental sensors and the microscopic details of th…
▽ More
Graphene has demonstrated great promise for technological use, yet control over material growth and understanding of how material imperfections affect the performance of devices are challenges that hamper the development of applications. In this work we reveal new insight into the connections between the performance of the graphene devices as environmental sensors and the microscopic details of the interactions at the sensing surface. Specifically, we monitor changes in the resistance of the chemical-vapour deposition grown graphene devices as exposed to different concentrations of ethanol. We perform thermal surface treatments after the devices are fabricated, use scanning probe microscopy to visualize their effects on the graphene sensing surface down to nanometer scale and correlate them with the measured performance of the device as an ethanol sensor. Our observations are compared to theoretical calculations of charge transfers between molecules and the graphene surface. We find that, although often overlooked, the surface cleanliness after device fabrication is responsible for the device performance and reliability. These results further our understanding of the mechanisms of sensing in graphene-based environmental sensors and pave the way to optimizing such devices, especially for their miniaturization, as with decreasing size of the active zone the potential role of contaminants will rise.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
Performance comparison of 3D correspondence grouping algorithm for 3D plant point clouds
Authors:
Shiva Azimi,
Tapan K. Gandhi
Abstract:
Plant Phenomics can be used to monitor the health and the growth of plants. Computer vision applications like stereo reconstruction, image retrieval, object tracking, and object recognition play an important role in imaging based plant phenotyping. This paper offers a comparative evaluation of some popular 3D correspondence grouping algorithms, motivated by the important role that they can play in…
▽ More
Plant Phenomics can be used to monitor the health and the growth of plants. Computer vision applications like stereo reconstruction, image retrieval, object tracking, and object recognition play an important role in imaging based plant phenotyping. This paper offers a comparative evaluation of some popular 3D correspondence grouping algorithms, motivated by the important role that they can play in tasks such as model creation, plant recognition and identifying plant parts. Another contribution of this paper is the extension of 2D maximum likelihood matching to 3D Maximum Likelihood Estimation Sample Consensus (MLEASAC). MLESAC is efficient and is computationally less intense than 3D random sample consensus (RANSAC). We test these algorithms on 3D point clouds of plants along with two standard benchmarks addressing shape retrieval and point cloud registration scenarios. The performance is evaluated in terms of precision and recall.
△ Less
Submitted 2 September, 2019;
originally announced September 2019.
-
Performance Evalution of 3D Keypoint Detectors and Descriptors for Plants Health Classification
Authors:
Shiva Azimi,
Brejesh lall,
Tapan K. Gandhi
Abstract:
Plant Phenomics based on imaging based techniques can be used to monitor the health and the diseases of plants and crops. The use of 3D data for plant phenomics is a recent phenomenon. However, since 3D point cloud contains more information than plant images, in this paper, we compare the performance of different keypoint detectors and local feature descriptors combinations for the plant growth st…
▽ More
Plant Phenomics based on imaging based techniques can be used to monitor the health and the diseases of plants and crops. The use of 3D data for plant phenomics is a recent phenomenon. However, since 3D point cloud contains more information than plant images, in this paper, we compare the performance of different keypoint detectors and local feature descriptors combinations for the plant growth stage and it's growth condition classification based on 3D point clouds of the plants. We have also implemented a modified form of 3D SIFT descriptor, that is invariant to rotation and is computationally less intense than most of the 3D SIFT descriptors reported in the existing literature. The performance is evaluated in terms of the classification accuracy and the results are presented in terms of accuracy tables. We find the ISS-SHOT and the SIFT-SIFT combinations consistently perform better and Fisher Vector (FV) is a better encoder than Vector of Linearly Aggregated (VLAD) for such applications. It can serve as a better modality.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
ShuffleDet: Real-Time Vehicle Detection Network in On-board Embedded UAV Imagery
Authors:
Seyed Majid Azimi
Abstract:
On-board real-time vehicle detection is of great significance for UAVs and other embedded mobile platforms. We propose a computationally inexpensive detection network for vehicle detection in UAV imagery which we call ShuffleDet. In order to enhance the speed-wise performance, we construct our method primarily using channel shuffling and grouped convolutions. We apply inception modules and deforma…
▽ More
On-board real-time vehicle detection is of great significance for UAVs and other embedded mobile platforms. We propose a computationally inexpensive detection network for vehicle detection in UAV imagery which we call ShuffleDet. In order to enhance the speed-wise performance, we construct our method primarily using channel shuffling and grouped convolutions. We apply inception modules and deformable modules to consider the size and geometric shape of the vehicles. ShuffleDet is evaluated on CARPK and PUCPR+ datasets and compared against the state-of-the-art real-time object detection networks. ShuffleDet achieves 3.8 GFLOPs while it provides competitive performance on test sets of both datasets. We show that our algorithm achieves real-time performance by running at the speed of 14 frames per second on NVIDIA Jetson TX2 showing high potential for this method for real-time processing in UAVs.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery
Authors:
Seyed Majid Azimi,
Eleonora Vig,
Reza Bahmanyar,
Marco Körner,
Peter Reinartz
Abstract:
Automatic multi-class object detection in remote sensing images in unconstrained scenarios is of high interest for several applications including traffic monitoring and disaster management. The huge variation in object scale, orientation, category, and complex backgrounds, as well as the different camera sensors pose great challenges for current algorithms. In this work, we propose a new method co…
▽ More
Automatic multi-class object detection in remote sensing images in unconstrained scenarios is of high interest for several applications including traffic monitoring and disaster management. The huge variation in object scale, orientation, category, and complex backgrounds, as well as the different camera sensors pose great challenges for current algorithms. In this work, we propose a new method consisting of a novel joint image cascade and feature pyramid network with multi-size convolution kernels to extract multi-scale strong and weak semantic features. These features are fed into rotation-based region proposal and region of interest networks to produce object detections. Finally, rotational non-maximum suppression is applied to remove redundant detections. During training, we minimize joint horizontal and oriented bounding box loss functions, as well as a novel loss that enforces oriented boxes to be rectangular. Our method achieves 68.16% mAP on horizontal and 72.45% mAP on oriented bounding box detection tasks on the challenging DOTA dataset, outperforming all published methods by a large margin (+6% and +12% absolute improvement, respectively). Furthermore, it generalizes to two other datasets, NWPU VHR-10 and UCAS-AOD, and achieves competitive results with the baselines even when trained on DOTA. Our method can be deployed in multi-class object detection applications, regardless of the image and object scales and orientations, making it a great choice for unconstrained aerial and satellite imagery.
△ Less
Submitted 1 November, 2018; v1 submitted 7 July, 2018;
originally announced July 2018.
-
Aerial LaneNet: Lane Marking Semantic Segmentation in Aerial Imagery using Wavelet-Enhanced Cost-sensitive Symmetric Fully Convolutional Neural Networks
Authors:
Seyed Majid Azimi,
Peter Fischer,
Marco Körner,
Peter Reinartz
Abstract:
The knowledge about the placement and appearance of lane markings is a prerequisite for the creation of maps with high precision, necessary for autonomous driving, infrastructure monitoring, lane-wise traffic management, and urban planning. Lane markings are one of the important components of such maps. Lane markings convey the rules of roads to drivers. While these rules are learned by humans, an…
▽ More
The knowledge about the placement and appearance of lane markings is a prerequisite for the creation of maps with high precision, necessary for autonomous driving, infrastructure monitoring, lane-wise traffic management, and urban planning. Lane markings are one of the important components of such maps. Lane markings convey the rules of roads to drivers. While these rules are learned by humans, an autonomous driving vehicle should be taught to learn them to localize itself. Therefore, accurate and reliable lane marking semantic segmentation in the imagery of roads and highways is needed to achieve such goals. We use airborne imagery which can capture a large area in a short period of time by introducing an aerial lane marking dataset. In this work, we propose a Symmetric Fully Convolutional Neural Network enhanced by Wavelet Transform in order to automatically carry out lane marking segmentation in aerial imagery. Due to a heavily unbalanced problem in terms of number of lane marking pixels compared with background pixels, we use a customized loss function as well as a new type of data augmentation step. We achieve a very high accuracy in pixel-wise localization of lane markings without using 3rd-party information. In this work, we introduce the first high-quality dataset used within our experiments which contains a broad range of situations and classes of lane markings representative of current transportation systems. This dataset will be publicly available and hence, it can be used as the benchmark dataset for future algorithms within this domain.
△ Less
Submitted 1 November, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
Road Segmentation in SAR Satellite Images with Deep Fully-Convolutional Neural Networks
Authors:
Corentin Henry,
Seyed Majid Azimi,
Nina Merkle
Abstract:
Remote sensing is extensively used in cartography. As transportation networks grow and change, extracting roads automatically from satellite images is crucial to keep maps up-to-date. Synthetic Aperture Radar satellites can provide high resolution topographical maps. However roads are difficult to identify in these data as they look visually similar to targets such as rivers and railways. Most roa…
▽ More
Remote sensing is extensively used in cartography. As transportation networks grow and change, extracting roads automatically from satellite images is crucial to keep maps up-to-date. Synthetic Aperture Radar satellites can provide high resolution topographical maps. However roads are difficult to identify in these data as they look visually similar to targets such as rivers and railways. Most road extraction methods on Synthetic Aperture Radar images still rely on a prior segmentation performed by classical computer vision algorithms. Few works study the potential of deep learning techniques, despite their successful applications to optical imagery. This letter presents an evaluation of Fully-Convolutional Neural Networks for road segmentation in SAR images. We study the relative performance of early and state-of-the-art networks after carefully enhancing their sensitivity towards thin objects by adding spatial tolerance rules. Our models shows promising results, successfully extracting most of the roads in our test dataset. This shows that, although Fully-Convolutional Neural Networks natively lack efficiency for road segmentation, they are capable of good results if properly tuned. As the segmentation quality does not scale well with the increasing depth of the networks, the design of specialized architectures for roads extraction should yield better performances.
△ Less
Submitted 16 August, 2018; v1 submitted 5 February, 2018;
originally announced February 2018.
-
La production de nitrites lors de la dénitrification des eaux usées par biofiltration - Stratégie de contrôle et de réduction des concentrations résiduelles
Authors:
Vincent Rocher,
Cédric Join,
Stéphane Mottelet,
Jean Bernier,
Sabrina Rechdaoui-Guérin,
Sam Azimi,
Paul Lessard,
André Pauss,
Michel Fliess
Abstract:
The recent popularity of post-denitrification processes in the greater Paris area wastewater treatment plants has caused a resurgence of the presence of nitrite in the Seine river. Controlling the production of nitrite during the post-denitrification has thus become a major technical issue. Research studies have been led in the MOCOPEE program (www.mocopee.com) to better understand the underlying…
▽ More
The recent popularity of post-denitrification processes in the greater Paris area wastewater treatment plants has caused a resurgence of the presence of nitrite in the Seine river. Controlling the production of nitrite during the post-denitrification has thus become a major technical issue. Research studies have been led in the MOCOPEE program (www.mocopee.com) to better understand the underlying mechanisms behind the production of nitrite during wastewater denitrification and to develop technical tools (measurement and control solutions) to assist on-site reductions of nitrite productions. Prior studies have shown that typical methanol dosage strategies produce a varying carbon-to-nitrogen ratio in the reactor, which in turn leads to unstable nitrite concentrations in the effluent. The possibility of adding a model-free control to the actual classical dosage strategy has thus been tested on the SimBio model, which simulates the behavior of wastewater biofilters. The corresponding "intelligent" feedback loop, which is using effluent nitrite concentrations, compensates the classical strategy only when needed. Simulation results show a clear improvement in average nitrite concentration level and level stability in the effluent, without a notable overcost in methanol.
△ Less
Submitted 28 November, 2017;
originally announced November 2017.
-
Online Edge Caching and Wireless Delivery in Fog-Aided Networks with Dynamic Content Popularity
Authors:
Seyyed Mohammadreza Azimi,
Osvaldo Simeone,
Avik Sengupta,
Ravi Tandon
Abstract:
Fog Radio Access Network (F-RAN) architectures can leverage both cloud processing and edge caching for content delivery to the users. To this end, F-RAN utilizes caches at the edge nodes (ENs) and fronthaul links connecting a cloud processor to ENs. Assuming time-invariant content popularity, existing information-theoretic analyses of content delivery in F-RANs rely on offline caching with separat…
▽ More
Fog Radio Access Network (F-RAN) architectures can leverage both cloud processing and edge caching for content delivery to the users. To this end, F-RAN utilizes caches at the edge nodes (ENs) and fronthaul links connecting a cloud processor to ENs. Assuming time-invariant content popularity, existing information-theoretic analyses of content delivery in F-RANs rely on offline caching with separate content placement and delivery phases. In contrast, this work focuses on the scenario in which the set of popular content is time-varying, hence necessitating the online replenishment of the ENs' caches along with the delivery of the requested files. The analysis is centered on the characterization of the long-term Normalized Delivery Time (NDT), which captures the temporal dependence of the coding latencies accrued across multiple time slots in the high signal-to-noise ratio regime. Online edge caching and delivery schemes are investigated for both serial and pipelined transmission modes across fronthaul and edge segments. Analytical results demonstrate that, in the presence of a time-varying content popularity, the rate of fronthaul links sets a fundamental limit to the long-term NDT of F- RAN system. Analytical results are further verified by numerical simulation, yielding important design insights.
△ Less
Submitted 22 April, 2018; v1 submitted 28 November, 2017;
originally announced November 2017.
-
Advanced Steel Microstructural Classification by Deep Learning Methods
Authors:
Seyed Majid Azimi,
Dominik Britz,
Michael Engstler,
Mario Fritz,
Frank Mücklich
Abstract:
The inner structure of a material is called microstructure. It stores the genesis of a material and determines all its physical and chemical properties. While microstructural characterization is widely spread and well known, the microstructural classification is mostly done manually by human experts, which gives rise to uncertainties due to subjectivity. Since the microstructure could be a combina…
▽ More
The inner structure of a material is called microstructure. It stores the genesis of a material and determines all its physical and chemical properties. While microstructural characterization is widely spread and well known, the microstructural classification is mostly done manually by human experts, which gives rise to uncertainties due to subjectivity. Since the microstructure could be a combination of different phases or constituents with complex substructures its automatic classification is very challenging and only a few prior studies exist. Prior works focused on designed and engineered features by experts and classified microstructures separately from the feature extraction step. Recently, Deep Learning methods have shown strong performance in vision applications by learning the features from data together with the classification step. In this work, we propose a Deep Learning method for microstructural classification in the examples of certain microstructural constituents of low carbon steel. This novel method employs pixel-wise segmentation via Fully Convolutional Neural Networks (FCNN) accompanied by a max-voting scheme. Our system achieves 93.94% classification accuracy, drastically outperforming the state-of-the-art method of 48.89% accuracy. Beyond the strong performance of our method, this line of research offers a more robust and first of all objective way for the difficult task of steel quality appreciation.
△ Less
Submitted 15 February, 2018; v1 submitted 20 June, 2017;
originally announced June 2017.
-
A simple and efficient feedback control strategy for wastewater denitrification
Authors:
Cédric Join,
Jean Bernier,
Stéphane Mottelet,
Michel Fliess,
Sabrina Rechdaoui-Guérin,
Sam Azimi,
Vincent Rocher
Abstract:
Due to severe mathematical modeling and calibration difficulties open-loop feedforward control is mainly employed today for wastewater denitrification, which is a key ecological issue. In order to improve the resulting poor performances a new model-free control setting and its corresponding "intelligent" controller are introduced. The pitfall of regulating two output variables via a single input v…
▽ More
Due to severe mathematical modeling and calibration difficulties open-loop feedforward control is mainly employed today for wastewater denitrification, which is a key ecological issue. In order to improve the resulting poor performances a new model-free control setting and its corresponding "intelligent" controller are introduced. The pitfall of regulating two output variables via a single input variable is overcome by introducing also an open-loop knowledge-based control deduced from the plant behavior. Several convincing computer simulations are presented and discussed.
△ Less
Submitted 15 March, 2017;
originally announced March 2017.
-
Topology of pre-images under Anosov endomorphisms
Authors:
Mohammad saeed Azimi,
Khosro Tajbakhsh
Abstract:
For an endomorphism it is known that if all the points in the manifold have dense sets of pre-images then the dynamical system is transitive. The inverse has been shown for a residual set of points but the the exact inverse has not yet been investigated before. Here we are going to show that under some conditions it is true for Anosov endomorphisms on closed manifolds, by using the fact that Anoso…
▽ More
For an endomorphism it is known that if all the points in the manifold have dense sets of pre-images then the dynamical system is transitive. The inverse has been shown for a residual set of points but the the exact inverse has not yet been investigated before. Here we are going to show that under some conditions it is true for Anosov endomorphisms on closed manifolds, by using the fact that Anosov endomorphisms are covering maps.
△ Less
Submitted 16 May, 2017; v1 submitted 27 February, 2017;
originally announced February 2017.
-
Online Edge Caching in Fog-Aided Wireless Network
Authors:
Seyyed Mohammadreza Azimi,
Osvaldo Simeone,
Avik Sengupta,
Ravi Tandon
Abstract:
In a Fog Radio Access Network (F-RAN) architecture, edge nodes (ENs), such as base stations, are equipped with limited-capacity caches, as well as with fronthaul links that can support given transmission rates from a cloud processor. Existing information-theoretic analyses of content delivery in F-RANs have focused on offline caching with separate content placement and delivery phases. In contrast…
▽ More
In a Fog Radio Access Network (F-RAN) architecture, edge nodes (ENs), such as base stations, are equipped with limited-capacity caches, as well as with fronthaul links that can support given transmission rates from a cloud processor. Existing information-theoretic analyses of content delivery in F-RANs have focused on offline caching with separate content placement and delivery phases. In contrast, this work considers an online caching set-up, in which the set of popular files is time-varying and both cache replenishment and content delivery can take place in each time slot. The analysis is centered on the characterization of the long-term Normalized Delivery Time (NDT), which captures the temporal dependence of the coding latencies accrued across multiple time slots in the high signal-to- noise ratio regime. Online caching and delivery schemes based on reactive and proactive caching are investigated, and their performance is compared to optimal offline caching schemes both analytically and via numerical results.
△ Less
Submitted 3 December, 2017; v1 submitted 22 January, 2017;
originally announced January 2017.
-
To Fall Or Not To Fall: A Visual Approach to Physical Stability Prediction
Authors:
Wenbin Li,
Seyedmajid Azimi,
Aleš Leonardis,
Mario Fritz
Abstract:
Understanding physical phenomena is a key competence that enables humans and animals to act and interact under uncertain perception in previously unseen environments containing novel object and their configurations. Developmental psychology has shown that such skills are acquired by infants from observations at a very early stage.
In this paper, we contrast a more traditional approach of taking…
▽ More
Understanding physical phenomena is a key competence that enables humans and animals to act and interact under uncertain perception in previously unseen environments containing novel object and their configurations. Developmental psychology has shown that such skills are acquired by infants from observations at a very early stage.
In this paper, we contrast a more traditional approach of taking a model-based route with explicit 3D representations and physical simulation by an end-to-end approach that directly predicts stability and related quantities from appearance. We ask the question if and to what extent and quality such a skill can directly be acquired in a data-driven way bypassing the need for an explicit simulation.
We present a learning-based approach based on simulated data that predicts stability of towers comprised of wooden blocks under different conditions and quantities related to the potential fall of the towers. The evaluation is carried out on synthetic data and compared to human judgments on the same stimuli.
△ Less
Submitted 31 March, 2016;
originally announced April 2016.
-
Ultra-Reliable Cloud Mobile Computing with Service Composition and Superposition Coding
Authors:
Seyyed Mohammadreza Azimi,
Osvaldo Simeone,
Onur Sahin,
Petar Popovski
Abstract:
An emerging requirement for 5G systems is the ability to provide wireless ultra-reliable communication (URC) services with close-to-full availability for cloud-based applications. Among such applications, a prominent role is expected to be played by mobile cloud computing (MCC), that is, by the offloading of computationally intensive tasks from mobile devices to the cloud. MCC allows battery-limit…
▽ More
An emerging requirement for 5G systems is the ability to provide wireless ultra-reliable communication (URC) services with close-to-full availability for cloud-based applications. Among such applications, a prominent role is expected to be played by mobile cloud computing (MCC), that is, by the offloading of computationally intensive tasks from mobile devices to the cloud. MCC allows battery-limited devices to run sophisticated applications, such as for gaming or for the "tactile" internet. This paper proposes to apply the framework of reliable service composition to the problem of optimal task offloading in MCC over fading channels, with the aim of providing layered, or composable, services at differentiated reliability levels. Inter-layer optimization problems, encompassing offloading decisions and communication resources, are formulated and addressed by means of successive convex approximation methods. The numerical results demonstrate the energy savings that can be obtained by a joint allocation of computing and communication resources, as well as the advantages of layered coding at the physical layer and the impact of channel conditions on the offloading decisions.
△ Less
Submitted 15 January, 2016;
originally announced January 2016.