-
Diversity-guided Search Exploration for Self-driving Cars Test Generation through Frenet Space Encoding
Authors:
Timo Blattner,
Christian Birchler,
Timo Kehrer,
Sebastiano Panichella
Abstract:
The rise of self-driving cars (SDCs) presents important safety challenges to address in dynamic environments. While field testing is essential, current methods lack diversity in assessing critical SDC scenarios. Prior research introduced simulation-based testing for SDCs, with Frenetic, a test generation approach based on Frenet space encoding, achieving a relatively high percentage of valid tests…
▽ More
The rise of self-driving cars (SDCs) presents important safety challenges to address in dynamic environments. While field testing is essential, current methods lack diversity in assessing critical SDC scenarios. Prior research introduced simulation-based testing for SDCs, with Frenetic, a test generation approach based on Frenet space encoding, achieving a relatively high percentage of valid tests (approximately 50%) characterized by naturally smooth curves. The "minimal out-of-bound distance" is often taken as a fitness function, which we argue to be a sub-optimal metric. Instead, we show that the likelihood of leading to an out-of-bound condition can be learned by the deep-learning vanilla transformer model. We combine this "inherently learned metric" with a genetic algorithm, which has been shown to produce a high diversity of tests. To validate our approach, we conducted a large-scale empirical evaluation on a dataset comprising over 1,174 simulated test cases created to challenge the SDCs behavior. Our investigation revealed that our approach demonstrates a substantial reduction in generating non-valid test cases, increased diversity, and high accuracy in identifying safety violations during SDC test execution.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
Multiscale cortical morphometry reveals pronounced regional and scale-dependent variations across the lifespan
Authors:
Karoline Leiberg,
Timo Blattner,
Bethany Little,
Victor B. B. Mello,
Fernanda H. P. de Moraes,
Christian Rummel,
Peter N. Taylor,
Bruno Mota,
Yujiang Wang
Abstract:
Motivation: Characterising the changes in cortical morphology across the lifespan is fundamental for a range of research and clinical applications. Most studies to date have found a monotonic decrease in commonly used morphometrics, such as cortical thickness and volume, across the entire brain with increasing age. Any regional variations reported are subtle changes in the rate of decrease. Howeve…
▽ More
Motivation: Characterising the changes in cortical morphology across the lifespan is fundamental for a range of research and clinical applications. Most studies to date have found a monotonic decrease in commonly used morphometrics, such as cortical thickness and volume, across the entire brain with increasing age. Any regional variations reported are subtle changes in the rate of decrease. However, these descriptions of morphological changes have been limited to a single length scale, or resolution. Here, we delineate the morphological changes associated with the healthy lifespan in multiscale morphometrics.
Methods: Using MRI from subjects aged 6-88 years from NKI and CamCAN, we computed morphometrics at spatial scales ranging from 0.32 mm to 3 mm. We used generalised additive mixed models to account for site differences when extracting age trajectories. In a proof-of-principle application, we compared brain age estimations based on a single metric (pial surface area) computed at a single scale vs. multiple scales.
Results: On the level of whole cortical hemispheres, lifespan trajectories show diverging and even opposing trends at different spatial scales, in contrast to the monotonic decreases of volume and thickness described so far. Pronounced regional differences between lobes also became apparent in scales over 0.7 mm. Using two complementary scales improved brain age estimates in RMSE by about 5 years.
Conclusion: Our study provides a comprehensive multiscale description of lifespan effects on cortical morphology in an age range from 6-88 years. In future, this can be used as a normative model to compare individuals or cohorts, hence identifying morphological abnormalities. Our results reveal the complementary information contained in different spatial scales, suggesting that morphometrics should not be considered mere scalars, but functions of length scale.
△ Less
Submitted 7 February, 2024; v1 submitted 22 November, 2023;
originally announced November 2023.
-
AI Model Utilization Measurements For Finding Class Encoding Patterns
Authors:
Peter Bajcsy,
Antonio Cardone,
Chenyi Ling,
Philippe Dessauw,
Michael Majurski,
Tim Blattner,
Derek Juba,
Walid Keyrouz
Abstract:
This work addresses the problems of (a) designing utilization measurements of trained artificial intelligence (AI) models and (b) explaining how training data are encoded in AI models based on those measurements. The problems are motivated by the lack of explainability of AI models in security and safety critical applications, such as the use of AI models for classification of traffic signs in sel…
▽ More
This work addresses the problems of (a) designing utilization measurements of trained artificial intelligence (AI) models and (b) explaining how training data are encoded in AI models based on those measurements. The problems are motivated by the lack of explainability of AI models in security and safety critical applications, such as the use of AI models for classification of traffic signs in self-driving cars. We approach the problems by introducing theoretical underpinnings of AI model utilization measurement and understanding patterns in utilization-based class encodings of traffic signs at the level of computation graphs (AI models), subgraphs, and graph nodes. Conceptually, utilization is defined at each graph node (computation unit) of an AI model based on the number and distribution of unique outputs in the space of all possible outputs (tensor-states). In this work, utilization measurements are extracted from AI models, which include poisoned and clean AI models. In contrast to clean AI models, the poisoned AI models were trained with traffic sign images containing systematic, physically realizable, traffic sign modifications (i.e., triggers) to change a correct class label to another label in a presence of such a trigger. We analyze class encodings of such clean and poisoned AI models, and conclude with implications for trojan injection and detection.
△ Less
Submitted 11 December, 2022;
originally announced December 2022.
