-
@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology
Authors:
Xin Jiang,
Junwei Zheng,
Ruiping Liu,
Jiahang Li,
Jiaming Zhang,
Sven Matthiesen,
Rainer Stiefelhagen
Abstract:
As Vision-Language Models (VLMs) advance, human-centered Assistive Technologies (ATs) for helping People with Visual Impairments (PVIs) are evolving into generalists, capable of performing multiple tasks simultaneously. However, benchmarking VLMs for ATs remains under-explored. To bridge this gap, we first create a novel AT benchmark (@Bench). Guided by a pre-design user study with PVIs, our bench…
▽ More
As Vision-Language Models (VLMs) advance, human-centered Assistive Technologies (ATs) for helping People with Visual Impairments (PVIs) are evolving into generalists, capable of performing multiple tasks simultaneously. However, benchmarking VLMs for ATs remains under-explored. To bridge this gap, we first create a novel AT benchmark (@Bench). Guided by a pre-design user study with PVIs, our benchmark includes the five most crucial vision-language tasks: Panoptic Segmentation, Depth Estimation, Optical Character Recognition (OCR), Image Captioning, and Visual Question Answering (VQA). Besides, we propose a novel AT model (@Model) that addresses all tasks simultaneously and can be expanded to more assistive functions for helping PVIs. Our framework exhibits outstanding performance across tasks by integrating multi-modal information, and it offers PVIs a more comprehensive assistance. Extensive experiments prove the effectiveness and generalizability of our framework.
△ Less
Submitted 21 September, 2024;
originally announced September 2024.
-
Human-machine Symbiosis: A Multivariate Perspective for Physically Coupled Human-machine Systems
Authors:
Jairo Inga,
Miriam Ruess,
Jan Heinrich Robens,
Thomas Nelius,
Sean Kille,
Philipp Dahlinger,
Roland Thomaschke,
Gerhard Neumann,
Sven Matthiesen,
Sören Hohmann,
Andrea Kiesel
Abstract:
The notion of symbiosis has been increasingly mentioned in research on physically coupled human-machine systems. Yet, a uniform specification on which aspects constitute human-machine symbiosis is missing. By combining the expertise of different disciplines, we elaborate on a multivariate perspective of symbiosis as the highest form of physically coupled human-machine systems. Four dimensions are…
▽ More
The notion of symbiosis has been increasingly mentioned in research on physically coupled human-machine systems. Yet, a uniform specification on which aspects constitute human-machine symbiosis is missing. By combining the expertise of different disciplines, we elaborate on a multivariate perspective of symbiosis as the highest form of physically coupled human-machine systems. Four dimensions are considered: Task, interaction, performance, and experience. First, human and machine work together to accomplish a common task conceptualized on both a decision and an action level (task dimension). Second, each partner possesses an internal representation of own as well as the other partner's intentions and influence on the environment. This alignment, which is the core of the interaction, constitutes the symbiotic understanding between both partners, being the basis of a joint, highly coordinated and effective action (interaction dimension). Third, the symbiotic interaction leads to synergetic effects regarding the intention recognition and complementary strengths of the partners, resulting in a higher overall performance (performance dimension). Fourth, symbiotic systems specifically change the user's experiences, like flow, acceptance, sense of agency, and embodiment (experience dimension). This multivariate perspective is flexible and generic and is also applicable in diverse human-machine scenarios, helping to bridge barriers between different disciplines.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
Classical and quasi-classical aspects of supersymmetric quantum mechanics
Authors:
Georg Junker,
Stephan Matthiesen,
Akira Inomata
Abstract:
A recent development of the studies on classical and quasi-classical properties of supersymmetric quantum mechanics in Witten's version is reviewed. First, classical mechanics of a supersymmetric system is considered. Solutions of the classical equations of motion are given and their properties are discussed in some detail. The corresponding quantum model is constructed by canonical quantization…
▽ More
A recent development of the studies on classical and quasi-classical properties of supersymmetric quantum mechanics in Witten's version is reviewed. First, classical mechanics of a supersymmetric system is considered. Solutions of the classical equations of motion are given and their properties are discussed in some detail. The corresponding quantum model is constructed by canonical quantization. The quantum model is analyzed by Feynman's path integral within a stationary-phase approximation. A quasi-classical quantization rule is derived, which is applicable when supersymmetry is exact or spontaneously broken.
△ Less
Submitted 31 October, 1995;
originally announced October 1995.
-
Supersymmetric classical mechanics
Authors:
Georg Junker,
Stephan Matthiesen
Abstract:
We study the classical properties of a supersymmetric system which is often used as a model for supersymmetric quantum mechanics. It is found that the classical dynamics of the bosonic as well as the fermionic degrees of freedom is fully described by a so--called quasi--classical solution. We also comment on the importance of this quasi--classical solution in the semi--classical treatment of the…
▽ More
We study the classical properties of a supersymmetric system which is often used as a model for supersymmetric quantum mechanics. It is found that the classical dynamics of the bosonic as well as the fermionic degrees of freedom is fully described by a so--called quasi--classical solution. We also comment on the importance of this quasi--classical solution in the semi--classical treatment of the supersymmetric quantum model.
△ Less
Submitted 23 August, 1994;
originally announced August 1994.
