Showing 1–50 of 98 results for author: Utschick, W

Low Complexity Rate Splitting Approach in RIS-Aided Systems Based on Channel Statistics

Authors: Sadaf Syed, Michael Joham, Wolfgang Utschick

Abstract: Rate splitting multiple access (RSMA) and reconfigurable intelligent surface (RIS) are two prospective technologies for improving the spectral and energy efficiency in future wireless communication systems. In this work, we investigate a rate splitting (RS) technique for an RIS-aided system in the presence of only statistical channel knowledge. We propose an algorithm with a quasi closed-form solu… ▽ More Rate splitting multiple access (RSMA) and reconfigurable intelligent surface (RIS) are two prospective technologies for improving the spectral and energy efficiency in future wireless communication systems. In this work, we investigate a rate splitting (RS) technique for an RIS-aided system in the presence of only statistical channel knowledge. We propose an algorithm with a quasi closed-form solution based only on the second-order channel statistics, which reduces the design complexity of the system as it does not require estimation of the channel state information (CSI) and optimisation of the precoding filters and phase shifts of the RIS in every channel coherence interval. △ Less

Submitted 16 October, 2024; originally announced October 2024.

Comments: 5 pages

Addressing Pilot Contamination in Channel Estimation with Variational Autoencoders

Authors: Amar Kasibovic, Benedikt Fesl, Michael Baur, Wolfgang Utschick

Abstract: Pilot contamination (PC) is a well-known problem that affects massive multiple-input multiple-output (MIMO) systems. When frequency and pilots are reused between different cells, PC constitutes one of the main bottlenecks of the system's performance. In this paper, we propose a method based on the variational autoencoder (VAE), capable of reducing the impact of PC-related interference during chann… ▽ More Pilot contamination (PC) is a well-known problem that affects massive multiple-input multiple-output (MIMO) systems. When frequency and pilots are reused between different cells, PC constitutes one of the main bottlenecks of the system's performance. In this paper, we propose a method based on the variational autoencoder (VAE), capable of reducing the impact of PC-related interference during channel estimation (CE). We obtain the first and second-order statistics of the conditionally Gaussian (CG) channels for both the user equipments (UEs) in a cell of interest and those in interfering cells, and we then use these moments to compute conditional linear minimum mean square error estimates. We show that the proposed estimator is capable of exploiting the interferers' additional statistical knowledge, outperforming other classical approaches. Moreover, we highlight how the achievable performance is tied to the chosen setup, making the setup selection crucial in the study of multi-cell CE. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Comments: 5 pages, 3 figures, submitted to ICASSP 2025

Nonlinear Precoding in the RIS-Aided MIMO Broadcast Channel

Authors: Dominik Semmler, Michael Joham, Wolfgang Utschick

Abstract: We propose to use Tomlinson-Harashima Precoding (THP) for the reconfigurable intelligent surface (RIS)-aided multiple-input multiple-output (MIMO) broadcast channel where we assume a line of sight (LOS) connection between the base station (BS) and the RIS. In this scenario, nonlinear precoding, like THP or dirty paper coding (DPC), has certain advantages compared to linear precoding as it is more… ▽ More We propose to use Tomlinson-Harashima Precoding (THP) for the reconfigurable intelligent surface (RIS)-aided multiple-input multiple-output (MIMO) broadcast channel where we assume a line of sight (LOS) connection between the base station (BS) and the RIS. In this scenario, nonlinear precoding, like THP or dirty paper coding (DPC), has certain advantages compared to linear precoding as it is more robust in case the BS-RIS channel is not orthogonal to the direct channel. Additionally, THP and DPC allow a simple phase shift optimization which is in strong contrast to linear precoding for which the solution is quite intricate. Besides being difficult to optimize, it can be shown that linear precoding has fundamental limitations for statistical and random phase shifts which do not hold for nonlinear precoding. Moreover, we show that the advantages of THP/DPC are especially pronounced for discrete phase shifts. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Feedback Design with VQ-VAE for Robust Precoding in Multi-User FDD Systems

Authors: Nurettin Turan, Michael Baur, Jianqing Li, Wolfgang Utschick

Abstract: In this letter, we propose a vector quantized-variational autoencoder (VQ-VAE)-based feedback scheme for robust precoder design in multi-user frequency division duplex (FDD) systems. We demonstrate how the VQ-VAE can be tailored to specific propagation environments, focusing on systems with low pilot overhead, which is crucial in massive multiple-input multiple-output (MIMO). Extensive simulations… ▽ More In this letter, we propose a vector quantized-variational autoencoder (VQ-VAE)-based feedback scheme for robust precoder design in multi-user frequency division duplex (FDD) systems. We demonstrate how the VQ-VAE can be tailored to specific propagation environments, focusing on systems with low pilot overhead, which is crucial in massive multiple-input multiple-output (MIMO). Extensive simulations with real-world measurement data show that our proposed feedback scheme outperforms state-of-the-art autoencoder (AE)-based compression schemes and conventional Discrete Fourier transform (DFT) codebook-based schemes. These improvements enable the deployment of systems with fewer feedback bits or pilots. △ Less

Submitted 8 August, 2024; originally announced August 2024.

A Versatile Pilot Design Scheme for FDD Systems Utilizing Gaussian Mixture Models

Authors: Nurettin Turan, Benedikt Böck, Benedikt Fesl, Michael Joham, Deniz Gündüz, Wolfgang Utschick

Abstract: In this work, we propose a Gaussian mixture model (GMM)-based pilot design scheme for downlink (DL) channel estimation in single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. In an initial offline phase, the GMM captures prior information during training, which is then utilized for pilot design. In the single-user case, the GMM is utilized to constr… ▽ More In this work, we propose a Gaussian mixture model (GMM)-based pilot design scheme for downlink (DL) channel estimation in single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. In an initial offline phase, the GMM captures prior information during training, which is then utilized for pilot design. In the single-user case, the GMM is utilized to construct a codebook of pilot matrices and, once shared with the mobile terminal (MT), can be employed to determine a feedback index at the MT. This index selects a pilot matrix from the constructed codebook, eliminating the need for online pilot optimization. We further establish a sum conditional mutual information (CMI)-based pilot optimization framework for multi-user MIMO (MU-MIMO) systems. Based on the established framework, we utilize the GMM for pilot matrix design in MU-MIMO systems. The analytic representation of the GMM enables the adaptation to any signal-to-noise ratio (SNR) level and pilot configuration without re-training. Additionally, an adaption to any number of MTs is facilitated. Extensive simulations demonstrate the superior performance of the proposed pilot design scheme compared to state-of-the-art approaches. The performance gains can be exploited, e.g., to deploy systems with fewer pilots. △ Less

Submitted 7 August, 2024; originally announced August 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2403.17577

Evaluation Metrics and Methods for Generative Models in the Wireless PHY Layer

Authors: Michael Baur, Nurettin Turan, Simon Wallner, Wolfgang Utschick

Abstract: Generative models are typically evaluated by direct inspection of their generated samples, e.g., by visual inspection in the case of images. Further evaluation metrics like the Fréchet inception distance or maximum mean discrepancy are intricate to interpret and lack physical motivation. These observations make evaluating generative models in the wireless PHY layer non-trivial. This work establish… ▽ More Generative models are typically evaluated by direct inspection of their generated samples, e.g., by visual inspection in the case of images. Further evaluation metrics like the Fréchet inception distance or maximum mean discrepancy are intricate to interpret and lack physical motivation. These observations make evaluating generative models in the wireless PHY layer non-trivial. This work establishes a framework consisting of evaluation metrics and methods for generative models applied to the wireless PHY layer. The proposed metrics and methods are motivated by wireless applications, facilitating interpretation and understandability for the wireless community. In particular, we propose a spectral efficiency analysis for validating the generated channel norms and a codebook fingerprinting method to validate the generated channel directions. Moreover, we propose an application cross-check to evaluate the generative model's samples for training machine learning-based models in relevant downstream tasks. Our analysis is based on real-world measurement data and includes the Gaussian mixture model, variational autoencoder, diffusion model, and generative adversarial network as generative models. Our results under a fair comparison in terms of model architecture indicate that solely relying on metrics like the maximum mean discrepancy produces insufficient evaluation outcomes. In contrast, the proposed metrics and methods exhibit consistent and explainable behavior. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Comments: 12 pages, 9 figures

Linear and Nonlinear MMSE Estimation in One-Bit Quantized Systems under a Gaussian Mixture Prior

Authors: Benedikt Fesl, Wolfgang Utschick

Abstract: We present new fundamental results for the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems for a Gaussian mixture model (GMM) distributed signal of interest, possibly corrupted by additive white Gaussian noise (AWGN). We first derive novel closed-form analytic expressions for the Bussgang estimator, the well-known linear minimum mean square error (MMSE… ▽ More We present new fundamental results for the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems for a Gaussian mixture model (GMM) distributed signal of interest, possibly corrupted by additive white Gaussian noise (AWGN). We first derive novel closed-form analytic expressions for the Bussgang estimator, the well-known linear minimum mean square error (MMSE) estimator in quantized systems. Afterward, closed-form analytic expressions for the CME in special cases are presented, revealing that the optimal estimator is linear in the one-bit quantized observation, opposite to higher resolution cases. Through a comparison to the recently studied Gaussian case, we establish a novel MSE inequality and show that that the signal of interest is correlated with the auxiliary quantization noise. We extend our analysis to multiple observation scenarios, examining the MSE-optimal transmit sequence and conducting an asymptotic analysis, yielding analytic expressions for the MSE and its limit. These contributions have broad impact for the analysis and design of various signal processing applications. △ Less

Submitted 1 July, 2024; originally announced July 2024.

A Statistical Characterization of Wireless Channels Conditioned on Side Information

Authors: Benedikt Böck, Michael Baur, Nurettin Turan, Dominik Semmler, Wolfgang Utschick

Abstract: Statistical prior channel knowledge, such as the wide-sense-stationary-uncorrelated-scattering (WSSUS) property, and additional side information both can be used to enhance physical layer applications in wireless communication. Generally, the wireless channel's strongly fluctuating path phases and WSSUS property characterize the channel by a zero mean and Toeplitz-structured covariance matrices in… ▽ More Statistical prior channel knowledge, such as the wide-sense-stationary-uncorrelated-scattering (WSSUS) property, and additional side information both can be used to enhance physical layer applications in wireless communication. Generally, the wireless channel's strongly fluctuating path phases and WSSUS property characterize the channel by a zero mean and Toeplitz-structured covariance matrices in different domains. In this work, we derive a framework to comprehensively categorize side information based on whether it preserves or abandons these statistical features conditioned on the given side information. To accomplish this, we combine insights from a generic channel model with the representation of wireless channels as probabilistic graphs. Additionally, we exemplify several applications, ranging from channel modeling to estimation and clustering, which demonstrate how the proposed framework can practically enhance physical layer methods utilizing machine learning (ML). △ Less

Submitted 6 June, 2024; originally announced June 2024.

High-SNR Comparison of Linear Precoding and DPC in RIS-Aided MIMO Broadcast Channels

Authors: Dominik Semmler, Benedikt Fesl, Michael Joham, Wolfgang Utschick

Abstract: We compare dirty paper coding (DPC) and linear precoding methods in a reconfigurable intelligent surface (RIS)- aided high-signal-to-noise ratio (SNR) scenario, where the channel between the base station (BS) and the RIS is dominated by a line-of-sight (LOS) component. Furthermore, we consider two groups of users where one group can be efficiently served by the BS, whereas the other one has a negl… ▽ More We compare dirty paper coding (DPC) and linear precoding methods in a reconfigurable intelligent surface (RIS)- aided high-signal-to-noise ratio (SNR) scenario, where the channel between the base station (BS) and the RIS is dominated by a line-of-sight (LOS) component. Furthermore, we consider two groups of users where one group can be efficiently served by the BS, whereas the other one has a negligible direct channel and has to be served via the RIS. Within this scenario, we analytically show fundamental differences between DPC and linear methods. In particular, our analysis addresses two essential aspects, i.e., the orthogonality of the BS-RIS channel with the direct channel and a channel mitigation term, depending on the number of RIS elements, that is present only for linear precoding techniques. The mitigation term generally leads to strong limitations for the linear method, especially for random or statistical phase shifts. Moreover, we discuss under which circumstances this mitigation term is negligible and in which scenarios DPC and linear precoding lead to the same performance. △ Less

Submitted 6 August, 2024; v1 submitted 29 May, 2024; originally announced May 2024.

Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Models

Authors: Marion Neumeier, Sebastian Dorn, Michael Botsch, Wolfgang Utschick

Abstract: This work introduces the conditioned Vehicle Motion Diffusion (cVMD) model, a novel network architecture for highway trajectory prediction using diffusion models. The proposed model ensures the drivability of the predicted trajectory by integrating non-holonomic motion constraints and physical constraints into the generative prediction module. Central to the architecture of cVMD is its capacity to… ▽ More This work introduces the conditioned Vehicle Motion Diffusion (cVMD) model, a novel network architecture for highway trajectory prediction using diffusion models. The proposed model ensures the drivability of the predicted trajectory by integrating non-holonomic motion constraints and physical constraints into the generative prediction module. Central to the architecture of cVMD is its capacity to perform uncertainty quantification, a feature that is crucial in safety-critical applications. By integrating the quantified uncertainty into the prediction process, the cVMD's trajectory prediction performance is improved considerably. The model's performance was evaluated using the publicly available highD dataset. Experiments show that the proposed architecture achieves competitive trajectory prediction accuracy compared to state-of-the-art models, while providing guaranteed drivable trajectories and uncertainty quantification. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Comments: Accepted at IEEE/CVF Computer Vision and Pattern Recognition Conference Workshops (CVPRW) 2024

Design of a Multi-User RIS-Aided System with Statistical Channel Knowledge

Authors: Sadaf Syed, Dominik Semmler, Donia Ben Amor, Michael Joham, Wolfgang Utschick

Abstract: Reconfigurable intelligent surface (RIS) is a promising technology to enhance the spectral and energy efficiency in a wireless communication system. The design of the phase shifts of an RIS in every channel coherence interval demands a huge training overhead, making its deployment practically infeasible. The design complexity can be significantly reduced by exploiting the second-order statistics o… ▽ More Reconfigurable intelligent surface (RIS) is a promising technology to enhance the spectral and energy efficiency in a wireless communication system. The design of the phase shifts of an RIS in every channel coherence interval demands a huge training overhead, making its deployment practically infeasible. The design complexity can be significantly reduced by exploiting the second-order statistics of the channels. This paper is the extension of our previous work to the design of an RIS for the multi-user setup, where we employ maximisation of the lower bound of the achievable sum-rate of the users. Unlike for the single-user case, obtaining a closed-form expression for the update of the filters and phase shifts is more challenging in the multi-user case. We resort to the fractional programming (FP) approach and the non-convex block coordinate descent (BCD) method to solve the optimisation problem. As the phase shifts of the RIS obtained by the proposed algorithms are based on the statistical channel knowledge, they do not need to be updated in every channel coherence interval. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Enhancing Channel Estimation in Quantized Systems with a Generative Prior

Authors: Benedikt Fesl, Aziz Banna, Wolfgang Utschick

Abstract: Channel estimation in quantized systems is challenging, particularly in low-resolution systems. In this work, we propose to leverage a Gaussian mixture model (GMM) as generative prior, capturing the channel distribution of the propagation environment, to enhance a classical estimation technique based on the expectation-maximization (EM) algorithm for one-bit quantization. Thereby, a maximum a post… ▽ More Channel estimation in quantized systems is challenging, particularly in low-resolution systems. In this work, we propose to leverage a Gaussian mixture model (GMM) as generative prior, capturing the channel distribution of the propagation environment, to enhance a classical estimation technique based on the expectation-maximization (EM) algorithm for one-bit quantization. Thereby, a maximum a posteriori (MAP) estimate of the most responsible mixture component is inferred for a quantized received signal, which is subsequently utilized in the EM algorithm as side information. Numerical results demonstrate the significant performance improvement of our proposed approach over both a simplistic Gaussian prior and current state-of-the-art channel estimators. Furthermore, the proposed estimation framework exhibits adaptability to higher resolution systems and alternative generative priors. △ Less

Submitted 26 April, 2024; originally announced May 2024.

Channel-Adaptive Pilot Design for FDD-MIMO Systems Utilizing Gaussian Mixture Models

Authors: Nurettin Turan, Benedikt Fesl, Benedikt Böck, Michael Joham, Wolfgang Utschick

Abstract: In this work, we propose to utilize Gaussian mixture models (GMMs) to design pilots for downlink (DL) channel estimation in frequency division duplex (FDD) systems. The GMM captures prior information during training that is leveraged to design a codebook of pilot matrices in an initial offline phase. Once shared with the mobile terminal (MT), the GMM is utilized to determine a feedback index at th… ▽ More In this work, we propose to utilize Gaussian mixture models (GMMs) to design pilots for downlink (DL) channel estimation in frequency division duplex (FDD) systems. The GMM captures prior information during training that is leveraged to design a codebook of pilot matrices in an initial offline phase. Once shared with the mobile terminal (MT), the GMM is utilized to determine a feedback index at the MT in the online phase. This index selects a pilot matrix from a codebook, eliminating the need for online pilot optimization. The GMM is further used for DL channel estimation at the MT via observation-dependent linear minimum mean square error (LMMSE) filters, parametrized by the GMM. The analytic representation of the GMM allows adaptation to any signal-to-noise ratio (SNR) level and pilot configuration without re-training. With extensive simulations, we demonstrate the superior performance of the proposed GMM-based pilot scheme compared to state-of-the-art approaches. △ Less

Submitted 26 March, 2024; originally announced March 2024.

An Efficient Rate Splitting Precoding Approach in Multi-User MISO FDD Systems

Authors: Donia Ben Amor, Michael Joham, Wolfgang Utschick

Abstract: In this work, we develop an efficient precoding strategy for a multi-user multiple-input-single output (MU MISO) system operating in frequency-division-duplex (FDD) mode, where rate splitting multiple access (RSMA) is implemented. To this end, we consider one-layer RS and show its significant impact on the system performance, specifically in the case where the channel state information (CSI) is in… ▽ More In this work, we develop an efficient precoding strategy for a multi-user multiple-input-single output (MU MISO) system operating in frequency-division-duplex (FDD) mode, where rate splitting multiple access (RSMA) is implemented. To this end, we consider one-layer RS and show its significant impact on the system performance, specifically in the case where the channel state information (CSI) is incomplete at the transmitter. Based on a lower bound on the achievable rate that takes into account the CSI errors, we establish an augmented weighted average mean squared error (AWAMSE) algorithm for the RS setup denoted by AWAMSE-RS, where even the updates for the common and the private precoders are computed via analytical expressions, hence circumventing the need for interior-point methods. Simulation results validate the efficiency of our approach in terms of computational time and its competitiveness in terms of the achievable system throughput compared to state-of-the-art methods and non-RS setups. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Diffusion-based Generative Prior for Low-Complexity MIMO Channel Estimation

Authors: Benedikt Fesl, Michael Baur, Florian Strasser, Michael Joham, Wolfgang Utschick

Abstract: This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural network (CNN) with positional embedding of the signal-to-noise ratio (SNR) information is designed by learning the channel distribution in the sparse angular domain. Combined with an… ▽ More This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural network (CNN) with positional embedding of the signal-to-noise ratio (SNR) information is designed by learning the channel distribution in the sparse angular domain. Combined with an estimation strategy that avoids stochastic resampling and truncates reverse diffusion steps that account for lower SNR than the given pilot observation, the resulting DM estimator has both low complexity and memory overhead. Numerical results exhibit better performance than state-of-the-art channel estimators utilizing generative priors. △ Less

Submitted 6 March, 2024; originally announced March 2024.

On the Asymptotic Mean Square Error Optimality of Diffusion Models

Authors: Benedikt Fesl, Benedikt Böck, Florian Strasser, Michael Baur, Michael Joham, Wolfgang Utschick

Abstract: Diffusion models (DMs) as generative priors have recently shown great potential for denoising tasks but lack theoretical understanding with respect to their mean square error (MSE) optimality. This paper proposes a novel denoising strategy inspired by the structure of the MSE-optimal conditional mean estimator (CME). The resulting DM-based denoiser can be conveniently employed using a pre-trained… ▽ More Diffusion models (DMs) as generative priors have recently shown great potential for denoising tasks but lack theoretical understanding with respect to their mean square error (MSE) optimality. This paper proposes a novel denoising strategy inspired by the structure of the MSE-optimal conditional mean estimator (CME). The resulting DM-based denoiser can be conveniently employed using a pre-trained DM, being particularly fast by truncating reverse diffusion steps and not requiring stochastic re-sampling. We present a comprehensive (non-)asymptotic optimality analysis of the proposed diffusion-based denoiser, demonstrating polynomial-time convergence to the CME under mild conditions. Our analysis also derives a novel Lipschitz constant that depends solely on the DM's hyperparameters. Further, we offer a new perspective on DMs, showing that they inherently combine an asymptotically optimal denoiser with a powerful generator, modifiable by switching re-sampling in the reverse process on or off. The theoretical findings are thoroughly validated with experiments based on various benchmark datasets. △ Less

Submitted 23 May, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Performance Analysis of Systems with Coupled and Decoupled RISs

Authors: Dominik Semmler, Josef A. Nossek, Michael Joham, Wolfgang Utschick

Abstract: We analyze and compare different methods for handling the mutual coupling in RIS-aided communication systems. A new mutual coupling aware algorithm is derived where the reactance of each element is updated successively with a closed-form solution. In comparison to existing element-wise methods, this approach leads to a considerably reduced computational complexity. Furthermore, we introduce decoup… ▽ More We analyze and compare different methods for handling the mutual coupling in RIS-aided communication systems. A new mutual coupling aware algorithm is derived where the reactance of each element is updated successively with a closed-form solution. In comparison to existing element-wise methods, this approach leads to a considerably reduced computational complexity. Furthermore, we introduce decoupling networks for the RIS array as a potential solution for handling mutual coupling. With these networks, the system model reduces to the same structure as when no mutual coupling were present. Including decoupling networks, we can optimize the channel gain of a RIS-aided SISO system in closed-form which allows to analyze the scenario under mutual coupling analytically and to draw connections to the conventional transmit array gain. In particular, a super-quadratic channel gain can be achieved which scales as N^4 where N is the number of RIS elements. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Wireless Channel Prediction via Gaussian Mixture Models

Authors: Nurettin Turan, Benedikt Böck, Kai Jie Chan, Benedikt Fesl, Friedrich Burmeister, Michael Joham, Gerhard Fettweis, Wolfgang Utschick

Abstract: In this work, we utilize a Gaussian mixture model (GMM) to capture the underlying probability density function (PDF) of the channel trajectories of moving mobile terminals (MTs) within the coverage area of a base station (BS) in an offline phase. We propose to leverage the same GMM for channel prediction in the online phase. Our proposed approach does not require signal-to-noise ratio (SNR)-specif… ▽ More In this work, we utilize a Gaussian mixture model (GMM) to capture the underlying probability density function (PDF) of the channel trajectories of moving mobile terminals (MTs) within the coverage area of a base station (BS) in an offline phase. We propose to leverage the same GMM for channel prediction in the online phase. Our proposed approach does not require signal-to-noise ratio (SNR)-specific training and allows for parallelization. Numerical simulations for both synthetic and measured channel data demonstrate the effectiveness of our proposed GMM-based channel predictor compared to state-ofthe-art channel prediction methods. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Alternating Minimization for Wideband Multiuser IRS-aided MIMO Systems under Imperfect CSI

Authors: Darian Pérez-Adán, Michael Joham, Óscar Fresnedo, José P. González-Coma, Luis Castedo, Wolfgang Utschick

Abstract: This work focuses on wideband intelligent reflecting surface (IRS)-aided multiuser MIMO systems. One of the major challenges of this scenario is the joint design of the frequency-dependent base station (BS) precoder and user filters, and the IRS phase-shift matrix which is frequency flat and common to all the users. In addition, we consider that the channel state information (CSI) is imperfect at… ▽ More This work focuses on wideband intelligent reflecting surface (IRS)-aided multiuser MIMO systems. One of the major challenges of this scenario is the joint design of the frequency-dependent base station (BS) precoder and user filters, and the IRS phase-shift matrix which is frequency flat and common to all the users. In addition, we consider that the channel state information (CSI) is imperfect at both the transmitter and the receivers. A statistical model for the imperfect CSI is developed and exploited for the system design. A minimum mean square error (MMSE) approach is followed to determine the IRS phase-shift matrix, the transmit precoders, and the receiving filters. The broadcast (BC)- multiple access channel (MAC) duality is used to solve the optimization problem following an alternating minimization approach. Numerical results show that the proposed approach leads to substantial performance gains with respect to baseline strategies that neglect the inter-user interference and do not optimize the IRS phase-shift matrix. Further performance gains are obtained when incorporating into the system design the statistical information of the channel estimation errors. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Journal ref: IEEE Transactions on Signal Processing, vol. 72, pp. 99-114, 2024

Limited Feedback on Measurements: Sharing a Codebook or a Generative Model?

Authors: Nurettin Turan, Benedikt Fesl, Michael Joham, Zhengxiang Ma, Anthony C. K. Soong, Baoling Sheen, Weimin Xiao, Wolfgang Utschick

Abstract: Discrete Fourier transform (DFT) codebook-based solutions are well-established for limited feedback schemes in frequency division duplex (FDD) systems. In recent years, data-aided solutions have been shown to achieve higher performance, enabled by the adaptivity of the feedback scheme to the propagation environment of the base station (BS) cell. In particular, a versatile limited feedback scheme u… ▽ More Discrete Fourier transform (DFT) codebook-based solutions are well-established for limited feedback schemes in frequency division duplex (FDD) systems. In recent years, data-aided solutions have been shown to achieve higher performance, enabled by the adaptivity of the feedback scheme to the propagation environment of the base station (BS) cell. In particular, a versatile limited feedback scheme utilizing Gaussian mixture models (GMMs) was recently introduced. The scheme supports multi-user communications, exhibits low complexity, supports parallelization, and offers significant flexibility concerning various system parameters. Conceptually, a GMM captures environment knowledge and is subsequently transferred to the mobile terminals (MTs) for online inference of feedback information. Afterward, the BS designs precoders using either directional information or a generative modeling-based approach. A major shortcoming of recent works is that the assessed system performance is only evaluated through synthetic simulation data that is generally unable to fully characterize the features of real-world environments. It raises the question of how the GMM-based feedback scheme performs on real-world measurement data, especially compared to the well-established DFT-based solution. Our experiments reveal that the GMM-based feedback scheme tremendously improves the system performance measured in terms of sum-rate, allowing to deploy systems with fewer pilots or feedback bits. △ Less

Submitted 3 January, 2024; originally announced January 2024.

DoA-Aided MMSE Channel Estimation for Wireless Communication Systems

Authors: Franz Weißer, Nurettin Turan, Wolfgang Utschick

Abstract: This paper investigates the combination of parametric channel estimation with minimum mean square error (MMSE) estimation. We propose a direction-of-arrival (DoA)-aided two-stage channel estimation technique that utilizes the decomposition of wireless communication channels into a line-of-sight (LoS) path and its orthogonal subspace. After estimating the channel along the dominant direction, we ut… ▽ More This paper investigates the combination of parametric channel estimation with minimum mean square error (MMSE) estimation. We propose a direction-of-arrival (DoA)-aided two-stage channel estimation technique that utilizes the decomposition of wireless communication channels into a line-of-sight (LoS) path and its orthogonal subspace. After estimating the channel along the dominant direction, we utilize a Gaussian mixture model to estimate the conditionally Gaussian distributed random vector, which represents the multipath propagation. The proposed two-stage estimator allows pre-computing the respective estimation filters, tremendously reducing the computational complexity. Numerical simulations with typical channel models depict the superior performance of our proposed two-stage estimation approach compared to state-of-the-art methods. △ Less

Submitted 26 April, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

Comments: Submitted to IEEE for possible publication

Variational Autoencoder for Channel Estimation: Real-World Measurement Insights

Authors: Michael Baur, Benedikt Böck, Nurettin Turan, Wolfgang Utschick

Abstract: This work utilizes a variational autoencoder for channel estimation and evaluates it on real-world measurements. The estimator is trained solely on noisy channel observations and parameterizes an approximation to the mean squared error-optimal estimator by learning observation-dependent conditional first and second moments. The proposed estimator significantly outperforms related state-of-the-art… ▽ More This work utilizes a variational autoencoder for channel estimation and evaluates it on real-world measurements. The estimator is trained solely on noisy channel observations and parameterizes an approximation to the mean squared error-optimal estimator by learning observation-dependent conditional first and second moments. The proposed estimator significantly outperforms related state-of-the-art estimators on real-world measurements. We investigate the effect of pre-training with synthetic data and find that the proposed estimator exhibits comparable results to the related estimators if trained on synthetic data and evaluated on the measurement data. Furthermore, pre-training on synthetic data also helps to reduce the required measurement training dataset size. △ Less

Submitted 8 February, 2024; v1 submitted 6 December, 2023; originally announced December 2023.

Comments: 6 pages, 6 figures, accepted at WSA 2024

Highly Accelerated Weighted MMSE Algorithms for Designing Precoders in FDD Systems with Incomplete CSI

Authors: Donia Ben Amor, Michael Joham, Wolfgang Utschick

Abstract: In this work, we derive a lower bound on the training-based achievable downlink (DL) sum rate (SR) of a multi-user multiple-input-single-output (MISO) system operating in frequency-division-duplex (FDD) mode. Assuming linear minimum mean square error (LMMSE) channel estimation is used, we establish a connection of the derived lower bound on the signal-to-interference-noise-ratio (SINR) to an avera… ▽ More In this work, we derive a lower bound on the training-based achievable downlink (DL) sum rate (SR) of a multi-user multiple-input-single-output (MISO) system operating in frequency-division-duplex (FDD) mode. Assuming linear minimum mean square error (LMMSE) channel estimation is used, we establish a connection of the derived lower bound on the signal-to-interference-noise-ratio (SINR) to an average MSE that allows to reformulate the SR maximization problem as the minimization of the augmented weighted average MSE (AWAMSE). We propose an iterative precoder design with three alternating steps, all given in closed form, drastically reducing the computation time. We show numerically the effectiveness of the proposed approach in challenging scenarios with limited channel knowledge, i.e., we consider scenarios with a very limited number of pilots. We additionally propose a more efficient version of the well-known stochastic iterative WMMSE (SIWMMSE) approach, where the precoder update is given in closed form. △ Less

Submitted 4 December, 2023; originally announced December 2023.

Gohberg-Semencul Estimation of Toeplitz Structured Covariance Matrices and Their Inverses

Authors: Benedikt Böck, Dominik Semmler, Benedikt Fesl, Michael Baur, Wolfgang Utschick

Abstract: When only few data samples are accessible, utilizing structural prior knowledge is essential for estimating covariance matrices and their inverses. One prominent example is knowing the covariance matrix to be Toeplitz structured, which occurs when dealing with wide sense stationary (WSS) processes. This work introduces a novel class of positive definiteness ensuring likelihood-based estimators for… ▽ More When only few data samples are accessible, utilizing structural prior knowledge is essential for estimating covariance matrices and their inverses. One prominent example is knowing the covariance matrix to be Toeplitz structured, which occurs when dealing with wide sense stationary (WSS) processes. This work introduces a novel class of positive definiteness ensuring likelihood-based estimators for Toeplitz structured covariance matrices (CMs) and their inverses. In order to accomplish this, we derive positive definiteness enforcing constraint sets for the Gohberg-Semencul (GS) parameterization of inverse symmetric Toeplitz matrices. Motivated by the relationship between the GS parameterization and autoregressive (AR) processes, we propose hyperparameter tuning techniques, which enable our estimators to combine advantages from state-of-the-art likelihood and non-parametric estimators. Moreover, we present a computationally cheap closed-form estimator, which is derived by maximizing an approximate likelihood. Due to the ensured positive definiteness, our estimators perform well for both the estimation of the CM and the inverse covariance matrix (ICM). Extensive simulation results validate the proposed estimators' efficacy for several standard Toeplitz structured CMs commonly employed in a wide range of applications. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Unsupervised high-throughput segmentation of cells and cell nuclei in quantitative phase images

Authors: Julia Sistermanns, Ellen Emken, Gregor Weirich, Oliver Hayden, Wolfgang Utschick

Abstract: In the effort to aid cytologic diagnostics by establishing automatic single cell screening using high throughput digital holographic microscopy for clinical studies thousands of images and millions of cells are captured. The bottleneck lies in an automatic, fast, and unsupervised segmentation technique that does not limit the types of cells which might occur. We propose an unsupervised multistage… ▽ More In the effort to aid cytologic diagnostics by establishing automatic single cell screening using high throughput digital holographic microscopy for clinical studies thousands of images and millions of cells are captured. The bottleneck lies in an automatic, fast, and unsupervised segmentation technique that does not limit the types of cells which might occur. We propose an unsupervised multistage method that segments correctly without confusing noise or reflections with cells and without missing cells that also includes the detection of relevant inner structures, especially the cell nucleus in the unstained cell. In an effort to make the information reasonable and interpretable for cytopathologists, we also introduce new cytoplasmic and nuclear features of potential help for cytologic diagnoses which exploit the quantitative phase information inherent to the measurement scheme. We show that the segmentation provides consistently good results over many experiments on patient samples in a reasonable per cell analysis time. △ Less

Submitted 24 November, 2023; originally announced November 2023.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

A Zero-Forcing Approach for the RIS-Aided MIMO Broadcast Channel

Authors: Dominik Semmler, Michael Joham, Wolfgang Utschick

Abstract: We present efficient algorithms for the sum-spectral efficiency (SE) maximization of the multi-user reconfigurable intelligent surface (RIS)-aided multiple-input multiple-output (MIMO) broadcast channel based on a zero-forcing approach. These methods conduct a user allocation for which the computation is independent of the number of elements at the RIS, that is usually large. Specifically, two alg… ▽ More We present efficient algorithms for the sum-spectral efficiency (SE) maximization of the multi-user reconfigurable intelligent surface (RIS)-aided multiple-input multiple-output (MIMO) broadcast channel based on a zero-forcing approach. These methods conduct a user allocation for which the computation is independent of the number of elements at the RIS, that is usually large. Specifically, two algorithms are given that exploit the line-of-sight (LOS) structure between the base station (BS) and the RIS. Simulations show superior SE performance compared to other linear precoding algorithms but with lower complexity. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Prediction and Interpretation of Vehicle Trajectories in the Graph Spectral Domain

Authors: Marion Neumeier, Sebastian Dorn, Michael Botsch, Wolfgang Utschick

Abstract: This work provides a comprehensive analysis and interpretation of the graph spectral representation of traffic scenarios. Based on a spatio-temporal vehicle interaction graph, an observed traffic scenario can be transformed into the graph spectral domain by means of the multidimensional Graph Fourier Transformation. Since these spectral scenario representations have shown to successfully incorpora… ▽ More This work provides a comprehensive analysis and interpretation of the graph spectral representation of traffic scenarios. Based on a spatio-temporal vehicle interaction graph, an observed traffic scenario can be transformed into the graph spectral domain by means of the multidimensional Graph Fourier Transformation. Since these spectral scenario representations have shown to successfully incorporate the complex and interactive nature of traffic scenarios, the beneficial feature representation is employed for the purpose of predicting vehicle trajectories. This work introduces GFTNNv2, a deep learning network predicting vehicle trajectories in the graph spectral domain. Evaluation of the GFTNNv2 on the publicly available datasets highD and NGSIM shows a performance gain of up to 25% in comparison to state-of-the-art prediction approaches. △ Less

Submitted 16 August, 2023; originally announced September 2023.

Comments: Accepted as a conference paper for IEEE ITSC 2023, Bilbao, Spain

Channel Estimation in Underdetermined Systems Utilizing Variational Autoencoders

Authors: Michael Baur, Nurettin Turan, Benedikt Fesl, Wolfgang Utschick

Abstract: In this work, we propose to utilize a variational autoencoder (VAE) for channel estimation (CE) in underdetermined (UD) systems. The basis of the method forms a recently proposed concept in which a VAE is trained on channel state information (CSI) data and used to parameterize an approximation to the mean squared error (MSE)-optimal estimator. The contributions in this work extend the existing fra… ▽ More In this work, we propose to utilize a variational autoencoder (VAE) for channel estimation (CE) in underdetermined (UD) systems. The basis of the method forms a recently proposed concept in which a VAE is trained on channel state information (CSI) data and used to parameterize an approximation to the mean squared error (MSE)-optimal estimator. The contributions in this work extend the existing framework from fully-determined (FD) to UD systems, which are of high practical relevance. Particularly noteworthy is the extension of the estimator variant, which does not require perfect CSI during its offline training phase. This is a significant advantage compared to most other deep learning (DL)-based CE methods, where perfect CSI during the training phase is a crucial prerequisite. Numerical simulations for hybrid and wideband systems demonstrate the excellent performance of the proposed methods compared to related estimators. △ Less

Submitted 5 January, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: 5 pages, 3 figures, accepted for publication at ICASSP 2024

Design of a Single-User RIS-Aided MISO System Based on Statistical Channel Knowledge

Authors: Sadaf Syed, Dominik Semmler, Donia Ben Amor, Michael Joham, Wolfgang Utschick

Abstract: Reconfigurable intelligent surface (RIS) is considered a prospective technology for beyond fifth-generation (5G) networks to improve the spectral and energy efficiency at a low cost. Prior works on the RIS mainly rely on perfect channel state information (CSI), which imposes a huge computational complexity. This work considers a single-user RIS-assisted communication system, where the second-order… ▽ More Reconfigurable intelligent surface (RIS) is considered a prospective technology for beyond fifth-generation (5G) networks to improve the spectral and energy efficiency at a low cost. Prior works on the RIS mainly rely on perfect channel state information (CSI), which imposes a huge computational complexity. This work considers a single-user RIS-assisted communication system, where the second-order statistical knowledge of the channels is exploited to reduce the training overhead. We present algorithms that do not require estimation of the CSI and reconfiguration of the RIS in every channel coherence interval, which constitutes one of the most critical practical issues in an RIS-aided system. △ Less

Submitted 8 September, 2023; originally announced September 2023.

Comments: 6 pages

Channel Estimation for Quantized Systems based on Conditionally Gaussian Latent Models

Authors: Benedikt Fesl, Nurettin Turan, Benedikt Böck, Wolfgang Utschick

Abstract: This work introduces a novel class of channel estimators tailored for coarse quantization systems. The proposed estimators are founded on conditionally Gaussian latent generative models, specifically Gaussian mixture models (GMMs), mixture of factor analyzers (MFAs), and variational autoencoders (VAEs). These models effectively learn the unknown channel distribution inherent in radio propagation s… ▽ More This work introduces a novel class of channel estimators tailored for coarse quantization systems. The proposed estimators are founded on conditionally Gaussian latent generative models, specifically Gaussian mixture models (GMMs), mixture of factor analyzers (MFAs), and variational autoencoders (VAEs). These models effectively learn the unknown channel distribution inherent in radio propagation scenarios, providing valuable prior information. Conditioning on the latent variable of these generative models yields a locally Gaussian channel distribution, thus enabling the application of the well-known Bussgang decomposition. By exploiting the resulting conditional Bussgang decomposition, we derive parameterized linear minimum mean square error (MMSE) estimators for the considered generative latent variable models. In this context, we explore leveraging model-based structural features to reduce memory and complexity overhead associated with the proposed estimators. Furthermore, we devise necessary training adaptations, enabling direct learning of the generative models from quantized pilot observations without requiring ground-truth channel samples during the training phase. Through extensive simulations, we demonstrate the superiority of our introduced estimators over existing state-of-the-art methods for coarsely quantized systems, as evidenced by significant improvements in mean square error (MSE) and achievable rate metrics. △ Less

Submitted 18 December, 2023; v1 submitted 7 September, 2023; originally announced September 2023.

Data-Aided Channel Estimation Utilizing Gaussian Mixture Models

Authors: Franz Weißer, Nurettin Turan, Dominik Semmler, Wolfgang Utschick

Abstract: In this work, we propose two methods that utilize data symbols in addition to pilot symbols for improved channel estimation quality in a multi-user system, so-called semi-blind channel estimation. To this end, a subspace is estimated based on all received symbols and utilized to improve the estimation quality of a Gaussian mixture model-based channel estimator, which solely uses pilot symbols for… ▽ More In this work, we propose two methods that utilize data symbols in addition to pilot symbols for improved channel estimation quality in a multi-user system, so-called semi-blind channel estimation. To this end, a subspace is estimated based on all received symbols and utilized to improve the estimation quality of a Gaussian mixture model-based channel estimator, which solely uses pilot symbols for channel estimation. Both of the proposed approaches allow for parallelization. Even the precomputation of estimation filters, which is beneficial in terms of computational complexity, is enabled by one of the proposed methods. Numerical simulations for real channel measurement data available to us show that the proposed methods outperform the studied state-of-the-art channel estimators. △ Less

Submitted 11 September, 2023; v1 submitted 31 August, 2023; originally announced August 2023.

Comments: Submitted to IEEE for possible publication

Physically Consistent Modelling of Wireless Links with Reconfigurable Intelligent Surfaces Using Multiport Network Analysis

Authors: Josef A. Nossek, Dominik Semmler, Michael Joham, Wolfgang Utschick

Abstract: RISs are an emerging technology for engineering the channels of future wireless communication systems. The vast majority of research publications on RIS are focussing on system-level optimization and are based on very simplistic models ignoring basic physical laws. There are only a few publications with a focus on physical modeling. Nevertheless, the widely employed model is still inconsistent wit… ▽ More RISs are an emerging technology for engineering the channels of future wireless communication systems. The vast majority of research publications on RIS are focussing on system-level optimization and are based on very simplistic models ignoring basic physical laws. There are only a few publications with a focus on physical modeling. Nevertheless, the widely employed model is still inconsistent with basic physical laws. We will show that even with a very simple abstract model based on isotropic radiators, ignoring any mismatch, mutual coupling, and losses, each RIS element cannot be modeled to simply reflect the incident signal by manipulating its phase only and letting the amplitude unchanged. We will demonstrate the inconsistencies with the aid of very simple toy examples, even with only one or two RIS elements. Based on impedance parameters, the problems associated with scattering parameters can be identified enabling a correct interpretation of the derived solutions. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Imperfect photon detection in quantum illumination

Authors: F. Kronowetter, M. Würth, W. Utschick, R. Gross, K. G. Fedorov

Abstract: In quantum illumination, various detection schemes have been proposed for harnessing remaining quantum correlations of the entanglement-based resource state. To this date, the only successful implementation in the microwave domain relies on a specific mixing operation of the respective return and idler modes, followed by single-photon counting in one of the two mixer outputs. We investigate the pe… ▽ More In quantum illumination, various detection schemes have been proposed for harnessing remaining quantum correlations of the entanglement-based resource state. To this date, the only successful implementation in the microwave domain relies on a specific mixing operation of the respective return and idler modes, followed by single-photon counting in one of the two mixer outputs. We investigate the performance of this scheme for realistic detection parameters in terms of detection efficiency, dark count probability, and photon number resolution. Furthermore, we take into account the second mixer output and investigate the advantage of correlated photon counting (CPC) for a varying thermal background and optimum post-processing weighting in CPC. We find that the requirements for photon number resolution in the two mixer outputs are highly asymmetric due to different associated photon number expectation values. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Leveraging Variational Autoencoders for Parameterized MMSE Estimation

Authors: Michael Baur, Benedikt Fesl, Wolfgang Utschick

Abstract: In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as conditionally Gaussian, yielding the conditional first and second moments of the estimand, given a noisy observation. The derived estimator is shown to approximate… ▽ More In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as conditionally Gaussian, yielding the conditional first and second moments of the estimand, given a noisy observation. The derived estimator is shown to approximate the minimum mean squared error estimator by utilizing the variational autoencoder as a generative prior for the estimation problem. We propose three estimator variants that differ in their access to ground-truth data during the training and estimation phases. The proposed estimator variant trained solely on noisy observations is particularly noteworthy as it does not require access to ground-truth data during training or estimation. We conduct a rigorous analysis by bounding the difference between the proposed and the minimum mean squared error estimator, connecting the training objective and the resulting estimation performance. Furthermore, the resulting bound reveals that the proposed estimator entails a bias-variance tradeoff, which is well-known in the estimation literature. As an example application, we portray channel estimation, allowing for a structured covariance matrix parameterization and low-complexity implementation. Nevertheless, the proposed framework is not limited to channel estimation but can be applied to a broad class of estimation problems. Extensive numerical simulations first validate the theoretical analysis of the proposed variational autoencoder-based estimators and then demonstrate excellent estimation performance compared to related classical and machine learning-based state-of-the-art estimators. △ Less

Submitted 21 August, 2024; v1 submitted 11 July, 2023; originally announced July 2023.

Comments: Accepted for publication in the IEEE Transactions on Signal Processing

Optimization and Interpretability of Graph Attention Networks for Small Sparse Graph Structures in Automotive Applications

Authors: Marion Neumeier, Andreas Tollkühn, Sebastian Dorn, Michael Botsch, Wolfgang Utschick

Abstract: For automotive applications, the Graph Attention Network (GAT) is a prominently used architecture to include relational information of a traffic scenario during feature embedding. As shown in this work, however, one of the most popular GAT realizations, namely GATv2, has potential pitfalls that hinder an optimal parameter learning. Especially for small and sparse graph structures a proper optimiza… ▽ More For automotive applications, the Graph Attention Network (GAT) is a prominently used architecture to include relational information of a traffic scenario during feature embedding. As shown in this work, however, one of the most popular GAT realizations, namely GATv2, has potential pitfalls that hinder an optimal parameter learning. Especially for small and sparse graph structures a proper optimization is problematic. To surpass limitations, this work proposes architectural modifications of GATv2. In controlled experiments, it is shown that the proposed model adaptions improve prediction performance in a node-level regression task and make it more robust to parameter initialization. This work aims for a better understanding of the attention mechanism and analyzes its interpretability of identifying causal importance. △ Less

Submitted 25 May, 2023; originally announced May 2023.

Comments: Accepted as a conference paper in IEEE IV 2023, Anchorage, Alaska, USA

On Learning the Tail Quantiles of Driving Behavior Distributions via Quantile Regression and Flows

Authors: Jia Yu Tee, Oliver De Candido, Wolfgang Utschick, Philipp Geiger

Abstract: Towards safe autonomous driving (AD), we consider the problem of learning models that accurately capture the diversity and tail quantiles of human driver behavior probability distributions, in interaction with an AD vehicle. Such models, which predict drivers' continuous actions from their states, are particularly relevant for closing the gap between AD agent simulations and reality. To this end,… ▽ More Towards safe autonomous driving (AD), we consider the problem of learning models that accurately capture the diversity and tail quantiles of human driver behavior probability distributions, in interaction with an AD vehicle. Such models, which predict drivers' continuous actions from their states, are particularly relevant for closing the gap between AD agent simulations and reality. To this end, we adapt two flexible quantile learning frameworks for this setting that avoid strong distributional assumptions: (1) quantile regression (based on the titled absolute loss), and (2) autoregressive quantile flows (a version of normalizing flows). Training happens in a behavior cloning-fashion. We use the highD dataset consisting of driver trajectories on several highways. We evaluate our approach in a one-step acceleration prediction task, and in multi-step driver simulation rollouts. We report quantitative results using the tilted absolute loss as metric, give qualitative examples showing that realistic extremal behavior can be learned, and discuss the main insights. △ Less

Submitted 27 July, 2023; v1 submitted 22 May, 2023; originally announced May 2023.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

A Multidimensional Graph Fourier Transformation Neural Network for Vehicle Trajectory Prediction

Authors: Marion Neumeier, Andreas Tollkühn, Michael Botsch, Wolfgang Utschick

Abstract: This work introduces the multidimensional Graph Fourier Transformation Neural Network (GFTNN) for long-term trajectory predictions on highways. Similar to Graph Neural Networks (GNNs), the GFTNN is a novel network architecture that operates on graph structures. While several GNNs lack discriminative power due to suboptimal aggregation schemes, the proposed model aggregates scenario properties thro… ▽ More This work introduces the multidimensional Graph Fourier Transformation Neural Network (GFTNN) for long-term trajectory predictions on highways. Similar to Graph Neural Networks (GNNs), the GFTNN is a novel network architecture that operates on graph structures. While several GNNs lack discriminative power due to suboptimal aggregation schemes, the proposed model aggregates scenario properties through a powerful operation: the multidimensional Graph Fourier Transformation (GFT). The spatio-temporal vehicle interaction graph of a scenario is converted into a spectral scenario representation using the GFT. This beneficial representation is input to the prediction framework composed of a neural network and a descriptive decoder. Even though the proposed GFTNN does not include any recurrent element, it outperforms state-of-the-art models in the task of highway trajectory prediction. For experiments and evaluation, the publicly available datasets highD and NGSIM are used △ Less

Submitted 12 May, 2023; originally announced May 2023.

Comments: Accepted as a conference paper in ITSC 2022, Macau, China

Enhanced Low-Complexity FDD System Feedback with Variable Bit Lengths via Generative Modeling

Authors: Nurettin Turan, Benedikt Fesl, Wolfgang Utschick

Abstract: Recently, a versatile limited feedback scheme based on a Gaussian mixture model (GMM) was proposed for frequency division duplex (FDD) systems. This scheme provides high flexibility regarding various system parameters and is applicable to both point-to-point multiple-input multiple-output (MIMO) and multi-user MIMO (MU-MIMO) communications. The GMM is learned to cover the operation of all mobile t… ▽ More Recently, a versatile limited feedback scheme based on a Gaussian mixture model (GMM) was proposed for frequency division duplex (FDD) systems. This scheme provides high flexibility regarding various system parameters and is applicable to both point-to-point multiple-input multiple-output (MIMO) and multi-user MIMO (MU-MIMO) communications. The GMM is learned to cover the operation of all mobile terminals (MTs) located inside the base station (BS) cell, and each MT only needs to evaluate its strongest mixture component as feedback, eliminating the need for channel estimation at the MT. In this work, we extend the GMM-based feedback scheme to variable feedback lengths by leveraging a single learned GMM through merging or pruning of dispensable mixture components. Additionally, the GMM covariances are restricted to Toeplitz or circulant structure through model-based insights. These extensions significantly reduce the offloading amount and enhance the clustering ability of the GMM which, in turn, leads to an improved system performance. Simulation results for both point-to-point and multi-user systems demonstrate the effectiveness of the proposed extensions. △ Less

Submitted 28 November, 2023; v1 submitted 5 May, 2023; originally announced May 2023.

Low-Rank Structured MMSE Channel Estimation with Mixtures of Factor Analyzers

Authors: Benedikt Fesl, Nurettin Turan, Wolfgang Utschick

Abstract: This work proposes a generative modeling-aided channel estimator based on mixtures of factor analyzers (MFA). In an offline step, the parameters of the generative model are inferred via an expectation-maximization (EM) algorithm in order to learn the underlying channel distribution of a whole communication scenario inside a base station (BS) cell. Thereby, the wireless channels are effectively mod… ▽ More This work proposes a generative modeling-aided channel estimator based on mixtures of factor analyzers (MFA). In an offline step, the parameters of the generative model are inferred via an expectation-maximization (EM) algorithm in order to learn the underlying channel distribution of a whole communication scenario inside a base station (BS) cell. Thereby, the wireless channels are effectively modeled on a piecewise linear subspace which is achieved by the low-rank structure of the learned covariances of the MFA. This suits the low-rank structure of wireless channels at high frequencies and additionally saves parameters and prevents overfitting. Afterwards, the trained MFA model is used online to perform channel estimation with a closed-form solution of the estimator which asymptotically converges to the minimum mean square error (MMSE) estimator. Numerical results based on real-world measurements demonstrate the great potential of the proposed approach for channel estimation. △ Less

Submitted 1 May, 2023; v1 submitted 28 April, 2023; originally announced April 2023.

A Versatile Low-Complexity Feedback Scheme for FDD Systems via Generative Modeling

Authors: Nurettin Turan, Benedikt Fesl, Michael Koller, Michael Joham, Wolfgang Utschick

Abstract: We propose a versatile feedback scheme for both single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. Particularly, we propose utilizing a Gaussian mixture model (GMM) with a reduced number of parameters for codebook construction, feedback encoding, and precoder design. The GMM is fitted offline at the base station (BS) to uplink training samples to… ▽ More We propose a versatile feedback scheme for both single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. Particularly, we propose utilizing a Gaussian mixture model (GMM) with a reduced number of parameters for codebook construction, feedback encoding, and precoder design. The GMM is fitted offline at the base station (BS) to uplink training samples to approximate the channel distribution of all possible mobile terminals (MTs) within the BS cell. Subsequently, a codebook is constructed, with each element based on one GMM component. Extracting directional information from the codebook or exploiting the GMM's sample generation ability facilitates joint precoder design for a multi-user MIMO system using state-of-the-art precoding algorithms. After offloading the GMM to the MTs, they can easily determine their feedback by selecting the index of the GMM component with the highest responsibility for their received pilot signal. This strategy exhibits low complexity and supports parallelization. Simulations demonstrate that the proposed approach outperforms conventional methods, which either estimate the channel and utilize a Lloyd codebook or use a deep neural network to determine the feedback in terms of spectral efficiency or sum-rate. The performance gains can be exploited to deploy systems with fewer pilots or feedback bits. △ Less

Submitted 28 November, 2023; v1 submitted 27 April, 2023; originally announced April 2023.

Comments: Copyright IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information

Gradient Derivation for Learnable Parameters in Graph Attention Networks

Authors: Marion Neumeier, Andreas Tollkühn, Sebastian Dorn, Michael Botsch, Wolfgang Utschick

Abstract: This work provides a comprehensive derivation of the parameter gradients for GATv2 [4], a widely used implementation of Graph Attention Networks (GATs). GATs have proven to be powerful frameworks for processing graph-structured data and, hence, have been used in a range of applications. However, the achieved performance by these attempts has been found to be inconsistent across different datasets… ▽ More This work provides a comprehensive derivation of the parameter gradients for GATv2 [4], a widely used implementation of Graph Attention Networks (GATs). GATs have proven to be powerful frameworks for processing graph-structured data and, hence, have been used in a range of applications. However, the achieved performance by these attempts has been found to be inconsistent across different datasets and the reasons for this remains an open research question. As the gradient flow provides valuable insights into the training dynamics of statistically learning models, this work obtains the gradients for the trainable model parameters of GATv2. The gradient derivations supplement the efforts of [2], where potential pitfalls of GATv2 are investigated. △ Less

Submitted 21 April, 2023; originally announced April 2023.

Reverse Ordering Techniques for Attention-Based Channel Prediction

Authors: Valentina Rizzello, Benedikt Böck, Michael Joham, Wolfgang Utschick

Abstract: This work aims to predict channels in wireless communication systems based on noisy observations, utilizing sequence-to-sequence models with attention (Seq2Seq-attn) and transformer models. Both models are adapted from natural language processing to tackle the complex challenge of channel prediction. Additionally, a new technique called reverse positional encoding is introduced in the transformer… ▽ More This work aims to predict channels in wireless communication systems based on noisy observations, utilizing sequence-to-sequence models with attention (Seq2Seq-attn) and transformer models. Both models are adapted from natural language processing to tackle the complex challenge of channel prediction. Additionally, a new technique called reverse positional encoding is introduced in the transformer model to improve the robustness of the model against varying sequence lengths. Similarly, the encoder outputs of the Seq2Seq-attn model are reversed before applying attention. Simulation results demonstrate that the proposed ordering techniques allow the models to better capture the relationships between the channel snapshots within the sequence, irrespective of the sequence length, as opposed to existing methods. △ Less

Submitted 11 May, 2023; v1 submitted 1 February, 2023; originally announced February 2023.

Comments: Submitted to IEEE for publication

Asymptotic Behavior of Zero-Forcing Precoding based on Imperfect Channel Knowledge for Massive MISO FDD Systems

Authors: Donia Ben Amor, Michael Joham, Wolfgang Utschick

Abstract: In this work, we study the asymptotic behavior of the zero-forcing precoder based on the least squares (LS) and the linear minimum mean-square error (LMMSE) channel estimates for the downlink (DL) of a frequency-division-duplex (FDD) massive multiple-input-single-output (MISO) system. We show analytically the rather surprising result that zero-forcing precoding based on the LS estimate leads asymp… ▽ More In this work, we study the asymptotic behavior of the zero-forcing precoder based on the least squares (LS) and the linear minimum mean-square error (LMMSE) channel estimates for the downlink (DL) of a frequency-division-duplex (FDD) massive multiple-input-single-output (MISO) system. We show analytically the rather surprising result that zero-forcing precoding based on the LS estimate leads asymptotically to an interference-free transmission, even if the number of pilots used for DL channel training is less than the number of antennas available at the base station (BS). Although the LMMSE channel estimate exhibits a better quality in terms of the MSE due to the exploitation of the channel statistics, we show that in the case of contaminated channel observations, zero-forcing based on the LMMSE is unable to eliminate the inter-user interference in the asymptotic limit of high DL transmit powers. In order for the results to hold, mild conditions on the channel probing phase are assumed. The validity of our analytical results is demonstrated through numerical simulations for different scenarios. △ Less

Submitted 4 December, 2023; v1 submitted 20 January, 2023; originally announced January 2023.

Learning a Gaussian Mixture Model from Imperfect Training Data for Robust Channel Estimation

Authors: Benedikt Fesl, Nurettin Turan, Michael Joham, Wolfgang Utschick

Abstract: In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical application, recent pilot observations at the base station (BS) can be utilized for training. This is in sharp contrast to state-of-theart machine learning (ML)… ▽ More In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical application, recent pilot observations at the base station (BS) can be utilized for training. This is in sharp contrast to state-of-theart machine learning (ML) techniques where a training dataset consisting of perfect channel state information (CSI) samples is a prerequisite, which is generally unaffordable. In particular, we propose an adapted training procedure for fitting the GMM which is a generative model that represents the distribution of all potential channels associated with a specific BS cell. To this end, the necessary modifications of the underlying expectation-maximization (EM) algorithm are derived. Numerical results show that the proposed estimator performs close to the case where perfect CSI is available for the training and exhibits a higher robustness against imperfections in the training data as compared to state-of-the-art ML techniques. △ Less

Submitted 13 February, 2023; v1 submitted 16 January, 2023; originally announced January 2023.

On the Mean Square Error Optimal Estimator in One-Bit Quantized Systems

Authors: Benedikt Fesl, Michael Koller, Wolfgang Utschick

Abstract: This paper investigates the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems in the context of channel estimation with jointly Gaussian inputs. We analyze the relationship of the generally nonlinear CME to the linear Bussgang estimator, a well-known method based on Bussgang's theorem. We highlight a novel observation that the Bussgang estimator is equal… ▽ More This paper investigates the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems in the context of channel estimation with jointly Gaussian inputs. We analyze the relationship of the generally nonlinear CME to the linear Bussgang estimator, a well-known method based on Bussgang's theorem. We highlight a novel observation that the Bussgang estimator is equal to the CME for different special cases, including the case of univariate Gaussian inputs and the case of multiple pilot signals in the absence of additive noise prior to the quantization. For the general cases we conduct numerical simulations to quantify the gap between the Bussgang estimator and the CME. This gap increases for higher dimensions and longer pilot sequences. We propose an optimal pilot sequence, motivated by insights from the CME, and derive a novel closed-form expression of the MSE for that case. Afterwards, we find a closed-form limit of the MSE in the asymptotically large number of pilots regime that also holds for the Bussgang estimator. Lastly, we present numerical experiments for various system parameters and for different performance metrics which illuminate the behavior of the optimal channel estimator in the quantized regime. In this context, the well-known stochastic resonance effect that appears in quantized systems can be quantified. △ Less

Submitted 27 April, 2023; v1 submitted 8 December, 2022; originally announced December 2022.

Channel Estimation with Reduced Phase Allocations in RIS-Aided Systems

Authors: Benedikt Fesl, Andreas Faika, Nurettin Turan, Michael Joham, Wolfgang Utschick

Abstract: We consider channel estimation in systems equipped with a reconfigurable intelligent surface (RIS). In order to illuminate the additional cascaded channel as compared to systems without a RIS, commonly an unaffordable amount of pilot sequences has to be transmitted over different phase allocations at the RIS. However, for a given base station (BS) cell, there exist immanent structural characterist… ▽ More We consider channel estimation in systems equipped with a reconfigurable intelligent surface (RIS). In order to illuminate the additional cascaded channel as compared to systems without a RIS, commonly an unaffordable amount of pilot sequences has to be transmitted over different phase allocations at the RIS. However, for a given base station (BS) cell, there exist immanent structural characteristics of the environment which can be leveraged to reduce the necessary number of phase allocations. We verify this observation by a study on discrete Fourier transform (DFT)-based phase allocations where we exhaustively search for the best combination of DFT columns. Since this brute-force search is unaffordable in practice, we propose to learn a neural network (NN) for joint phase optimization and channel estimation because of the dependency of the optimal phase allocations on the channel estimator, and vice versa. We verify the effectiveness of the approach by numerical simulations where common choices for the phase allocations and the channel estimator are outperformed. By an ablation study, the learned phase allocations are shown to be beneficial in combination with a different state-of-the-art channel estimator as well. △ Less

Submitted 26 January, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Unsupervised Parameter Estimation using Model-based Decoder

Authors: Franz Weißer, Michael Baur, Wolfgang Utschick

Abstract: In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can outperform existing unsupervised machine learning methods and classical methods. The proposed approach consists of introducing a model-based decoder in an autoencoder a… ▽ More In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can outperform existing unsupervised machine learning methods and classical methods. The proposed approach consists of introducing a model-based decoder in an autoencoder architecture which leads to a meaningful representation of the statistical model in the latent space of the autoencoder. Our numerical simulations show that the performance of the presented approach is not affected by correlated signals and performs well for both, uncorrelated and correlated, scenarios. This is a result of the fact, that, in the proposed framework, the signal covariance matrix and the DOAs are estimated simultaneously. △ Less

Submitted 28 November, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: Accepted for publication at SPAWC 2023

Variational Inference Aided Estimation of Time Varying Channels

Authors: Benedikt Böck, Michael Baur, Valentina Rizzello, Wolfgang Utschick

Abstract: One way to improve the estimation of time varying channels is to incorporate knowledge of previous observations. In this context, Dynamical VAEs (DVAEs) build a promising deep learning (DL) framework which is well suited to learn the distribution of time series data. We introduce a new DVAE architecture, called k-MemoryMarkovVAE (k-MMVAE), whose sparsity can be controlled by an additional memory p… ▽ More One way to improve the estimation of time varying channels is to incorporate knowledge of previous observations. In this context, Dynamical VAEs (DVAEs) build a promising deep learning (DL) framework which is well suited to learn the distribution of time series data. We introduce a new DVAE architecture, called k-MemoryMarkovVAE (k-MMVAE), whose sparsity can be controlled by an additional memory parameter. Following the approach in [1] we derive a k-MMVAE aided channel estimator which takes temporal correlations of successive observations into account. The results are evaluated on simulated channels by QuaDRiGa and show that the k-MMVAE aided channel estimator clearly outperforms other machine learning (ML) aided estimators which are either memoryless or naively extended to time varying channels without major adaptions. △ Less

Submitted 3 November, 2022; v1 submitted 31 October, 2022; originally announced October 2022.

Model Order Selection with Variational Autoencoding

Authors: Michael Baur, Franz Weißer, Benedikt Böck, Wolfgang Utschick

Abstract: Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the available observations with training on large datasets. This manuscript proposes an approach that uses a variational autoencoder (VAE) for model order selection. The id… ▽ More Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the available observations with training on large datasets. This manuscript proposes an approach that uses a variational autoencoder (VAE) for model order selection. The idea is to learn a parameterized conditional covariance matrix at the VAE decoder that approximates the true signal covariance matrix. The method is unsupervised and only requires a small representative dataset for calibration after training the VAE. Numerical simulations show that the proposed method outperforms classical methods and even reaches or beats a supervised approach depending on the considered snapshots. △ Less

Submitted 28 June, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

Comments: Accepted for publication at IEEE SPAWC 2023

High SNR Analysis of RIS-Aided MIMO Broadcast Channels

Authors: Dominik Semmler, Michael Joham, Wolfgang Utschick

Abstract: We analyze the influence of a reconfigurable intelligent surface (RIS) on the Gram channel eigenvalues in a high signal-to-noise ratio (SNR) scenario. This allows to connect specific channel properties with the rank improvement capabilities of the RIS. In particular, fundamental limits due to a possible line of sight (LOS) setup between the base station (BS) and the RIS are derived. Furthermore, d… ▽ More We analyze the influence of a reconfigurable intelligent surface (RIS) on the Gram channel eigenvalues in a high signal-to-noise ratio (SNR) scenario. This allows to connect specific channel properties with the rank improvement capabilities of the RIS. In particular, fundamental limits due to a possible line of sight (LOS) setup between the base station (BS) and the RIS are derived. Furthermore, dirty paper coding (DPC) based schemes are compared to linear precoding in such a scenario and it is shown that under certain channel conditions, the performance gap between DPC and linear precoding vanishes. △ Less

Submitted 14 April, 2023; v1 submitted 27 October, 2022; originally announced October 2022.