International Seminar on Signal Processing

Lecturer: Wolfgang Utschick and Josef A. Nossek

In Cooperation with:
Prof. Markus Rupp (Institute of Telecommunications, TU Vienna)
Prof. Armin Wittneben (Communication Technology Laboratory, ETH Zürich)

Organization: Andreas Barthelme

Target Audience: Master EI

Language: English

Offered in: Summer Term

Description

The Institute of Telecommunications at TU Vienna (Prof. Rupp, Prof. Mecklenbräucker and Prof. Görtz), the Communication Technology Lab at ETH Zürich (Prof. Wittneben) and the Methods of Signal Processing Group at Technische Universität München (Prof. Utschick) are organizing an international seminar on selected topics in signal processing and communications for students from the participating institutions during the summer term. The students (4-6 from each department) are offered potential topics by the corresponding supervisors, collect the required literature, understand the topic, summarize it in a two-page abstract and finally give a scientific talk. The talks are held in Zürich, Vienna and Munich. The travel and accommodation costs are covered by the organizers.

Note that due to the Coronavirus crisis, we have to suspend traveling to our partner universities in the summer term 2020. 

Application

Please send your informal application with an up-to-date transcript of records by April 1, 2020, to a.barthelme@tum.de

Scheduled Dates (Summer Term 2020)

May 22, 2020 (canceled) TU Wien
May 29, 2020 (canceled) ETH Zürich
June 26, 2020 TU München
 

Topics Offered in Summer Term 2020

Leveraging k-Nearest Neighbours in Deep Neural Networks

The ever growing popularity of deep neural networks (DNNs) can easily be observed across many fields - especially in computer vision and data mining.  However, these DNNs, generally speaking, come with a lack of interpretability, confidence quantification and robustness to adversarial attacks.  The authors of [1], address this problem by introducing the Deep k-Nearest Neighbours (DkNN) algorithm, which combines the interpretability of the k-NN algorithm with the feature extraction capacity of DNNs.  In this seminar, the student is expected to give an overview of the benefits of the DkNN algorithm in terms of interpretability, confidence and robustness.  Moreover, the student should also provide an intuitive explanation of the DkNN algorithm.

 

[1] N. Papernot, and P. McDaniel, “Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learning,” 2018. [Online]. Available: arxiv.org/abs/1803.04765

ClusterGAN: Latent Space Clustering in Generative Adversarial Networks

Clustering is central to many data-driven application domains and has been studied extensively. Due to the success of generative modeling in the last years it seems natural to leverage the potential of generative models also for clustering tasks. The intuition behind is that if a model learns to produce realistic samples from a low dimensional representation, then similar data points should be naturally close to each other in this low dimensional representation.
In this seminar topic a novel method called “ClusterGAN” [1] should be investigated which performs clustering within the framework of Generative Adversarial Networks (GANs) [2].

 

[1] S.  Mukherjee, H.  Asnani, E.  Lin, and S.  Kannan, “Clustergan:  Latent space clustering in generative adversarial networks,” The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI), 2019.

[2] Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio.  Generative adversarial nets.  In Advances in Neural Information Processing Systems 27

Deep Learning for Optimization of MISO Downlink Beamforming

Recently, a framework for optimization of MISO downlink beamforming was proposed, where fast optimal downlink beamforming strategies were studied by leveraging powerful deep learning (DL) techniques [1]. In this paper, three typical optimization problems are considered, i.e., the signal to-interference-plus-noise ratio (SINR) balancing problem, the power minimization problem and the sum rate maximization problem [1]. Depending on the problem, specific approaches to solve the computationally expensive problems with the help of a deep neural network consisting of a neural network module and a beamforming recovery module are considered [1]. The student should provide a brief summary of the key findings of the paper, where the focus is on identifying and understanding the differences between the proposed training strategies for each of the three optimization problems.

 

[1] “A Deep Learning Framework for Optimization of MISO Downlink Beamforming” - Wenchao Xia, Gan Zheng, Yongxu Zhu, Jun Zhang, Jiangzhou Wang, and Athina P. Petropulu

Transfer Learning and Meta Learning-Based Algorithms for CSI Estimation in Multiple Environments

Machine learning and deep learning techniques for physical communications have gained quite a lot of popularity and are considered to be a key enabling factor for channel state information (CSI) prediction in frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO). To address this problem, [1] develops a deep learning framework for a mixed scenario, in which different users experience different wireless transmission environments. In particular, three different algorithms for CSI prediction are proposed:

  • no-transfer algorithm, where the neural network is trained for multiple environments and then tested on the single environment;
  • direct-transfer algorithm, where after a coarse estimation of the parameters, the network is specifically tuned for the single environment;
  • meta-learning algorithm, where the network learns to adapt to a new environment with a small number of labeled data.

The student can see how machine learning techniques such as the one in [2] and [3] can be utilized for solving practical communication problems.

 

[1] “Deep Transfer Learning Based Downlink Channel Prediction for FDD Massive MIMO systems” -  Y. Yang, F. Gao, Z. Zhong and A. Alkhateeb.

[2] “A survey on transfer learning” - S. J. Pan and Q. Yang.

[3] “Model-agnostic meta-learning for fast adaptation of deep networks” - C. Finn, P. Abbeel and S. Levine.

A Kernelized Stein Discrepancy for Goodness-of-fit Tests

A method to test how well a probabilistic model fits a set of observations has been proposed [1]. The method combines Stein's identity with the concept of reproducing kernel Hilbert spaces. In the seminar, the student should summarize and present this method.

 

[1] “A Kernelized Stein Discrepancy for Goodness-of-fit Tests” – Q. Liu, J. Lee, M. Jordan

Unfolding the Approximate Message Passing Algorithm

Approximate Message Passing (AMP) [1] is a well-known iterative approach to solving problems, which fall into the Compressed Sensing framework. As has been proposed for similar iterative algorithms, unfolding the iterations of the AMP algorithm with the help of a deep neural network can improve its reconstruction properties [2]. For the seminar, the student shall produce an introduction into classical AMP methods and explain how unfolding can be used to improve the signal reconstruction.

 

[1] “Message Passing Algorithms for Compressed Sensing” – David L. Donoho, Arian Maleki and Andrea Montanari

[2] “AMP-Inspired Deep Networks for Sparse Linear Inverse Problems” – Mark Borgerding, Philip Schniter and Sundeep Rangan

Hierarchical Rate Splitting

Unlike conventional downlink strategies consisting of exclusively transmitting private messages to the users, the rate splitting (RS) approach divides the message of each user to a private part and a common part. The common part is decoded by all users whilst the private part can only be decoded by the intended user. This method is shown to achieve a higher sum Degree-of-Freedom (DoF) with an appropriate power allocation among the private and common messages compared to conventional strategies. It is also shown to offer robustness in large scale systems with imperfect channel state information at the transmitter (CSIT) [1].

The student should look into the RS approach and investigate the so-called hierarchical RS (HRS) proposed in [2] for the case of imperfect CSIT. Further, the student is supposed to present the limitations and challenges related to this strategy.    

 

[1] "A Rate Splitting Strategy for Massive MIMO with Imperfect CSIT," - M. Dai, B. Clerckx, D. Gesbert and G. Caire

[2] "A Hierarchical Rate Splitting Strategy for FDD Massive MIMO under Imperfect CSIT," - M. Dai, B. Clerckx, D. Gesbert and G. Caire