Deep Learning meets Shearlets: On the Path Towards Interpretable Imaging

Gitta Kutyniok (LMU Munich)

27-Apr-2021, 10:15-11:45 (5 years ago)

Abstract: Pure model-based approaches are today often insufficient for solving complex inverse problems in medical imaging. At the same time, methods based on artificial intelligence, in particular, deep neural networks, are extremely successful, often quickly leading to state-of-the-art algorithms. However, pure deep learning approaches often neglect known and valuable information from the modeling world and suffer from a lack of interpretability.

In this talk, we will develop a conceptual approach by combining the model-based method of sparse regularization by shearlets with the data-driven method of deep learning. Our solvers pay particular attention to the singularity structures of the data. Focussing then on the inverse problem of (limited-angle) computed tomography, we will show that our algorithms significantly outperform previous methodologies, including methods entirely based on deep learning. Finally, we will also touch upon the issue of how to interpret such algorithms, and present a novel, state-of-the-art explainability method based on information theory.

machine learningnumerical analysisoptimization and control

Audience: researchers in the topic


Mathematics of Deep Learning

Series comments: Please fill out the following form for registering for our email list, where talk announcements and zoom details are distributed: docs.google.com/forms/d/e/1FAIpQLSeWAzBXsXRqpJhHDKODywySl_BWZN-Cbrik_4bEun2fGwhOKg/viewform?usp=sf_link

Slides: drive.google.com/drive/folders/1w9lNCGWZyzGFxxuVvhJOcjlc92X2toJg?usp=sharing

Videos: www.fau.tv/course/id/878

Organizers: Leon Bungert*, Daniel Tenbrinck
Curator: Martin Burger
*contact for this listing

Export talk to