Instructors: Prof. Dr. Nassir NavabDr. Shahrooz Faghih Roohi,  Ashkan Khakzar, Azade Farshad, Yousef Yeganeh

Time: TBA



  • It is highly recommended to attend the seminar in person. However, for those who cannot attend in person, the online link via Zoom will be provided (the meeting link will be shared with participants via email and on the moodle).
  • The presentation and blogpost guidelines are available here: Guide_DLMA WS2022_23.pdf


  • Deep Learning is growing tremendously in Computer Vision and Medical Imaging as well. Highly impacted journals in the medical imaging community, i.e. IEEE Transaction on Medical Imaging, published recently their special edition on Deep Learning [1]. The Seminar will propose a list of recent scientific articles related to the main current research topics in deep learning for Medical Applications together with some interesting papers from other communities (CVPR, NeurIPS, ICCV, ICLR, ICML, ...).

Course Structure

In this Master Seminar (Hauptseminar), students select one scientific topic from the list provided by course organizers. The students should read the proposed sample papers by the tutors, find the topic-related articles, summarize and compare them in their presentation and blogpost:

  • Presentation: The selected paper is presented to the other participants (Maximum 25 minutes presentation, 10 minutes questions). You can use the CAMP templates for PowerPoint TUM-Template.pptx.
  • Blog Post: A blog post of 2000-2500 words, excluding references should be submitted before the deadline. The blog post must include all references used and must be written completely in your own words. Copy and paste will not be tolerated
  • Attendance: Participants have to participate actively in all seminar sessions. Each presentation is followed by a discussion and everyone is encouraged to participate actively.

Submission Deadline: You have to submit the first draft of the blog post one week before your presentation session. However, you would have time to modify it until the last session. You should also submit the presentation one day right after your presentation session.



DateSession: TopicSlidesStudents
21/07Preliminary Meeting


Uncertainty estimation for medical segmentation

Yao, Junting


Motion Compensation for Electromagnetically Tracked Catheters

Transformers in Image Registration

Wally, Youssef

Ünlü Idil


Self-supervised Vessel Segmentation

Automated Semantic/Anatomical Vessel labeling

Masking Techniques for Computer Vision and Medical Imaging

Avendano-Prieto, Natalia

Otto, Julia

Anil Kul


Representation Learning using Generative Models

Graph / Scene Graph representation learning

Incremental Learning in Medical Image Analysis:

Sun Mei

Bigom, Andreas

Dozono, Kohei


Curvilinear structures segmentation

Unsupervised Domain Adaptation in Medical Image Analysis

SSL representation learning by/for object detection

Sotela, Sebastian

Posada Cárdenas, Andrea

Jiajun Wang


Cross-modal learning

Contrastive Language-Image Models in Medical Image Understanding

Multimodal Image Synthesis

Duman, Serdar

Diery, Kristina

Karoui, Yasmine


Diffusion Models for Medical Imaging

Physics Informed Neural Network for Computer Vision and Medical Imaging

NeRF Applications in Medical Imaging

Self-Supervised/Unsupervised Image and Medical Imaging Segmentation

Zhang, Yifan

He, Xinyi

Matiunina Daria

Palmisano Patrizio

List of Topics and Material

Papers in this course are selected from the following venues/publications:

CVPR: Conference on Computer Vision and Pattern Recognition
ICLR: International Conference on Learning Representations
NeurIPS: Neural Information Processing Systems

TPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence

TMI: IEEE Transaction on Medical Imaging
JBHI: IEEE Journal of Biomedical and Health Informatics
MedIA: Medical Image Analysis (Elsevier)

MICCAI: Medical Image Computing and Computer-Assisted Intervention
BMVC: British Machine Vision Conference
MIDL: Medical Imaging with Deep Learning

List of topics

NoTopicSample PapersJournal/ ConferenceTutorStudentLink
1Learning-based Statistical Shape Model

Deep implicit statistical shape models for 3d medical image delineationAAAI 2022None
Deep Structural Causal Shape ModelsECCV 2022
Leveraging unsupervised image registration for discovery of landmark shape descriptorMedIA 2021
2Representation Learning using Generative Models

Generative Flow Networks for Discrete Probabilistic ModelingICML 2022 SpotlightSun Mei
Flamingo: a Visual Language Model for Few-Shot LearningDeepMind
Object Scene Representation TransformerNeurIPS 2022
3Graph / Scene Graph representation learning

VARSCENE: A Deep Generative Model for Realistic Scene Graph SynthesisICML 2022 SpotlightBigom, Andreas
Self-Supervised Representation Learning via Latent Graph PredictionICML 2022 Spotlight
Iterative Scene Graph GenerationNeurIPS 2022
4Motion Compensation for Electromagnetically Tracked Catheters

A survey of catheter tracking concepts and methodologiesMedical Image AnalysisWally, Youssef
Respiratory motion compensation with tracked internal and external sensors during CT-guided proceduresComputer Aided Surgery
Position Control of Motion Compensation Cardiac CathetersIEEE Transactions on Robotics
5Diffusion Models for Medical Imaging

Diffusion Deformable Model for 4D Temporal Medical Image GenerationMICCAI 2022Zhang, Yifan
Diffusion Models for Medical Anomaly DetectionMICCAI 2022
Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion ModelsMICCAI 2022
6Symbolic Regression

Discovering Symbolic Models from Deep Learning with Inductive BiasesNeurIPS 2020None

End-to-end symbolic regression with transformersArXiv 2022
AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularityNeurIPS 2020

7Uncertainty estimation for medical segmentation

Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for SegmentationMICCAI 2022Yao, Junting
Efficient Bayesian Uncertainty Estimation for nnU-NetMICCAI 2022
CRISP - Reliable Uncertainty Estimation for Medical Image SegmentationMICCAI 2022
8Cross-modal learning

Learning Explicit and Implicit Dual Common Subspaces for Audio-Visual Cross-Modal RetrievalTOMM 2022Duman, Serdar

VISUALVOICE: Audio-Visual Speech Separation with Cross-Modal Consistency (2021)

CVPR 2021
Visually Guided Sound Source Separation and Localization Using Self-Supervised Motion RepresentationsIEEE/CVF/WACV 2022

9Curvilinear structures segmentationCS2-Net: Deep learning segmentation of curvilinear structures in medical imagingMedIA 2021

Sotela, Sebastian
3D vessel-like structure segmentation in medical images by an edge-reinforced networkMedIA 2022
10Transformers in Image RegistrationDeformer: Towards Displacement Field Learning for Unsupervised Medical Image RegistrationMICCAI 2022Ünlü Idil
TransMorph: Transformer for unsupervised medical image registrationMedIA 2022
Affine Medical Image Registration With Coarse-To-Fine Vision TransformerCVPR 2022

11Masking Techniques for Computer Vision and Medical ImagingResolution-robust large mask inpainting with fourier convolutionsWACV 2022Anil Kul

Image inpainting for irregular holes using partial convolutionsECCV 2018

Incremental transformer structure enhanced image inpainting with masking positional encodingCVPR 2022

12Self-Supervised/Unsupervised Image and Medical Imaging Segmentation

Self-Supervised Learning for Few-Shot Medical Image SegmentationTMI 2022Palmisano Patrizio
Mix-and-match tuning for self-supervised semantic segmentationAAAI 2018
Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial RegularizationRAL 2021
13Physics Informed Neural Network for Computer Vision and Medical Imaging

Physics-Informed Neural Networks for Brain Hemodynamic Predictions Using Medical ImagingTMI 2022He, Xinyi
Physics-informed neural networks for myocardial perfusion MRI quantificationMedIA 2022
Physics-Informed Neural Networks for Cardiac Activation MappingFrontiers 2020
14NeRF Applications in Medical Imaging

ImplicitAtlas: Learning Deformable Shape Templates in Medical ImagingCVPR 2022Matiunina Daria

3D Ultrasound Spine Imaging with Application of Neural Radiance Field MethodIUS 2021
Implicit Neural Representations for Medical Imaging SegmentationMICCAI 2022
15Contrastive Language-Image Models in Medical Image Understanding

Contrastive Learning of Medical Visual Representations from Paired Images and Textarxiv 2020/ revised 2022Diery, Kristina
RepsNet: Combining Vision with Language for Automated Medical ReportsMICCAI 2022
Radiological Reports Improve Pre-training for Localized Imaging Tasks on Chest X-RaysMICCAI 2022
16Multimodal Image Synthesis

Multimodal Image Synthesis and Editing: A SurveyPAMI 2022Karoui, Yasmine
Hi-net: hybrid-fusion network for multi-modal MR image synthesisTMI 2020

ResViT: residual vision transformers for multimodal medical image synthesisTMI 2022

17Incremental Learning in Medical Image Analysis:

Continual Class Incremental Learning for CT Thoracic SegmentationMICCAI 2020Dozono, Kohei
Mnemonics Training: Multi-Class Incremental Learning without ForgettingCVPR 2020

Class-Incremental Learning by Knowledge Distillationwith Adaptive Feature ConsolidationCVPR 2022

18 Unsupervised Domain Adaptation in Medical Image Analysis

S-CUDA: Self-cleansing unsupervised domain adaptation for medical image segmentationMedIA 2021Posada Cárdenas, Andrea
Data Efficient Unsupervised Domain Adaptationfor Cross-Modality Image SegmentationMICCAI 2019
Unsupervised Domain Adaptation for Medical Image Segmentation by Disentanglement Learning and Self-TrainingTMI 2022

19Self-supervised Vessel Segmentation
Self-supervised vessel segmentation via adversarial learningICCV2021Avendano-Prieto, Natalia

Diffusion Adversarial Representation Learning for Self-supervised Vessel SegmentationArxiv 2022
20Automated Semantic/Anatomical Vessel labeling
Automated anatomical labeling of a topologically variant abdominal arterial system via probabilistic hypergraph matchingMIA2022Otto, Julia
CPR-GCN: Conditional Partial-Residual Graph Convolutional Network in Automated Anatomical Labeling of Coronary ArterieCVPR2020

Automated anatomical labeling of coronary arteries via bidirectional tree LSTMsIJCARS 2019
21Out of Distribution (OOD) robustness

An impartial take to the cnn vs transformer robustness contestECCV 2022None
Plex: Towards Reliability using Pretrained Large Model ExtensionsArxiv 2022 (Google AI)
Smoothness in neural network approximators: the good, the bad, the uglyNeurIPS 2020 (Deepmind)

22SSL representation learning by/for object detection

Object discovery and representation networksECCV 2022Jiajun Wang
Unsupervised part discovery from contrastive reconstructionNeurIPS 2021
Efficient Visual Pretraining with Contrastive DetectionArxiv
23Continual Learning

Architecture Matters in Continual LearningArxiv 2022 (Deepmind)None
Efficient Continual Learning in Neural Network SubspacesArxiv 2022 (Deepmind)
Wide Neural Networks Forget Less CatastrophicallyArxiv 2022 (Deepmind)

Literature and Helpful Links

A lot of scientific publications can be found online.

The following list may help you to find some further information on your particular topic:

Some publishers:

Libraries (online and offline):

Some further hints for working with references:

  • JabRef is a Java program for comfortable working with Bibtex literature databases. Handy feature: if you know the PubMed ID for an article, JabRef can import data from there (via "Web Search/Medline").
  • Mendeley is a cross-platform program for organising your references.

If you find useful resources that are not already listed here, please tell us, so we can add them for others. Thanks.

  • No labels