Instructors: Prof. Dr. Nassir Navab, Dr. Shahrooz Faghih Roohi, Ashkan Khakzar, Azade Farshad, Roger Soberanis
Time: Thursdays, 12:00 to 14:00
Registration
- Registration must be done through TUM Matching Platform (please pay attention to the Deadlines)
- In order to increase your priority, please also apply via our own Registration system.
- The maximum number of participants: 20.
Announcements
- The presentation guidelines are available here: Guide_DLMAss21.pdf
- The preliminary meeting slides can be found here: DLMASs21.pdf
- The preliminary meeting is scheduled for Feb 8, 15:30 (Zoom link is visible on TUMonline in the course description).
- Due to the current pandemic, the seminar happens virtually via Zoom (the meeting link will be shared with participants via email).
Introduction
- Deep Learning is growing tremendously in Computer Vision and Medical Imaging as well. Highly impacted journals in the medical imaging community, i.e. IEEE Transaction on Medical Imaging, published recently their special edition on Deep Learning [1]. The Seminar will propose a list of recent scientific articles related to the main current research topics in deep learning for Medical Applications together with some interesting papers from other communities (CVPR, NeurIPS, ICCV, ICLR, ICML, ...).
Course Structure
In this Master Seminar (Hauptseminar), students select one scientific article from the list provided by course organizers. The students read the paper, and must accomplish the following:
- Presentation: The selected paper is presented to the other participants (20 minutes presentation 10 minutes questions). You can use the CAMP templates for PowerPoint camp-tum-jhu-slides.zip, or Latex: CAMP-latex-template.
- Blog Post: A blog post of 1000-1200 words excluding references should be submitted before the deadline. The blog post must include all references used and must be written completely in your own words. Copy and paste will not be tolerated
- Attendance: Participants have to participate actively in all seminar sessions. Each presentation is followed by a discussion and everyone is encouraged to actively participate.
Submission Deadline: You have to submit the blog post one week before your presentation session! You should also submit the presentation one day right after your presentation session.
You may look at the blog posts and presentations from the previous semester (using the tree in the upper left corner).
Schedule
Date | Session: Topic | Slides | Students |
---|---|---|---|
08.02.2021 (15:30-16) | Preliminary Meeting | Slides | |
13.04.2021 | Announcing the list of papers | ||
19.04.2021 | Paper Assignment | ||
20.05.2021 | Data-Efficient DL, Representation Learning 1 | Ana-Maria Lacatusu Oleksii Khakhlyuk | |
27.05.2021 | Data-Efficient DL, Representation Learning 2 | Rob van Kemenade Melissa Lutgardo Yiran Huang | |
03.06.2021 | No class (regional holiday) | ||
10.06.2021 | Unsupervised/Semi-supervised/Self-supervised learning 1 | Zhisheng Zheng Huaiwei Zhang Florian Hautmann | |
17.06.2021 | Unsupervised/Semi-supervised/Self-supervised learning 2 | Tomas Chobola Margaryta Olenchuk Batuhan Yumurtaci | |
24.06.2021 | Transformers | Güven Erkaya Mei-Ju Su | |
01.07.2021 | Medical Image segmentation / Registration/ Report generation | Lizi Mamisashvili Cansu Yildirim Tim Neumann | |
08.07.2021 | Graph | Zhuoling Li Carl Alexander Noack Ayhan Can Erdur |
List of Topics and Material
Papers in this course are selected from the following venues/publications:
CVPR: Conference on Computer Vision and Pattern Recognition
ICLR: International Conference on Learning Representations
NeurIPS: Neural Information Processing Systems
TPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence
TMI: IEEE Transaction on Medical Imaging
JBHI: IEEE Journal of Biomedical and Health Informatics
MedIA: Medical Image Analysis (Elsevier)
MICCAI: Medical Image Computing and Computer-Assisted Intervention
BMVC: British Machine Vision Conference
MIDL: Medical Imaging with Deep Learning
List of papers
Topic | No | Title | Journal/ Conference | Tutor | Student | Link |
Medical Image segmentation / Registration/ Report generation | 1 | Automatic Medical Image Report Generation with Multi-view and Multi-modal Attention Mechanism | ICA3PP 2020 | Matthias | Lizi Mamisashvili | https://link.springer.com/chapter/10.1007/978-3-030-60248-2_48 |
3 | CS2-Net: Deep learning segmentation of curvilinear structures in medical imaging | MedIA 2020 | Shahrooz | Cansu Yildirim | https://www.sciencedirect.com/science/article/abs/pii/S1361841520302383 | |
4 | Learning multiview 3D point cloud registration | CVPR 2020 | Maria | Tim Neumann | https://openaccess.thecvf.com/content_CVPR_2020/html/Gojcic_Learning_Multiview_3D_Point_Cloud_Registration_CVPR_2020_paper.html | |
Unsupervised/Semi-supervised/Self-supervised learning | ----------- | |||||
6 | SELF-SUPERVISED LEARNING FROM A MULTI-VIEW PERSPECTIVE | ICLR 2021 | Azade | Huaiwei Zhang | https://openreview.net/pdf?id=-bdp_8Itjwp | |
7 | Self-supervised Pretraining of Visual Features in the Wild | CVPR 2021 | Tariq | Tomas Chobola | https://arxiv.org/pdf/2103.01988.pdf | |
8 | Big Self-Supervised Models Advance Medical Image Classifications | CVPR 2021 | Tariq | Florian Hautmann | https://arxiv.org/pdf/2101.05224.pdf | |
10 | Semi-Supervised Capsule cGAN for Speckle Noise Reduction in Retinal OCT Images | TMI 2021 | Shahrooz | Margaryta Olenchuk | https://ieeexplore.ieee.org/abstract/document/9312620 | |
11 | State-Aware Tracker for Real-Time Video Object Segmentation | CVPR2020 | Baochang Zhang | Batuhan Yumurtaci | https://arxiv.org/pdf/2003.00482.pdf | |
2 | Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation | Medical Image Analysis, 2021 | Matthias | Zhisheng Zheng | https://www.sciencedirect.com/science/article/abs/pii/S136184152030236X?dgcid=rss_sd_all | |
9 | Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning | CVPR 2021 | Heiko | Oleksii Khakhlyuk | https://arxiv.org/abs/2011.10043 | |
Data-Efficient DL, Representation Learning | 12 | Continual Adaptation of Visual Representations via Domain Randomization and Meta-learning | CVPR 2021 | Azade | Melissa Lutgardo | https://arxiv.org/pdf/2012.04324.pdf |
----------- | ||||||
14 | Handling Missing Data with Graph Representation Learning | NeurIPS 2020 | Roger | Yiran Huang | https://arxiv.org/abs/2010.16418 | |
15 | Procedure Planning in Instructional Videos | ECCV 2020 | Tobias | Ana-Maria Lacatusu | https://arxiv.org/pdf/1907.01172.pdf | |
20 | Saliency is a Possible Red Herring When Diagnosing Poor Generalization | ICLR 2021 | Ashkan | Rob van Kemenade | https://arxiv.org/abs/1910.00199 | |
Reliable AI (Interpretability, Uncertainty, robustness) | ----------- | |||||
----------- | ||||||
----------- | ||||||
----------- | ||||||
Transformers | ----------- | |||||
22 | Medical Transformer: Gated Axial-Attention for Medical Image Segmentation | Yousef | Güven Erkaya | https://arxiv.org/abs/2102.10662 | ||
23 | Vision Transformers for Dense Prediction | Yousef | Mei-Ju Su | https://arxiv.org/abs/2103.13413 | ||
----------- | ||||||
Graphs | 25 | Multi-Label Graph Convolutional Network Representation Learning | IEEE Transactions on Big Data (TBD) 2020 | Mahsa | Zhuoling Li | https://arxiv.org/pdf/1912.11757.pdf |
----------- | ||||||
27 | Robust Graph Convolutional Networks Against Adversarial Attacks | ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. | Anees | Carl Alexander Noack | http://119.28.72.117/papers/RGCN.pdf | |
28 | Recovering Brain Structural Connectivity from Functional Connectivity via Multi-GCN Based Generative Adversarial Network | MICCAI 2020 | Anees | Ayhan Can Erdur | https://link.springer.com/chapter/10.1007/978-3-030-59728-3_6 |
Literature and Helpful Links
A lot of scientific publications can be found online.
The following list may help you to find some further information on your particular topic:
- Microsoft Academic Search
- Google Scholar
- CiteSeer
- CiteULike
- Collection of Computer Science Bibliographies
Some publishers:
- ScienceDirect (Elsevier Journals)
- IEEE Journals
- ACM Digital Library
Libraries (online and offline):
- http://rzblx1.uni-regensburg.de/ezeit/ (Elektronische Zeitschriften Bibliothek)
- Verbundkatalog des Bibliotheksverbundes Bayern (BVB)
- Computer ORG
- http://www.ub.tum.de/ (TUM Library)
- To get access onto the electronic library, see http://www.ub.tum.de/medien/ejournals/readme.html
- "proxy.biblio.tu-muenchen.de" mit Port 8080 (nur fuer http). Damit klappen zumindest portal.acm.org und computer.org meistens
- Various proceedings of conferences in our AR-Lab, 03.13.036 (These proceedings are not for lending!)
Some further hints for working with references:
- JabRef is a Java program for comfortable working with Bibtex literature databases. Handy feature: if you know the PubMed ID for an article, JabRef can import data from there (via "Web Search/Medline").
- Mendeley is a cross-platform program for organising your references.
If you find useful resources that are not already listed here, please tell us, so we can add them for others. Thanks.