Instructors: Prof. Dr. Nassir NavabDr. Shahrooz Faghihroohi, Azade Farshad, Yousef Yeganeh


Time: TBA

Registration

Announcements

Introduction

  • Deep Learning is growing tremendously in Computer Vision and Medical Imaging as well. Highly impacted journals in the medical imaging community, i.e. IEEE Transaction on Medical Imaging, recently published their special edition on Deep Learning [1]. The Seminar will propose a list of recent scientific articles related to the main current research topics in deep learning for Medical Applications, together with some interesting papers from other communities (CVPR, NeurIPS, ICCV, ICLR, ICML, ...).

Course Structure

In this Master Seminar (Hauptseminar), students select one scientific topic from the list provided by course organizers. The students should read the proposed sample papers by the tutors, find the topic-related articles, summarize and compare them in their presentation and blogpost:

  • Presentation: The selected paper is presented to the other participants (Maximum 25 minutes presentation, 10 minutes questions). You can use the CAMP templates for PowerPoint TUM-Template.pptx.
  • Blog Post: A blog post of 3000-3500 words excluding references, should be submitted before the deadline. The blog post must include all references used and must be written completely in your own words. Copy and paste will not be tolerated.
  • Attendance: Participants have to participate actively in all seminar sessions. Each presentation is followed by a discussion, and everyone is encouraged to actively participate.

Submission Deadline: You have to submit the blog post by the first presentation date and can modify it a bit until the last session of the course.

Schedule (TBA)

DateSession: TopicsStudents
12.12.2024

Learning Physiology in neural networks

Physics-informed Multimodal Networks

Acoustic Signal Analysis

Sweilam Abdullah, Abdelrahman

Fazakas, Borbala

Salerno, Giovanni Karl Alberto

19.12.2024

Deep Learning in Echocardiography

Coronary Stenosis Detection in Cardiac Imaging

Deep Learning in Ultrasound Elastography 

Valera, Patris

Thees, Christoph

Jostan, Jonas

16.01.2025

LLMs for disease prediction based on non-imaging data,

Best practices for report generation via LLMs based on template

Knowledge Graphs for Medical Applications

Elghitany, Asmaa

Pospelova, Maria

Chen, Zixi

23.01.2025

PointNeRF (Point clouds and NeRF)

Mesh Reconstruction for 3D Medical Imaging

Video anomaly detection/generation Using Prompt

Sahin, Volkan

Temiz, Kazım Muhammet

Bamel, Parag

List of Topics and Material

The proposed papers for each topic in this course are usually selected from the following venues/publications:


CVPR: Conference on Computer Vision and Pattern Recognition
ICLR: International Conference on Learning Representations
NeurIPS: Neural Information Processing Systems

TPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence

TMI: IEEE Transaction on Medical Imaging
JBHI: IEEE Journal of Biomedical and Health Informatics
MedIA: Medical Image Analysis (Elsevier)

MICCAI: Medical Image Computing and Computer-Assisted Intervention.
BMVC: British Machine Vision Conference
MIDL: Medical Imaging with Deep Learning


List of papers (TBA)

NoTopicSample PapersJournal/ ConferenceTutorStudentLink
1Coronary Stenosis Detection in Cardiac ImagingBMC Medical Imaging 2024BMC Medical Imaging 2024Thees, Christophhttps://link.springer.com/content/pdf/10.1186/s12880-024-01403-4.pdf
Frontiers in Cardiovascular Medicine 2023Frontiers in Cardiovascular Medicine 2023

https://www.frontiersin.org/journals/cardiovascular-medicine/articles/10.3389/fcvm.2023.944135/full

JACC: Advances 2024JACC: Advances 2024https://www.sciencedirect.com/science/article/pii/S2772963X24000395
2PointNeRF (Point clouds and NeRF)Point-nerf: Point-based neural radiance fieldsCVPR 2022Sahin, Volkan

https://openaccess.thecvf.com/content/CVPR2022/html/Xu_Point-NeRF_Point-Based_Neural_Radiance_Fields_CVPR_2022_paper.html

Pointnerf++: A multi-scale, point-based neural radiance fieldECCV 2024https://link.springer.com/chapter/10.1007/978-3-031-72920-1_13
Points2nerf: Generating neural radiance fields from 3d point cloudPattern Recognition Letters 2024

https://www.sciencedirect.com/science/article/pii/S0167865524002058?casa_token=ZxZAlmWwMhQAAAAA:xH_C2NbUMkfxbG97tgQFb6YUY2gYic1hln_-EtuO9aQXAJjhamyxoC7ASiwAkgsQ9QQenT_1RDg

3Reflection modelling with NeRFMerf: Memory-efficient radiance fields for real-time view synthesis in unbounded scenesACM Transactions on Graphic 2023--------------https://arxiv.org/pdf/2302.12249
NeRF-Casting: Improved View-Dependent Appearance with Consistent ReflectionsSIGGRAPH 2024https://arxiv.org/abs/2405.14871
Flash Cache: Reducing Bias in Radiance Cache Based Inverse RenderingArXiv 2024https://arxiv.org/abs/2409.05867
4Acoustic Signal AnalysisA Comprehensive Overview of Heart Sound Analysis Using Machine Learning MethodsIEEE Access 2024Salerno, Giovanni Karl Albertohttps://ieeexplore.ieee.org/abstract/document/10606233
Non-Invasive Assessment of Cartilage Damage of the Human Knee Using Acoustic Emission Monitoring: A Pilot Cadaver StudyIEEE Transactions on Biomedical Engineering 2023https://ieeexplore.ieee.org/abstract/document/10089156
Knee acoustic emissions as a noninvasive biomarker of articular health in patients with juvenile idiopathic arthritis: a clinical validation in an extended study populationPediatric Rheumatology, 2023https://link.springer.com/article/10.1186/s12969-023-00842-7
5Learning Physiology in neural networksNeuron Structure Modeling for Generalizable Remote Physiological MeasurementCVPR 2023Sweilam Abdullah, Abdelrahman

https://openaccess.thecvf.com/content/CVPR2023/html/Lu_Neuron_Structure_Modeling_for_Generalizable_Remote_Physiological_Measurement_CVPR_2023_paper.html

Physics-informed neural networks for modeling physiological time series for cuffless blood pressure estimationnpj Digital Medicine 2023https://www.nature.com/articles/s41746-023-00853-4
Leveraging physiology and artificial intelligence to deliver advancements in health carePhysiological Reviews 2023https://ieeexplore.ieee.org/abstract/document/10667569
6Knowledge Graphs for Medical ApplicationsMedical Knowledge Graph: Data Sources, Construction, Reasoning, and ApplicationsBig Data Mining and Analytics 2023Chen, Zixihttps://ieeexplore.ieee.org/abstract/document/10026520
Towards electronic health record-based medical knowledge graph construction, completion, and applications: A literature studyJournal of Biomedical Informatics 2023https://www.sciencedirect.com/science/article/pii/S1532046423001247
Building a knowledge graph to enable precision medicineScientific Data 2023https://www.nature.com/articles/s41597-023-01960-3
7Physics-informed Multimodal NetworksUnsupervised physics-informed disentanglement of multimodal dataFoundations of Data Science 2024Fazakas, Borbalahttps://www.aimsciences.org/article/doi/10.3934/fods.2024019
Advancing Temporal Multimodal Learning with Physics Informed RegularizationCISS 2023https://dl.acm.org/doi/full/10.1145/3689037
Physics-Informed Computer Vision: A Review and PerspectivesACM Computing 2024https://dl.acm.org/doi/full/10.1145/3689037
8Deep Learning in Ultrasound Elastography Deep learning in ultrasound elastography imaging: A reviewMedical Physics 2022Jostan, Jonashttps://aapm.onlinelibrary.wiley.com/doi/10.1002/mp.15856
An unsupervised learning approach to ultrasound strain elastography with spatio-temporal consistencyPhysics in Medicine & Biology 2021https://iopscience.iop.org/article/10.1088/1361-6560/ac176a
Artificial intelligence - based ultrasound elastography for disease evaluation - a narrative reviewFrontiers in Oncology 2023

https://www.frontiersin.org/journals/oncology/articles/10.3389/fonc.2023.1197447/full

9Mesh Reconstruction for 3D Medical ImagingOReX: Object Reconstruction from Planar Cross-sections Using Neural FieldsCVPR 2023Temiz, Kazım Muhammet

https://openaccess.thecvf.com/content/CVPR2023/papers/Sawdayee_OReX_Object_Reconstruction_From_Planar_Cross-Sections_Using_Neural_Fields_CVPR_2023_paper.pdf

Multi-class point cloud completion networks for 3D cardiac anatomy reconstruction from cine magnetic resonance imagesMedIA 2023https://www.sciencedirect.com/science/article/pii/S1361841523002359
X2V: 3D Organ Volume Reconstruction From a Planar X-Ray Image With Neural Implicit MethodsIEEE Access 2024https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10493004
10Video anomaly detection/generation Using PromptGenerating anomalies for video anomaly detection with prompt-based feature mappingCVPR 2023Bamel, Parag

https://openaccess.thecvf.com/content/CVPR2023/html/Liu_Generating_Anomalies_for_Video_Anomaly_Detection_With_Prompt-Based_Feature_Mapping_CVPR_2023_paper.html

Learning prompt-enhanced context features for weakly-supervised video anomaly detectionTIP 2024https://arxiv.org/pdf/2306.14451
Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly DetectionCVPR 2024

https://openaccess.thecvf.com/content/CVPR2024/html/Yang_Text_Prompt_with_Normality_Guidance_for_Weakly_Supervised_Video_Anomaly_CVPR_2024_paper.html

11Deep Learning in Echocardiography AI-driven View Guidance System in Intra-cardiac Echocardiography ImagingArXiv 2024Valera, Patrishttps://arxiv.org/abs/2409.16898
From Sparse to Precise: A Practical Editing Approach for Intracardiac Echocardiography SegmentationMICCAI 2023https://link.springer.com/chapter/10.1007/978-3-031-43901-8_73
CoReEcho: Continuous Representation Learning for 2D+Time Echocardiography AnalysisMICCAI 2024https://link.springer.com/chapter/10.1007/978-3-031-72083-3_55
12LLMs for disease prediction based on non-imaging dataHealth-LLM: Personalized Retrieval-Augmented Disease Prediction SystemArXiv 2024Elghitany, Asmaahttps://arxiv.org/abs/2402.00746
Large Language Models for Disease Diagnosis: A Scoping ReviewArXiv 2024https://arxiv.org/pdf/2409.00097
LLMs-based Few-Shot Disease Predictions using EHR: A Novel Approach Combining Predictive Agent Reasoning and Critical Agent InstructionArXiv 2024https://arxiv.org/html/2403.15464v1
13Best practices for report generation via LLMs based on templateExplainability for Large Language Models: A SurveyACM Transactions on Intelligent Systems and Technology 2024Pospelova, Mariahttps://dl.acm.org/doi/10.1145/3639372
XAI for all: Can large language models simplify explainable AI?ArXiv 2024https://arxiv.org/pdf/2401.13110
Commonsense reasoning and explainable artificial intelligence using large language modelsEuropean Conference on Artificial Intelligence 2023https://link.springer.com/chapter/10.1007/978-3-031-50396-2_17
14Uncertainty Quantification in Neural Fields FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher InformationECCV2024--------------------https://arxiv.org/abs/2311.17874
Bayes' Rays: Uncertainty Quantification for Neural Radiance FieldsCVPR2024

https://openaccess.thecvf.com/content/CVPR2024/html/Goli_Bayes_Rays_Uncertainty_Quantification_for_Neural_Radiance_Fields_CVPR_2024_paper.html

UMedNeRF: Uncertainty-Aware Single View Volumetric Rendering For Medical Neural Radiance FieldsISBI2024https://arxiv.org/abs/2311.05836


  • Keine Stichwörter