Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

The variational autoencoder paradigm demystified

less than 10 minute read

Published:

This post is aimed at those who want to understand the mathematical framework of variational autoencoders and its implementation in deep learning.

The transformer paradigm demystified

less than 10 minute read

Published:

Are you interested in understanding the mathematics that underlie the transformer? If so, this post is tailored for you!

publications

CMRSegTools: An open-source software enabling reproducible research in segmentation of acute myocardial infarct in CMR images

Published in Plos one, 2022

This paper introduces CMRSegTools: an open-source application software designed for the segmentation and quantification of myocardial infarct lesion enabling full access to state-of-the-art segmentation methods and parameters, easy integration of new algorithms and standardised results sharing.

Recommended citation: Romero, William (2022). "CMRSegTools: An open-source software enabling reproducible research in segmentation of acute myocardial infarct in CMR images." Plos one. 17(9). https://hal.science/hal-04215855

A Pipeline for the Generation of Synthetic Cardiac Color Doppler

Published in IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2022

We present a numerical framework for generating clinical-like Color Doppler imaging. Synthetic blood vector fields were obtained from a patient-specific computational fluid dynamics CFD model.

Recommended citation: Sun, Yunyun (2022). "A Pipeline for the Generation of Synthetic Cardiac Color Doppler." IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 69(3). https://cnrs.hal.science/hal-03538666

Deep Learning vs manual techniques for assessing left ventricular ejection fraction in 2D echocardiography: validation against CMR

Published in medRxiv, 2022

We evaluate the accuracy and reproducibility of 2D echocardiography left ventricular volumes and ejection fraction estimates by Deep Learning versus manual contouring and against CMR.

Recommended citation: Saloux, Eric (2022). "Deep Learning vs manual techniques for assessing left ventricular ejection fraction in 2D echocardiography: validation against CMR." medRxiv. https://www.medrxiv.org/content/10.1101/2022.07.26.22278059v1

Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

Published in IEEE Transactions on Medical Imaging, 2022

We propose a novel deep learning solution for motion estimation in echocardiography. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences.

Recommended citation: Evain, Ewan (2022). "Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation." IEEE Transactions on Medical Imaging. 41(8). https://hal.science/hal-03603014

CRISP - Reliable Uncertainty Estimation for Medical Image Segmentation

Published in Medical Image Computing and Computer Assisted Intervention -- MICCAI, 2022

We propose a method called CRISP for uncertainty prediction of image segmentation. CRISP implements a contrastive method to learn a joint latent space which encodes a distribution of valid segmentations and their corresponding images.

Recommended citation: Judge, Thierry (2022). "CRISP - Reliable Uncertainty Estimation for Medical Image Segmentation." Medical Image Computing and Computer Assisted Intervention -- MICCAI. https://hal.science/hal-04215854

Echocardiography Segmentation With Enforced Temporal Consistency

Published in IEEE Transactions on Medical Imaging, 2022

We propose a framework to learn the 2D+time apical long-axis cardiac shape such that the segmented sequences can benefit from temporal and anatomical consistency constraints.

Recommended citation: Painchaud, Nathan (2022). "Echocardiography Segmentation With Enforced Temporal Consistency." IEEE Transactions on Medical Imaging. 41(10). https://hal.science/hal-03672999

Phase unwrapping of color Doppler echocardiography using deep learning

Published in IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2023

We developed an unfolded primal-dual network to unwrap (dealias) color Doppler echocardiographic images and compared its effectiveness against two state-of-the-art segmentation approaches based on nnU-Net and transformer models.

Recommended citation: Ling, Hang Jung (2023). "Phase unwrapping of color Doppler echocardiography using deep learning." IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 70(8). https://hal.science/hal-04142824v2

Ultrafast Cardiac Imaging Using Deep Learning For Speckle-Tracking Echocardiography

Published in IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2023

We developped a complex-weighted convolutional neural network (CNN) for ultrasound images. We showed that our method allows reconstructing high-quality static images while maintaining the capability of tracking cardiac motion

Recommended citation: Lu, Jingfeng (2023). "Ultrafast Cardiac Imaging Using Deep Learning For Speckle-Tracking Echocardiography." IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. https://arxiv.org/abs/2306.14265

Asymmetric Contour Uncertainty Estimation for Medical Image Segmentation

Published in Medical Image Computing and Computer Assisted Intervention -- MICCAI, 2023

We propose explicitly modeling location uncertainty by redefining the segmentation task as contour regression, providing improved performance and interpretability.

Recommended citation: Judge, Thierry (2023). "Asymmetric Contour Uncertainty Estimation for Medical Image Segmentation." Medical Image Computing and Computer Assisted Intervention -- MICCAI. https://hal.science/hal-04243975v1

research

Realistic simulations of echocardiographic sequences

We have developed a simulation pipeline to generate realistic synthetic echocardiographic sequences. This pipeline is currently being used to generate a large-scale cohort of virtual patients to feed deep learning methods.

Representation learning for gold standard segmentation generation

We have developed a strategy based on learning the representation of plausible cardiac shapes to efficiently generate gold standard annotations. This pipeline has been successfully applied to two other tasks: the simulation of realistic echocardiographic sequences and the generalization of segmentation tools.

talks

Generative models - variational auto-encoder

Published:

In this presentation, I taught the formalism of the variational auto-encoder and emphasized the importance of creating specialized latent spaces using various examples. I then described the auto-encoder formalism and highlighted the additional advantages of the variational approach. I concluded by showing how we have exploited this formalism in order to i) provide guarantees on the segmented anatomical structures; ii) provide guarantees on the temporal consistency of the segmented shapes; iii) model the uncertainty of the segmentation algorithm.

Segmentation in echocardiography: is the problem finally solved ?

Published:

Deep learning methods have allowed major advances in many specific areas such as echocardiogram analysis, view classification, recognition and segmentation of anatomical structures, user guidance or even automatic report generation. Moreover, the combination of these different techniques allows the deployment of complete and fully automated processing chains, making it possible to increase the reliability of clinical measurements and facilitate the use of ultrasound scanners outside of hospitals. In this talk, I described the various advances we have made using the deep learning paradigm for echocardigraphy image segmentation.

Physical simulations for deep learning: applications to image formation and motion estimation

Published:

In recent years, artificial intelligence (AI) techniques have shown remarkable success in the field of medical imaging. While supervised learning approaches currently stand as the most effective methods, they rely heavily on ground truth data usually obtained from manual annotations, which often poses challenges across diverse applications. In this presentation, I introduced a comprehensive pipeline aimed at generating realistic simulations of echocardiographic image sequences to be used as inputs for supervised learning algorithms. I showcased their application in two different areas: tissue motion estimation in traditional imaging and ultra-fast cardiac image reconstruction.

On the integration of robust AI-based image information for continuous patient stratification

Published:

AI paradigm now enables automatic and robust extraction of cardiac function descriptors from echocardiographic sequences, such as ejection fraction or strain. These descriptors provide fine-grained information that physicians consider, in conjunction with more global variables from the clinical record, to assess patients’ condition. In this presentation, I introduced a recently developed transformer-based framework that takes into account all descriptors extracted from medical records and echocardiograms. The framework aims to learn the representation of a challenging cardiovascular pathology, specifically hypertension. I showed that for descriptors whose interactions with hypertension are well documented, patterns are consistent with prior physiological knowledge, paving the way for further clinical studies to better understand this disease.

teaching

Signal modeling

Course, INSA, university of Lyon, electrical department, 2023

French course on signal modeling. The following aspects are covered: basic signals / elementary operations, linear time-invariant systems, Fourier transform.

Sampling and quantization

Course, INSA, university of Lyon, electrical department, 2023

French course on signal sampling and quantization. The following aspects are covered: modeling of the sampling and quantization operations, energy assessment of the acquisition chain.

Neural networks

Course, INSA, university of Lyon, electrical department, 2023

French course on neural network. The following aspects are covered: modeling of a perceptron, modeling of a neural network, activation functions, backpropagation principle, loss function, gradient descent needs.

Optimization of neural networks

Course, INSA, university of Lyon, electrical department, 2023

French course on the optimization steps involved in neural networks. The following aspects are covered: mini-batch gradient descent, momentum/RMSprop/ADAM scheme, batch normalization, dropout, training/validation/test scheme.

Convolutional neural networks

Course, INSA, university of Lyon, electrical department, 2023

French course on convolutional neural network. The following aspects are covered: convolutional layer, feature maps, receptive field, classification, segmentation.

Variational Auto-encoders

Course, INSA, university of Lyon, electrical department, 2023

French course on variational auto-encoder networks. The following aspects are covered: fundamental concepts, Kullback-Liebler divergence, variational inference, VAE architectures. The complete derivation of the VAE equations can be found in this post

Transformers

Course, INSA, university of Lyon, electrical department, 2023

French course on transformers. The following aspects are covered: tokenisation, positional embeding, encoding blocs, self-attention module, multi-head attention, vision transformer. A complementary description of the transformer paradigm can be found in this post