Reference
Learn2Reg: Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning 👉
Abstract
Medical image registration plays a very important role in improving clinical workflows, computer-assisted interventions and diagnosis as well as for research studies involving e.g. morphological analysis. Besides ongoing research into new concepts for optimisation, similarity metrics, domain adaptation and deformation models, deep learning for medical registration is currently starting to show promising advances that could improve the robustness, generalisation, computation speed and accuracy of conventional algorithms to enable better practical translation. Nevertheless, before Learn2Reg there was no commonly used benchmark dataset to compare stateof-the-art learning based registration among another and with their conventional (not trained) counterparts. With few exceptions (CuRIOUS at MICCAI 2018/2019, the Continuous Registration Challenge at WBIR 2018 and Learn2Reg 2020) there has also been no comprehensive registration challenge covering different anatomical structures and evaluation metrics. We also believe that the entry barrier for new teams to contribute to this emerging field are higher than e.g. for segmentation, where standardised datasets (e.g. Medical Decathlon, BraTS) are easily available. In contrast, many registration tasks, require resampling from different voxel spacings, affine pre-registration and can lead to ambiguous and error-prone evaluation of whole deformation fields. We propose a simplified challenge design that removes many of the common pitfalls for learning and applying transformations. We will provide pre-preprocessed data (resample, crop, pre-align, etc.) that can be directly employed by most conventional and learning frameworks. Only docker containers that generate displacement fields in voxel dimensions in a standard orientation will have to be provided by participants and python code to test their application (on local machines) to training data will be provided as open-source along with all evaluation metrics. Our challenge will consist of three clinically relevant sub-tasks (datasets) that are complementary in nature. They can either be individually or comprehensively addressed by participants and cover both intra- and inter-patient alignment, CT, ultrasound and MRI modalities, neuro-, thorax and abdominal anatomies and the four of the imminent challenges of medical image registration:
- learning from small datasets
- estimating large deformations
- dealing with multi-modal scans
- learning from noisy annotations
黄色部分 是可以直接引用在论文写作中的;黑体部分 是 Learn2Reg2021 的意义和提供的数据集以及提出的挑战。
Task 03: Whole Brain MRI
Abstract
皮层下和脑深部结构涉及许多认知、记忆和情绪任务。众所周知,海马体与衰老、记忆和空间导航有关。全脑 MRI 的区域分析也被确定为阿尔茨海默病、精神分裂症和癫痫的病理生理学的关键指标。
Subcortical and deep brain structures are involved in many cognitive, memory and emotional tasks. The hippocampus e.g. is known to be involved in aging, memory, and spatial navigation. Regional analysis of whole brain MRI has also been identified as a key indicator for pathophysiology of Alzheimer’s disease, schizophrenia, and epilepsy.
这项任务的挑战是在不同患者之间,在单模态 MRI 图像上以高精度对齐形状和大小可变的小结构。与其他任务相比,这种配准预计更容易估计:有较小的变形,MRI 中结构的对比度足够,并且在对齐之前解剖结构通常至少部分重叠。
我们还期望对基于学习的配准有新的见解,因为这是一个包含大量有标注的 3D 扫描的大型数据集。 OASIS dataset project 包含数百个神经成像数据集,专门专注于自由共享数据。
我们已经预处理了一个由 400 个大脑组成的重要亚组,分为训练(300)、验证(50)和测试(50)。我们使用几个软件包(FreeSurfer 7.1 和 SAMSEG)计算了包含 40 个皮质和皮质下解剖标签的分割图。我们将融合这些标签图,并在 MGH 神经科学家的帮助下手动验证所有 400 次扫描。
We have pre-processed a significant subgroup of 400 brains split among train (300), validation (50), and test (50).
Keywords
inter-patient, MRI, brain, small deformation
Cohorts
-
Target cohorts - 哪些主体 / 对象将在最终的应用中获得有用的数据?
神经影像学配准是神经科学和临床治疗的一个重要部分,并规划了一系列疾病和程序,如神经退行性疾病(AD、精神分裂症、癫痫)或肿瘤切除术。
Neuroimaging registration is an important part of neuroscience and clinical treatment and planning for a wide range of diseases and procedures, such as neurodegenerative diseases (AD, schizophrenia, epilepsy) or tumor resections.
-
challenge cohort - 获取这些数据的主体 / 对象。
该数据集是 OASIS 数据集项目的一部分 T1w MRI,其中包含数百个神经成像数据集,受试者年龄从 42 岁到 95 岁不等,涵盖正常人以及处于不同认知衰退阶段的受试者。
The dataset consists of T1w MRIs acquired as part of the OASIS dataset project (https://www.oasis-brains.org/)
Imaging modality(ies)
Magnetic Resonance Imaging (MRI)
Algorithm target
即,说明算法设计用于关注的结构 / 主题 / 对象 / 组件(例如大脑肿瘤、医疗器械尖端、手术室护士、透视扫描中的导管)。
算法应该关注全脑 MRI 重要的神经解剖学区域:皮质、皮质下和脑深部结构。实现在同一模态(MRI)内,跨患者的皮质下和脑深部解剖结构的高度精确配准
Whole brain MRI showing important neuroanatomical regions: cortical, subcortical and deep brain structures. Highly accurate alignment of subcortical and deep brain anatomy across patients within the same modality (MRI)
Training and test case characteristics
数据是获取的或重塑到 T1-weighted MRI 全脑扫描的 1x1x1mm 各向同性分辨率。
-
说明训练、验证和测试案例的总数。
Training: 300 cases + 50 validation
Test: 50 cases
足够大的训练集得以可靠地训练深层网络。Sufficiently large number to robustly train deep networks.
手动分割标签的特征
Annotation characteristics
40 个小结构(皮质下和脑深部)的自动自由曲面分割,手动验证。所使用的软件是 FreeSurfer 7.1 和 SAMSEG。
数据预处理
Data pre-processing method(s)
提供相同体素分辨率的通用预处理、强度标准化和空间维度以及仿射预配准,以便于先前在图像配准方面经验不足的参与者使用基于学习的算法。
Common pre-processing to same voxel resolutions, intensity normalization, and spatial dimensions as well as affine pre-registration will be provided to ease the use of learning-based algorithms for participants with little prior experience in image registration.
误差来源
先前的研究表明,在所有结构中,标注者之间的一致性达到超过 75% 的 Dice 值,但这些差异很大。某些深层结构(如丘脑)缺乏明显的对比,而皮层缺乏足够的分辨率。
指标
- DSC (Dice similarity coefficient) of segmentations
- HD95 (95% percentile of Haussdorff distance) of segmentations
- Robustness: 30% lowest DSC of all cases
- SD (standard deviation) of log Jacobian determinant
- Run-time computation time
DSC 或 TRE 度量准确度;HD95 度量可靠性;使用稳健性得分(最低平均 DSC 的 30% 或最高平均 TRE 的 30%)对异常值进行惩罚;变形场的平滑度(对数雅可比行列式的标准差)在配准中很重要;运行时计算时间与临床应用相关。
我们认为逆一致性(inverse consistency)是一个附加的度量标准,这在医学图像配准中是有争议的。我们决定不使用它作为竞争(排名)指标,而是出于信息的原因(即逆一致算法是否更稳健的问题)计算它。
Baselines
我们将提供几种 baseline 算法来比较你的方法,包括:
- PDD-Net (MICCAI '19) unsupervised training
- Voxelmorph (CVPR’18) with and without label supervision
- Deeds
- Elastix, NiftyReg, and/or ANTs (where applicable)
得益于 MICCAI 2020 的成功经验,我们有信心为模态域迁移、无监督/弱监督学习、几何网络等前沿深度学习主题提供极具洞察力的新发现。。
provide very insightful new findings for cutting-edge deep learning topics such as domain adaptation, unsupervised/weaklysupervised learning, geometric networks, etc…