2024-04-22-2023-CIBM-Multi-Stage Hybrid Attention Network for MRI reconstruction and SR

Motivation:

Framework:

Experiment:

Limitation and future work

The proposed MHAN has some limitations. First, in practice, this multi-task network may need to deal with different masks and scaling factors than in the pre-training. Due to the limited memory of MR Scanners, it is not cost-effective to train a model for every case as in the previous section. Second, our method is explored based on single-coil data, which is still a certain distance from practical applications since commercial MR Scanner usually acquires multi-coil data. Third,
the medical data captured by MR Scanner is in 3D format. However, our model mainly targets the reconstruction of 2D images, which inevitably loses the spatial correlation information. In the future, we will devote ourselves to improving the generalization ability of our model and achieving reconstruction of arbitrary under-sampled patterns and SR of continuous scaling factors by fine-
tuning some hyperparameters. In addition, a typical MRI protocol comprises a set of pulse sequences to provide multi-contrast images (e.g., T1, T2, PD, FSPD), which have inter-modality consistent and modality-specific information. It is a worthy try to restore the target modality from its low-resolution under-sampled counterpart with the guidance of the auxiliary modality.