TY - GEN
T1 - EdgeReg
T2 - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
AU - Liu, Jun
AU - Wang, Wenyi
AU - Wang, Wei
AU - Luo, Gongning
AU - Li, Yacong
AU - Wang, Kuanquan
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Medical image registration (MIR) is essential for various clinical diagnoses and treatments. Despite the rapid progress in deep learning-based MIR techniques, most methods focus on directly optimizing the raw image intensity information. In this paper, we explore the usage of edge information of anatomical structures associated with the spatial location of image intensities to assist in registration, termed EdgeReg. The intuition is that the edge information can provide additional rich boundary information to the raw images, enhancing the network's feature representation. Additionally, as the edge images are strictly spatially consistent with the raw images, additional supervised information can be added to network training. Specifically, we first extract the edge images from the raw moving and fixed images using the Sobel operator and feed these images into a lightweight feature extractor to merge the image intensity and edge information. The enriched features are subsequently input into established registration networks. Finally, similarity loss is applied to both the raw and edge images. Extensive experiments show that EdgeReg is compatible with various networks across diverse datasets and dimensions (2D and 3D), achieving superior registration performance. In particular, EdgeReg does not rely on segmentation labels and is trained in an unsupervised paradigm. Therefore, edge information is a beneficial assistance for unsupervised MIR. The code is available at https://github.com/PerceptionComputingLab/EdgeReg.
AB - Medical image registration (MIR) is essential for various clinical diagnoses and treatments. Despite the rapid progress in deep learning-based MIR techniques, most methods focus on directly optimizing the raw image intensity information. In this paper, we explore the usage of edge information of anatomical structures associated with the spatial location of image intensities to assist in registration, termed EdgeReg. The intuition is that the edge information can provide additional rich boundary information to the raw images, enhancing the network's feature representation. Additionally, as the edge images are strictly spatially consistent with the raw images, additional supervised information can be added to network training. Specifically, we first extract the edge images from the raw moving and fixed images using the Sobel operator and feed these images into a lightweight feature extractor to merge the image intensity and edge information. The enriched features are subsequently input into established registration networks. Finally, similarity loss is applied to both the raw and edge images. Extensive experiments show that EdgeReg is compatible with various networks across diverse datasets and dimensions (2D and 3D), achieving superior registration performance. In particular, EdgeReg does not rely on segmentation labels and is trained in an unsupervised paradigm. Therefore, edge information is a beneficial assistance for unsupervised MIR. The code is available at https://github.com/PerceptionComputingLab/EdgeReg.
KW - edge image
KW - medical image registration
KW - unsupervised learning
UR - https://www.scopus.com/pages/publications/85217281375
U2 - 10.1109/BIBM62325.2024.10822409
DO - 10.1109/BIBM62325.2024.10822409
M3 - 会议稿件
AN - SCOPUS:85217281375
T3 - Proceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
SP - 3543
EP - 3548
BT - Proceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
A2 - Cannataro, Mario
A2 - Zheng, Huiru
A2 - Gao, Lin
A2 - Cheng, Jianlin
A2 - de Miranda, Joao Luis
A2 - Zumpano, Ester
A2 - Hu, Xiaohua
A2 - Cho, Young-Rae
A2 - Park, Taesung
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 3 December 2024 through 6 December 2024
ER -