PlumX Metrics
Embed PlumX Metrics

Cross Pyramid Transformer makes U-net stronger in medical image segmentation

Biomedical Signal Processing and Control, ISSN: 1746-8094, Vol: 86, Page: 105361
2023
  • 4
    Citations
  • 0
    Usage
  • 11
    Captures
  • 0
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Citations
    4
    • Citation Indexes
      4
  • Captures
    11

Article Description

Accurate auto-medical image segmentation, which is essential in disease diagnosis and treatment planning, has been significantly prospered by recent advances in Convolution Neural Network (CNN) and Transformer. However, pure CNN-based or pure Transformer-base architectures exhibit limitations for segmentation tasks. For example, CNN fails to capture long-range relations due to fix receptive fields, and Transformer ignores pixel-level spatial details of features. To address these challenges, we propose a novel parallel hybrid architecture for medical image segmentation, which is named CPT-Unet (Cross Pyramid Transformer U-shape Network). CPT-Unet may be the first attempt to exploit both the advantages of Pyramid Vision Transformer (PVT) and CNN to the full by integrating them into the standard U-shape network to improve the segmentation performance and inference time. Specifically, we design a parallel dual branch encoder and decoder in CPT-Unet that consists of CNN and PVT. The input image is fed into the encoder of these two branches simultaneously to extract low-level spatial details and global contexts in a much shallower way. We design a novel fusion strategy to adequately utilize the multi-scale features extracted from CNN and PVT. We also add PVT in the decoder to better restore the segmentation map. Experiments on two public segmentation datasets demonstrate the improved performance of the proposed CPT-Unet over the comparison methods. The source code is available at https://github.com/ShengYue007/CPT-Unet.git.

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know