Skip to main navigation Skip to search Skip to main content

Expert-Guided Cross-View Fusion With Self-Derived Lesion Proposals for Multi-View Diabetic Retinopathy Grading

  • Wai Keung Wong
  • , Wenzhe Liu
  • , Xueling Zhou
  • , Junlin Hou
  • , Yuxin Lin*
  • , Jie Wen
  • *Corresponding author for this work
  • Hong Kong Polytechnic University
  • Laboratory for Artificial Intelligence in Design
  • Huzhou Normal University
  • Dongguan University of Technology
  • Hong Kong University of Science and Technology
  • Shantou University
  • Harbin Institute of Technology Shenzhen

Research output: Contribution to journalArticlepeer-review

Abstract

Recent advances in multi-view fundus imaging show great promise for automated diabetic retinopathy (DR) grading. However, mainstream end-to-end CNN/Transformer pipelines rely on striding or tokenization that compresses spatial detail, causing small, low-contrast lesions (e.g., microaneurysms) to be under-represented and creating performance ceilings. Prior efforts have mitigated this by incorporating external lesion- or vessel-level annotations into models. However, such labels are costly to acquire, break the end-to-end training, and make performance over-reliant on the annotation quality. To reduce dependence on expensive annotations, we propose an end-to-end framework that generates lesion proposals on the fly during training and inference, providing self-derived cues for grading. First, we introduce a Grade-Activated Lesion Proposal (GALP) module that derives grade-conditioned evidence maps (GEMs) from stage-wise auxiliary classifiers and selects the top-K high-evidence regions per view as lesion proposals. Second, we propose a Cross-View Lesion Expert Guided Regional Fusion (LGRF) module, which selectively activates experts for a view's lesion proposals based on contextual guidance from other views, ensuring that only the most relevant feature extractors contribute to fusion. Experimental results on two multi-view DR datasets show that our method matches or surpasses strong baselines without external annotations, confirming that self-generated proposals can substantially reduce annotation needs.

Original languageEnglish
Pages (from-to)6446-6459
Number of pages14
JournalIEEE Transactions on Image Processing
Volume35
DOIs
StatePublished - 2026
Externally publishedYes

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • Multi-view learning
  • diabetic retinopathy grading
  • feature extraction
  • fundus images analysis

Fingerprint

Dive into the research topics of 'Expert-Guided Cross-View Fusion With Self-Derived Lesion Proposals for Multi-View Diabetic Retinopathy Grading'. Together they form a unique fingerprint.

Cite this