Skip to main navigation Skip to search Skip to main content

TBCA-SlowFast: A Spatiotemporal Network for Endoscopic Image-Based Round Window Membrane Puncture Recognition

  • Jiahui Yang
  • , Haifeng Zhu
  • , Zhuowen Zhang
  • , Haozhong Yuan
  • , Yuanyuan Li
  • , Jie Zhao
  • , He Zhang*
  • *Corresponding author for this work
  • School of Mechatronics Engineering, Harbin Institute of Technology
  • CRRC Corporation Limited
  • The Second Affiliated Hospital of Harbin Medical University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Transcanal endoscopic minimally invasive ear surgery features mild trauma, efficient operation and fewer complications compared with traditional otologic surgery. Nevertheless, the confined ear canal space prevents the integration of traditional force sensors, resulting in the absence of real-time perception during round window membrane (RWM) puncture. To tackle this problem, this paper proposes TBCA-SlowFast, an endoscopic image-based recognition network for RWM puncture state detection. Based on the SlowFast baseline, a novel Temporal Branch Coordinate Attention (TBCA) module is embedded to strengthen fine-grained spatiotemporal feature extraction and suppress complex surgical background noise. A simulated RWM puncture dataset is established for model training and evaluation. Experimental results demonstrate that TBCA-SlowFast reaches a recognition accuracy of 88.23%, outperforming the original SlowFast by 1.96%. The lightweight TBCA module only brings slight increases in parameters (0.7M) and computation (14.1M FLOPs), striking a favorable balance between accuracy and real-time capability. This method can provide stable intraoperative feedback, reduce needle over-insertion risks, and improve the overall safety and reliability of transcanal minimally invasive ear surgery.

Original languageEnglish
Title of host publication2026 IEEE 20th International Conference on Control and Automation, ICCA 2026
PublisherIEEE Computer Society
Pages1466-1471
Number of pages6
ISBN (Electronic)9798331548537
DOIs
StatePublished - 2026
Externally publishedYes
Event20th IEEE International Conference on Control and Automation, ICCA 2026 - Almaty, Kazakhstan
Duration: 16 Jun 202619 Jun 2026

Publication series

NameIEEE International Conference on Control and Automation, ICCA
ISSN (Print)1948-3449
ISSN (Electronic)1948-3457

Conference

Conference20th IEEE International Conference on Control and Automation, ICCA 2026
Country/TerritoryKazakhstan
CityAlmaty
Period16/06/2619/06/26

Fingerprint

Dive into the research topics of 'TBCA-SlowFast: A Spatiotemporal Network for Endoscopic Image-Based Round Window Membrane Puncture Recognition'. Together they form a unique fingerprint.

Cite this