Skip to main navigation Skip to search Skip to main content

Braille Recognition Algorithm Based on Robotic Arm Active Tactile Perception

  • Mingkun Chen
  • , Xing Lin
  • , Ruikai Liu
  • , Yunjiang Lou*
  • *Corresponding author for this work
  • School of Robotics and Advanced Manufacture, Harbin Institute of Technology Shenzhen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With limited Braille literacy among the visually impaired, assistive technologies that do not depend on prior Braille knowledge are urgently needed. This study presents a Braille recognition framework using PyBullet simulation and a KUKA iiwa robotic arm to actively acquire tactile data from Braille characters. A deep neural network (DNN) is trained on 19-dimensional features combining statistical and temporal force signals. The dataset includes 5,000 custom Braille characters based on a 4×4 dot matrix and 2,000 Chinese Braille characters. The system captures both normal and tangential forces during contact. Experimental results show that recognition accuracy is up to 92 % across both datasets. The proposed method is low-cost, repeatable, and effective for tactile Braille recognition, offering practical potential for blind assistance and Braille education in resource-constrained environments.

Original languageEnglish
Title of host publicationProceedings of 2025 IEEE 26th China Conference on System Simulation Technology and its Applications, CCSSTA 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-45
Number of pages6
ISBN (Electronic)9798331544041
DOIs
StatePublished - 2025
Externally publishedYes
Event26th IEEE China Conference on System Simulation Technology and its Applications, CCSSTA 2025 - Shenzhen, China
Duration: 11 Jul 202513 Jul 2025

Publication series

NameProceedings of 2025 IEEE 26th China Conference on System Simulation Technology and its Applications, CCSSTA 2025

Conference

Conference26th IEEE China Conference on System Simulation Technology and its Applications, CCSSTA 2025
Country/TerritoryChina
CityShenzhen
Period11/07/2513/07/25

Keywords

  • Braille Recognition
  • Deep Neural Network
  • Simulation
  • Tactile Perception

Fingerprint

Dive into the research topics of 'Braille Recognition Algorithm Based on Robotic Arm Active Tactile Perception'. Together they form a unique fingerprint.

Cite this