Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation

Hanwei Ma; Bowen Chen; Weihong Ren; Ziheng Wang; Zhiyong Wang; Weibo Jiang; Ruihan Lin; Honghai Liu

doi:10.1007/978-3-031-13844-7_35

Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation

Hanwei Ma
, Bowen Chen
, Weihong Ren
, Ziheng Wang
, Zhiyong Wang
, Weibo Jiang
, Ruihan Lin
, Honghai Liu^*

^*Corresponding author for this work

Harbin Institute of Technology Shenzhen
Peng Cheng Laboratory
Shanghai Jiao Tong University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Autism spectrum disorders is a range of neurodevelopmental conditions primarily characterized by difficulties in social interactions, differences in communication, and presentations of rigid and repetitive behavior. The evidence shows that the functional social behavior of children with autism can be enhanced by early intervention. However, traditional intervention methods meet problems, e.g., assessment results are varied from one clinician to another while sometimes children are lack of interest in intervention. To address these problems, we design a computer-aided motion imitation assessment system based on human pose estimation in this paper. The system is implemented by Unity3D. We recruit 10 people (5 people with imitation ability defect and 5 people without imitation ability defect) participated in the experiment, and the result shows that the system can effectively evaluate the motion imitation ability. Finally, three future development directions of the system are further discussed for better application in autistic early intervention.

Original language	English
Title of host publication	Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings
Editors	Honghai Liu, Weihong Ren, Zhouping Yin, Lianqing Liu, Li Jiang, Guoying Gu, Xinyu Wu
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	360-369
Number of pages	10
ISBN (Print)	9783031138430
DOIs	https://doi.org/10.1007/978-3-031-13844-7_35
State	Published - 2022
Externally published	Yes
Event	15th International Conference on Intelligent Robotics and Applications, ICIRA 2022 - Harbin, China Duration: 1 Aug 2022 → 3 Aug 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13455 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th International Conference on Intelligent Robotics and Applications, ICIRA 2022
Country/Territory	China
City	Harbin
Period	1/08/22 → 3/08/22

Keywords

Autism spectrum disorder
Early intervention
Human pose estimation
Imitative ability

Access to Document

10.1007/978-3-031-13844-7_35

Cite this

Ma, H., Chen, B., Ren, W., Wang, Z., Wang, Z., Jiang, W., Lin, R., & Liu, H. (2022). Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation. In H. Liu, W. Ren, Z. Yin, L. Liu, L. Jiang, G. Gu, & X. Wu (Eds.), Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings (pp. 360-369). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13455 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-13844-7_35

Ma, Hanwei ; Chen, Bowen ; Ren, Weihong et al. / Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation. Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings. editor / Honghai Liu ; Weihong Ren ; Zhouping Yin ; Lianqing Liu ; Li Jiang ; Guoying Gu ; Xinyu Wu. Springer Science and Business Media Deutschland GmbH, 2022. pp. 360-369 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{6cafd65d332d494c9cf6b0bfa11b8ee9,

title = "Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation",

abstract = "Autism spectrum disorders is a range of neurodevelopmental conditions primarily characterized by difficulties in social interactions, differences in communication, and presentations of rigid and repetitive behavior. The evidence shows that the functional social behavior of children with autism can be enhanced by early intervention. However, traditional intervention methods meet problems, e.g., assessment results are varied from one clinician to another while sometimes children are lack of interest in intervention. To address these problems, we design a computer-aided motion imitation assessment system based on human pose estimation in this paper. The system is implemented by Unity3D. We recruit 10 people (5 people with imitation ability defect and 5 people without imitation ability defect) participated in the experiment, and the result shows that the system can effectively evaluate the motion imitation ability. Finally, three future development directions of the system are further discussed for better application in autistic early intervention.",

keywords = "Autism spectrum disorder, Early intervention, Human pose estimation, Imitative ability",

author = "Hanwei Ma and Bowen Chen and Weihong Ren and Ziheng Wang and Zhiyong Wang and Weibo Jiang and Ruihan Lin and Honghai Liu",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 15th International Conference on Intelligent Robotics and Applications, ICIRA 2022 ; Conference date: 01-08-2022 Through 03-08-2022",

year = "2022",

doi = "10.1007/978-3-031-13844-7\_35",

language = "英语",

isbn = "9783031138430",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "360--369",

editor = "Honghai Liu and Weihong Ren and Zhouping Yin and Lianqing Liu and Li Jiang and Guoying Gu and Xinyu Wu",

booktitle = "Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings",

address = "德国",

}

Ma, H, Chen, B, Ren, W, Wang, Z, Wang, Z, Jiang, W, Lin, R & Liu, H 2022, Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation. in H Liu, W Ren, Z Yin, L Liu, L Jiang, G Gu & X Wu (eds), Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13455 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 360-369, 15th International Conference on Intelligent Robotics and Applications, ICIRA 2022, Harbin, China, 1/08/22. https://doi.org/10.1007/978-3-031-13844-7_35

Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation. / Ma, Hanwei; Chen, Bowen; Ren, Weihong et al.
Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings. ed. / Honghai Liu; Weihong Ren; Zhouping Yin; Lianqing Liu; Li Jiang; Guoying Gu; Xinyu Wu. Springer Science and Business Media Deutschland GmbH, 2022. p. 360-369 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13455 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation

AU - Ma, Hanwei

AU - Chen, Bowen

AU - Ren, Weihong

AU - Wang, Ziheng

AU - Wang, Zhiyong

AU - Jiang, Weibo

AU - Lin, Ruihan

AU - Liu, Honghai

PY - 2022

Y1 - 2022

N2 - Autism spectrum disorders is a range of neurodevelopmental conditions primarily characterized by difficulties in social interactions, differences in communication, and presentations of rigid and repetitive behavior. The evidence shows that the functional social behavior of children with autism can be enhanced by early intervention. However, traditional intervention methods meet problems, e.g., assessment results are varied from one clinician to another while sometimes children are lack of interest in intervention. To address these problems, we design a computer-aided motion imitation assessment system based on human pose estimation in this paper. The system is implemented by Unity3D. We recruit 10 people (5 people with imitation ability defect and 5 people without imitation ability defect) participated in the experiment, and the result shows that the system can effectively evaluate the motion imitation ability. Finally, three future development directions of the system are further discussed for better application in autistic early intervention.

AB - Autism spectrum disorders is a range of neurodevelopmental conditions primarily characterized by difficulties in social interactions, differences in communication, and presentations of rigid and repetitive behavior. The evidence shows that the functional social behavior of children with autism can be enhanced by early intervention. However, traditional intervention methods meet problems, e.g., assessment results are varied from one clinician to another while sometimes children are lack of interest in intervention. To address these problems, we design a computer-aided motion imitation assessment system based on human pose estimation in this paper. The system is implemented by Unity3D. We recruit 10 people (5 people with imitation ability defect and 5 people without imitation ability defect) participated in the experiment, and the result shows that the system can effectively evaluate the motion imitation ability. Finally, three future development directions of the system are further discussed for better application in autistic early intervention.

KW - Autism spectrum disorder

KW - Early intervention

KW - Human pose estimation

KW - Imitative ability

UR - https://www.scopus.com/pages/publications/85135818083

U2 - 10.1007/978-3-031-13844-7_35

DO - 10.1007/978-3-031-13844-7_35

M3 - 会议稿件

AN - SCOPUS:85135818083

SN - 9783031138430

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 360

EP - 369

BT - Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings

A2 - Liu, Honghai

A2 - Ren, Weihong

A2 - Yin, Zhouping

A2 - Liu, Lianqing

A2 - Jiang, Li

A2 - Gu, Guoying

A2 - Wu, Xinyu

PB - Springer Science and Business Media Deutschland GmbH

T2 - 15th International Conference on Intelligent Robotics and Applications, ICIRA 2022

Y2 - 1 August 2022 through 3 August 2022

ER -

Ma H, Chen B, Ren W, Wang Z, Wang Z, Jiang W et al. Assessment System for Imitative Ability for Children with Autism Spectrum Disorder Based on Human Pose Estimation. In Liu H, Ren W, Yin Z, Liu L, Jiang L, Gu G, Wu X, editors, Intelligent Robotics and Applications - 15th International Conference, ICIRA 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 360-369. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-13844-7_35