TY - GEN
T1 - Research and experiment of lip coordination with speech for the humanoid head robot-"H & Frobot-III"
AU - Qingmei, Meng
AU - Weiguo, Wu
AU - Yusheng, Zhong
AU - Ce, Song
PY - 2008
Y1 - 2008
N2 - This paper proposes a method of lip shape coordination with speech in the facial expression robot system "H&Frobot-III". The proposed method can model the talking robot's lip shape using visual speech system, which includes three modules: speech recognition, lip shape recognition and lip pose actuator. In the lip shape recognition module, a viseme representation method is proposed for synthesising the human visual speech. To analyze the robot's lip shape, Lip shape model is developed based on the anatomy and facial action coding system (FACS). When robot speaking, the lip shape coordination with speech can be realized through basic lip shape or the combination of basic lip shape. In the "H&Frobot-III" system, the lip shape is realized through slide and guide slot mechanism, which implements the two-way movement of muscle in the lip. Finally, the result of the experiment, which is the lip coordination with speech, is shown. When speaking same word, the lip shape of robot is similarity to that of human.
AB - This paper proposes a method of lip shape coordination with speech in the facial expression robot system "H&Frobot-III". The proposed method can model the talking robot's lip shape using visual speech system, which includes three modules: speech recognition, lip shape recognition and lip pose actuator. In the lip shape recognition module, a viseme representation method is proposed for synthesising the human visual speech. To analyze the robot's lip shape, Lip shape model is developed based on the anatomy and facial action coding system (FACS). When robot speaking, the lip shape coordination with speech can be realized through basic lip shape or the combination of basic lip shape. In the "H&Frobot-III" system, the lip shape is realized through slide and guide slot mechanism, which implements the two-way movement of muscle in the lip. Finally, the result of the experiment, which is the lip coordination with speech, is shown. When speaking same word, the lip shape of robot is similarity to that of human.
UR - https://www.scopus.com/pages/publications/63749097065
U2 - 10.1109/ICHR.2008.4756012
DO - 10.1109/ICHR.2008.4756012
M3 - 会议稿件
AN - SCOPUS:63749097065
SN - 9781424428229
T3 - 2008 8th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2008
SP - 603
EP - 608
BT - 2008 8th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2008
PB - IEEE Computer Society
T2 - 8th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2008
Y2 - 1 December 2008 through 3 December 2008
ER -