Human Body Modeling for Heterogenous Signal Fusion Based on ToF and Millimeter Wave

The human modeling technology has a broad application background in popular fields, such as security inspection, medical modeling, virtual fitting, and virtual human in the metauniverse. Addressing the limitations of current optical modeling methods in accurately representing the body surface covered by clothes accurately and meeting the precise location requirements of the acquisition equipment for heterodyne signal fusion, this article utilizes optical modeling based on a time-of-flight (ToF) camera and combines it with millimeter-wave technology. It also applies heterodyne signal fusion, leveraging the characteristics of the human body’s skeleton and edge points, to achieve the accurate modeling of both clothes and body surface. A human modeling system and method are proposed, based on the fusion of alien signal technology with millimeter-wave technology and ToF cameras, to solve the shortcomings of deep learning methods in estimating body surface estimation. The feasibility of the method in potential application areas such as anthropometry and visual security screening is finally verified through experiments. The measurement errors and visual effects in security screening are analyzed to demonstrate the practical value of the method.