Title:
END-TO-END SPECKLE PROJECTION THREE-DIMENSIONAL MEASUREMENT METHOD BASED ON DEEP LEARNING
Document Type and Number:
WIPO Patent Application WO/2022/057556
Kind Code:
A1
Abstract:
Disclosed is an end-to-end speckle projection three-dimensional measurement method based on deep learning. The method comprises: first using a projector for projection and a binocular camera for synchronously collecting a speckle pattern; performing stereo correction on the speckle pattern, inputting the pattern into a stereo matching network, and a feature extraction sub-network based on a shared weight processing the speckle pattern obtain a series of low-resolution three-dimensional feature tensors; inputting the feature tensors into a salient object detection sub-network for detecting foreground information in the speckle pattern to generate a full-resolution effective mask; generating a four-dimensional matching cost body by means of the feature tensors of two viewing angles according to a candidate disparity range, achieving cost aggregation by means of a series of three-dimensional convolutional layer filtering, and obtaining an initial disparity map by means of disparity regression; and obtaining a final disparity map by combining the effective mask and the initial disparity map to achieve single-frame robust absolute three-dimensional surface contouring. The present invention can achieve single-frame robust absolute three-dimensional surface contouring simply by projecting a speckle pattern.
Inventors:
ZUO CHAO (CN)
YIN WEI (CN)
CHEN QIAN (CN)
FENG SHIJIE (CN)
SUN JIASONG (CN)
HU YAN (CN)
TAO TIANYANG (CN)
YIN WEI (CN)
CHEN QIAN (CN)
FENG SHIJIE (CN)
SUN JIASONG (CN)
HU YAN (CN)
TAO TIANYANG (CN)
Application Number:
PCT/CN2021/113187
Publication Date:
March 24, 2022
Filing Date:
August 18, 2021
Export Citation:
Assignee:
UNIV NANJING SCI & TECH (CN)
International Classes:
G06T7/55; G06N3/04
Foreign References:
| CN112419386A | 2021-02-26 | |||
| CN111563564A | 2020-08-21 | |||
| CN110111271A | 2019-08-09 | |||
| US20200193580A1 | 2020-06-18 |
Attorney, Agent or Firm:
JIANGSU SHENGDIAN LAW FIRM (CN)
Download PDF:
Previous Patent: FAULT DETECTION METHOD AND APPARATUS, AND PHOTOVOLTAIC POWER GENERATION SYSTEM
Next Patent: HOUSEHOLD DEVICE CONTROL METHOD AND DEVICE
Next Patent: HOUSEHOLD DEVICE CONTROL METHOD AND DEVICE