Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
VIDEO INSTANCE SEGMENTATION METHOD AND APPARATUS BASED ON SPATIO-TEMPORAL MEMORY INFORMATION
Document Type and Number:
WIPO Patent Application WO/2023/116632
Kind Code:
A1
Abstract:
Disclosed in the present invention are a video instance segmentation method and apparatus based on spatio-temporal memory information. The video instance segmentation method comprises: acquiring a query key feature map and a query value feature map of an instance to be segmented of the current frame of image in a video, and a memory key feature map and a memory value feature map of an instance to be segmented of each memory frame image; calculating a weight value of the memory key feature map of the instance to be segmented of each memory frame image when attention matching is performed; selecting a predetermined number of weight values from among all the weight values in a descending order, and taking same as weight coefficients; according to the weight coefficients, and memory key feature maps and memory value feature maps of memory frame images corresponding to the weight coefficients, obtaining a global feature map having weighted spatio-temporal information; and obtaining an instance segmentation result of the current frame of image according to the global feature map, the query key feature map and the query value feature map. By means of the method, full use can be made of historical information of a memory frame image, thereby improving the robustness of a segmentation result.

Inventors:
ZHOU YIMIN (CN)
MA ZHUANG (CN)
Application Number:
PCT/CN2022/140070
Publication Date:
June 29, 2023
Filing Date:
December 19, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
SHENZHEN INST OF ADV TECH CAS (CN)
International Classes:
G06V20/40; G06N3/04; G06V10/26; G06V10/28; G06V10/764; G06V10/766; G06V10/82
Foreign References:
CN114241388A2022-03-25
CN112669324A2021-04-16
CN109118519A2019-01-01
CN113361519A2021-09-07
Attorney, Agent or Firm:
BEIJING ZHONG XUN TONG DA INTELLECTUAL PROPERTY AGENCY CO., LTD. (CN)
Download PDF:
View/Download PDF      PDF Help



 
Previous Patent: TRAINING METHOD AND TRAINING APPARATUS FOR ROTATING-SHIP TARGET DETECTION MODEL, AND STORAGE MEDIUM

Next Patent: DETAIL-FIDELITY MULTI-SCALE DEEP LEARNING MAGNETIC RESONANCE DYNAMIC IMAGE RECONSTRUCTION METHOD