Title:
DATA FEATURE ENHANCEMENT METHOD AND APPARATUS FOR CORPUS DATA, COMPUTER DEVICE, AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2021/139317
Kind Code:
A1
Abstract:
Disclosed are a data feature enhancement method and apparatus for corpus data, a computer device, and a storage medium, relating to artificial intelligence technology. The method comprises: after a full corpus data set is acquired, firstly carrying out data grouping to obtain a plurality of corpus data subsets; every time one corpus data subset is sequentially deleted, training a user intention recognition model to be trained in order to obtain a plurality of user intention recognition models; taking each piece of data in the full corpus data set as training sample data and test sample data, and correspondingly calculating a model average correction rate difference value, a sample recall rate difference value and a prediction correction rate difference value, respectively, to acquire a sample contribution degree triple corresponding to each piece of corpus data; and if there is corpus data, three difference values in a corresponding sample contribution degree triple of which are negative values, acquiring target corpus data to form a corpus data set to be deleted, and then deleting said corpus data set from the full corpus data set. By means of the method, the apparatus, the computer device and the storage medium, automatic cleaning of negative-contribution corpus data is achieved, and no human intervention is needed in the cleaning process, thereby improving the acquisition efficiency of a high-quality training set.
Inventors:
LIN JIAJIA (CN)
HAO ZHENGHONG (CN)
WANG SHAOJUN (CN)
XIAO JING (CN)
HAO ZHENGHONG (CN)
WANG SHAOJUN (CN)
XIAO JING (CN)
Application Number:
PCT/CN2020/122842
Publication Date:
July 15, 2021
Filing Date:
October 22, 2020
Export Citation:
Assignee:
PING AN TECH SHENZHEN CO LTD (CN)
International Classes:
G06K9/62; G06F40/30
Foreign References:
| CN104951469A | 2015-09-30 | |||
| CN1940915A | 2007-04-04 | |||
| CN110134799A | 2019-08-16 | |||
| US20160026634A1 | 2016-01-28 |
Attorney, Agent or Firm:
SHENZHEN TALENT PATENT SERVICE (CN)
Download PDF: