Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
TRAINING METHOD AND APPARATUS AND RECOGNITION METHOD AND APPARATUS FOR TEXT ERROR CORRECTION MODEL, AND COMPUTER DEVICE
Document Type and Number:
WIPO Patent Application WO/2022/121178
Kind Code:
A1
Abstract:
The present application relates to the technical field of artificial intelligence, and provides a training method and apparatus and a recognition method and apparatus for a soft mask-based text error correction model, a computer device, and a computer-readable storage medium. The training method comprises: obtaining a text to be corrected, and converting said text into word vector information of each word; training a preset soft mask-based language model according to the word vector information of each word, and obtaining a corresponding loss function; updating model parameters of the preset soft mask-based language model on the basis of the loss function, and determining whether the preset soft mask-based language model is in a convergent state; and if it is determined that the preset soft mask-based language model is in the convergent state, generating a corresponding text error correction model. Processing words by means of soft mask does not require a large amount of training corpora, a training duration of the model is shortened, data is fitted, and accuracy of the model is improved.

Inventors:
DENG YUE (CN)
ZHENG LIYING (CN)
XU LIANG (CN)
Application Number:
PCT/CN2021/084171
Publication Date:
June 16, 2022
Filing Date:
March 30, 2021
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
PING AN TECH SHENZHEN CO LTD (CN)
International Classes:
G06N3/04; G06F40/151
Foreign References:
CN112528634A2021-03-19
CN111931490A2020-11-13
CN110196894A2019-09-03
Other References:
SHAOHUA ZHANG; HAORAN HUANG; JICONG LIU; HANG LI: "Spelling Error Correction with Soft-Masked BERT", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 May 2020 (2020-05-15), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081674179
Attorney, Agent or Firm:
SHENZHEN ZHONGYI UNION INTELLECTUAL PROPERTY AGENCY CO.,LTD. (CN)
Download PDF: