Title:
NATURAL LANGUAGE PROCESSING METHOD AND APPARATUS, DEVICE, AND READABLE STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2023/130688
Kind Code:
A1
Abstract:
A natural language processing method and apparatus, a device, and a readable storage medium. The method comprises: acquiring a target sentence to be processed, and determining each entity in the target sentence (S101); for each entity in the target sentence, in response to the entity being present in a preset entity set, determining extended information for the entity, and adding the determined extended information after the position where the entity is located in the target sentence, so as to obtain an updated target sentence (S102); and inputting the updated target sentence into a BERT model, such that the BERT model executes a natural language processing task, wherein during the process of the BERT model executing the natural language processing task, an attention score of the extended information of any entity in the target sentence and attention scores of other entities in the target sentence are adjusted to be zero (S103).
Inventors:
WANG LI (CN)
ZHAO YAQIAN (CN)
FAN BAOYU (CN)
LI RENGANG (CN)
ZHAO YAQIAN (CN)
FAN BAOYU (CN)
LI RENGANG (CN)
Application Number:
PCT/CN2022/102862
Publication Date:
July 13, 2023
Filing Date:
June 30, 2022
Export Citation:
Assignee:
INSPUR SUZHOU INTELLIGENT TECHNOLOGY CO LTD (CN)
International Classes:
G06F40/295
Foreign References:
| CN114021572A | 2022-02-08 | |||
| CN113158653A | 2021-07-23 | |||
| CN113627192A | 2021-11-09 | |||
| CN109522553A | 2019-03-26 | |||
| US6374209B1 | 2002-04-16 | |||
| US20180336466A1 | 2018-11-22 | |||
| KR20210040319A | 2021-04-13 |
Attorney, Agent or Firm:
BEIJING WANHUIDA LAW FIRM (CN)
Download PDF: