Title:
SENTENCE DISCRIMINATION METHOD AND APPARATUS, AND DEVICE AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2022/116443
Kind Code:
A1
Abstract:
Disclosed are a sentence discrimination method and apparatus, and a computer device and a computer-readable storage medium, which are applicable to the technical field of artificial intelligence. The method comprises: splitting text to be processed, so as to generate a word set of said text (S101); determining affiliation relationships among words in the word set, and constructing a corresponding language model according to the affiliation relationships among the words (S102); acquiring a sentence to be subjected to prediction, and acquiring a frequency value of said sentence according to said sentence and the language model (S103); and determining, according to the frequency value of said sentence, whether said sentence is coherent (S104). By means of the above-mentioned method, the modeling of the distribution of sentences is realized by means of an unsupervised method, thereby reducing labor costs; and prior knowledge is added by means of parsing an affiliation relationship between sentences, such that contextual semantics can be fully utilized, thereby improving the accuracy of a language model.
Inventors:
DENG YUE (CN)
ZHENG LIYING (CN)
XU LIANG (CN)
XIAO JING (CN)
ZHENG LIYING (CN)
XU LIANG (CN)
XIAO JING (CN)
Application Number:
PCT/CN2021/084173
Publication Date:
June 09, 2022
Filing Date:
March 30, 2021
Export Citation:
Assignee:
PING AN TECH SHENZHEN CO LTD (CN)
International Classes:
G06F40/253
Foreign References:
| CN112446205A | 2021-03-05 | |||
| CN111651999A | 2020-09-11 | |||
| CN107590130A | 2018-01-16 | |||
| CN108255857A | 2018-07-06 | |||
| CN110188351A | 2019-08-30 | |||
| US20070260450A1 | 2007-11-08 | |||
| US20160283588A1 | 2016-09-29 |
Other References:
"Information Processing of Pre-Qin Literature", 31 January 2013, ISBN: 978-7-5100-5661-1, article CHEN, XIAOHE : "2. Conditional Random Field Model", pages: 73 - 74, XP009538106
Attorney, Agent or Firm:
SHENZHEN ZHONGYI UNION INTELLECTUAL PROPERTY AGENCY CO.,LTD. (CN)
Download PDF: