Title:
LEARNING DEVICE, INFERENCE DEVICE, LEARNING METHOD, AND PROGRAM
Document Type and Number:
WIPO Patent Application WO/2023/017568
Kind Code:
A1
Abstract:
Provided are a learning device and the like that apply a knowledge distillation technology to a complex classification problem taking a complex context into consideration. This learning device infers a label corresponding to a text included in a learning data set by using a teacher model that is a model including, in a hierarchical manner, Q functions for performing processing by a specific unit, infers a label corresponding to a text included in the learning data set by using a student model that is a model including, in a hierarchical manner, Q functions the same as those of the teacher model, obtains a hard target loss by using a correct answer label corresponding to the text included in the learning data set and the inference result of a student model label inference process, obtains a soft target loss by using the inference result of a teacher model label inference process and the inference result of the student model label inference process, and updates a parameter of the student model so as to optimize a loss obtained from the hard target loss and the soft target loss.
Inventors:
ORIHASHI SHOTA (JP)
MASUMURA RYO (JP)
MASUMURA RYO (JP)
Application Number:
PCT/JP2021/029544
Publication Date:
February 16, 2023
Filing Date:
August 10, 2021
Export Citation:
Assignee:
NIPPON TELEGRAPH & TELEPHONE (JP)
International Classes:
G06N3/08; G06F40/216; G06F40/35; G06N20/00
Domestic Patent References:
| WO2018051841A1 | 2018-03-22 |
Foreign References:
| CN112613312A | 2021-04-06 |
Other References:
RYO MASUMURA, TOMOHIRO TANAKA, ATSUSHI ANDO, HOSANA KAMIYAMA, TAKANOBU OBA, YUSHI AONO: "Call scene segmentation based on neural networks with conversational contexts", IEICE TECHNICAL REPORT, NLC; IPSJ INFORMATION FUNDAMENTALS AND ACCESS TECHNOLOGIES (IFAT), IEICE, JP, vol. 2019-IFAT-133, no. 5 (NLC2018-39), 31 January 2019 (2019-01-31), JP, pages 1 - 6, XP009537301
Attorney, Agent or Firm:
NAKAO, Naoki et al. (JP)
Download PDF:
Previous Patent: COMMUNICATION DEVICE AND COMMUNICATION CONTROL METHOD
Next Patent: WIRELESS DEADMAN SWITCH FOR AIRCRAFT FUELING VEHICLE
Next Patent: WIRELESS DEADMAN SWITCH FOR AIRCRAFT FUELING VEHICLE