Title:
VIDEO MANUAL GENERATION DEVICE
Document Type and Number:
WIPO Patent Application WO/2023/223671
Kind Code:
A1
Abstract:
This video manual generation device comprises an acquisition unit, an identification unit, and a video manual generation unit. The acquisition unit acquires input video data indicating the content of a task that includes one or more procedures, and one or more items of input procedure text data corresponding in a one-to-one manner with the one or more procedures. The identification unit uses a task learning model that has learned a relationship between first information, which is configured from a video indicating the content of a task configured from one or more procedures, and one or more items of text corresponding in a one-to-one manner with the one or more procedures, and second information, which indicates, for each frame of the video, the procedure among the one or more procedures that corresponds to said frame, said task learning model being used to identify, for each frame of the input video data, the procedure corresponding to said frame, among the one or more procedures. The video manual generation unit generates video manual data on the basis of the input video data, and the input procedure text data which, among the one or more input procedure text data, corresponds to the procedure identified by the identification unit.
Inventors:
MATSUSHIMA NOBUTAKA (JP)
MIZUKOSHI YUUICHI (JP)
MIZUKOSHI YUUICHI (JP)
Application Number:
PCT/JP2023/011799
Publication Date:
November 23, 2023
Filing Date:
March 24, 2023
Export Citation:
Assignee:
NTT DOCOMO INC (JP)
International Classes:
G06F16/78; G06N3/02; G06N20/00
Foreign References:
| JP7023427B1 | 2022-02-21 | |||
| JP2020150509A | 2020-09-17 | |||
| JP2008225883A | 2008-09-25 | |||
| JP2013037634A | 2013-02-21 | |||
| CN112040322A | 2020-12-04 |
Other References:
YAMAKATA, YOKO ET AL.: "A Method of Recipe to Cooking Video Mapping for Automated Cooking Content Construction", IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, DENSHI JOUHOU TSUUSHIN GAKKAI, JOUHOU SHISUTEMU SOSAIETI, JP, vol. J90-D, no. 10, 1 October 2007 (2007-10-01), JP , pages 2817 - 2829, XP009541687, ISSN: 1880-4535
MIURA KOICHI, TAKANO MOTOMU, HAMADA REIKO, IDE ICHIRO, SAKAI SHUICHI, TANAKA HIDEHIKO: "Associating semantically structured cooking videos with their preparation steps", SYSTEMS & COMPUTERS IN JAPAN., WILEY, HOBOKEN, NJ., US, vol. 36, no. 2, 1 November 2003 (2003-11-01), US , pages 1647 - 1656, XP093011049, ISSN: 0882-1666, DOI: 10.1002/scj.20131
MIURA KOICHI, TAKANO MOTOMU, HAMADA REIKO, IDE ICHIRO, SAKAI SHUICHI, TANAKA HIDEHIKO: "Associating semantically structured cooking videos with their preparation steps", SYSTEMS & COMPUTERS IN JAPAN., WILEY, HOBOKEN, NJ., US, vol. 36, no. 2, 1 November 2003 (2003-11-01), US , pages 1647 - 1656, XP093011049, ISSN: 0882-1666, DOI: 10.1002/scj.20131
Attorney, Agent or Firm:
OHCHI INTERNATIONAL IP (JP)
Download PDF:
Previous Patent: POLYMER AND RESIN COMPOSITION FOR OPTICAL LENS
Next Patent: BOARDING AND ALIGHTING NUMBER PREDICTION DEVICE
Next Patent: BOARDING AND ALIGHTING NUMBER PREDICTION DEVICE