Title:
INTELLIGENT IDENTIFICATION METHOD AND SYSTEM FOR GIVING ASSISTANCE WITH PIANO TEACHING, AND INTELLIGENT PIANO TRAINING METHOD AND SYSTEM
Document Type and Number:
WIPO Patent Application WO/2022/052941
Kind Code:
A1
Abstract:
An intelligent identification method for giving assistance with piano teaching, the method comprising: acquiring, from above a piano keyboard, a 2D image, which contains the complete piano keyboard, of playing a piano; performing target detection on the 2D image by means of a piano keyboard detection network to detect a piano keyboard region, which is represented by the relative position coordinates of the 2D image, and obtaining, by means of conversion, piano keyboard position coordinates under the original coordinates of the 2D image; performing, by means of a hand detection network, target detection on the piano keyboard region, which is represented by the piano keyboard position coordinates, so as to detect a hand region, which is represented by the relative position coordinates of the piano keyboard region, and obtaining hand position coordinates under the original coordinate system of the 2D image by means of conversion; and identifying, by means of a hand shape error detection network, whether there is a hand shape error in the hand region, which is represented by the hand position coordinates, outputting a hand shape error type and a hand shape error position, which is represented by the relative position coordinates of the hand region, and obtaining, by means of conversion, hand shape error position coordinates under the original coordinates of the 2D image. In addition, further provided is an intelligent piano training method for identifying a playing error by using the intelligent identification method.
Inventors:
HAN BINGBING (CN)
TAO ZHIYU (CN)
ZHENG QINGWEI (CN)
TAO ZHIYU (CN)
ZHENG QINGWEI (CN)
Application Number:
PCT/CN2021/117130
Publication Date:
March 17, 2022
Filing Date:
September 08, 2021
Export Citation:
Assignee:
GUILIN ZHISHEN INFORMATION TECH CO LTD (CN)
International Classes:
G09B15/00
Foreign References:
| CN109493683A | 2019-03-19 | |||
| CN109243248A | 2019-01-18 | |||
| CN108052277A | 2018-05-18 | |||
| CN109448131A | 2019-03-08 | |||
| CN107180224A | 2017-09-19 | |||
| EP1569185A2 | 2005-08-31 |
Attorney, Agent or Firm:
PANAWELL & PARTNERS, LLC (CN)
Download PDF: