Title:
NATURAL HUMAN-COMPUTER INTERACTION SYSTEM BASED ON MULTI-SENSING DATA FUSION
Document Type and Number:
WIPO Patent Application WO/2019/024577
Kind Code:
A1
Abstract:
A natural human-computer interaction system based on multi-sensing data fusion, comprising an MEMS arm tracking device, a visual tracking device, a force feedback device, and a PC terminal. The MEMS arm tracking device consists of three groups of independent MEMS sensors for collecting arm joint angle information and measuring an arm movement track. The visual tracking device consists of a binocular camera for collecting image information and measuring a finger movement track. The force feedback device is mounted on the palm of an operator for providing force feedback to the finger. The PC terminal comprises a data display module, an arm movement calculating module, an image processing module, a mechanical calculating module, and a virtual scene rendering module. The system tracks the arm movement track of the operator by taking advantage of wide measurement range of the MEMS sensor and tracks the finger movement track of the operator by taking advantage of high precision of visual interaction, and provides force feedback interaction to the finger of the operator by means of the force feedback device, so that the sense of immersion of the operator can be improved.
Inventors:
SONG AIGUO (CN)
ZHANG HUI (CN)
YU YUQING (CN)
QIN HUANHUAN (CN)
LI HUIJUN (CN)
XU BAOGUO (CN)
ZHANG HUI (CN)
YU YUQING (CN)
QIN HUANHUAN (CN)
LI HUIJUN (CN)
XU BAOGUO (CN)
Application Number:
PCT/CN2018/088077
Publication Date:
February 07, 2019
Filing Date:
May 23, 2018
Export Citation:
Assignee:
UNIV SOUTHEAST (CN)
International Classes:
G06F3/01
Foreign References:
| CN107632699A | 2018-01-26 | |||
| CN106779045A | 2017-05-31 | |||
| CN103488291A | 2014-01-01 | |||
| CN106648116A | 2017-05-10 |
Attorney, Agent or Firm:
NANJING RUIHONG PATENT & TRADEMARK AGENCY (ORDINARY PARTNERSHIP) (CN)
Download PDF: