Title:
LARGE-RANGE MONITORING METHOD BASED ON DEEP WEIGHTED DOUBLE-Q LEARNING AND MONITORING ROBOT
Document Type and Number:
WIPO Patent Application WO/2018/205778
Kind Code:
A1
Abstract:
A large-range monitoring method based on deep weighted double-Q learning. The method involves: firstly, providing a robot (10) having a Q value table comprising a QA table and a QB table; secondly, an unidentified object (30) entering a large-range space (20) so as to trigger the robot (10); then, the robot (10) sensing a current state s, and determining whether the current state s is a target state; if so, the robot (10) reaching the next state and monitoring the unidentified object (30); if not, the robot (10) reaching the next state, and the robot (10) obtaining a reward value according to the next state; and the robot (10) choosing to update a QA value or a QB value equiprobably, and then updating a Q value, until the optimal monitoring policy is obtained through convergence. Not only does the method solve the problems of a limited monitoring range and a limited camera capacity, the problem of the synchronisation of a plurality of cameras also does not need to be considered, thereby reducing the cost.
Inventors:
ZHANG ZONGZHANG (CN)
PAN ZHIYUAN (CN)
WANG HUI (CN)
PAN ZHIYUAN (CN)
WANG HUI (CN)
Application Number:
PCT/CN2018/082105
Publication Date:
November 15, 2018
Filing Date:
April 08, 2018
Export Citation:
Assignee:
ZHANGJIAGANG INSITUTE OF INDUSTRIAL TECH (CN)
UNIV SOOCHOW (CN)
UNIV SOOCHOW (CN)
International Classes:
G05B13/00; G05D1/12
Foreign References:
CN107292392A | 2017-10-24 | |||
CN105867427A | 2016-08-17 | |||
CN106598058A | 2017-04-26 | |||
US20170032245A1 | 2017-02-02 | |||
US20100094786A1 | 2010-04-15 |
Attorney, Agent or Firm:
SUZHOU FLY PATENT AGENCY (GENERAL PARTERNERSHIP) (CN)
Download PDF:
Previous Patent: RATE-MATCHING SCHEME FOR POLAR CODES
Next Patent: GAMEPAD, MOBILE PHONE BACK HOLDER, AND MOBILE PHONE HOLDING AND PROTECTING MEMBER
Next Patent: GAMEPAD, MOBILE PHONE BACK HOLDER, AND MOBILE PHONE HOLDING AND PROTECTING MEMBER