ROBOT AUDIO-VISUAL SYSTEM

Japanese Patent JP3843743

B2

PROBLEM TO BE SOLVED: To provide a robot audio-visual system performing the visual and auditory tracing of an object to perform the audio-visual servo of a robot, using both visual and auditory senses.
SOLUTION: An auditory module 20 extracts an auditory event 28 by identifying the sound source of a speaker by pitch extraction and the separation and orientation of the sound source form an acoustic signal of a microphone. A visual module 30 extracts a visual event 39 by the face identification and orientation of the speaker from the image of a camera. A motor control module 40 extracts a motor event 49 from the rotating position of a drive motor. An association module 60 creates an auditory stream 65 and a visual stream 66 from the auditory event, visual event and motor event and creates an association stream 67 by associating these streams. An attention module 64 performs attention control on the basis of the association stream and performs the audio-visual servo of the robot.

Kazuhiro Nakadai
Kenichi Hidai
Hiroshi Okuno
Hiroaki Kitano

JP2001067849A

November 08, 2006

March 09, 2001

Click for automatic bibliography generation  

Japan Science and Technology Agency

B25J9/10; B25J5/00; B25J19/02; G06T1/00; G06T7/00; G06T7/60; G10L13/00; G10L13/04; G10L15/00; G10L15/02; G10L15/20; G10L15/22; G10L15/28; G10L17/00; G10L21/0208; G10L21/0272; G10L21/028; G10L25/00; G10L25/51; G10L25/90; H04N7/18; (IPC1-7): B25J9/10; B25J5/00; B25J19/02; G06T1/00; G06T7/00; G06T7/60; G10L11/04; G10L13/00; G10L15/28; G10L17/00; G10L15/00; G10L15/22; G10L15/20; G10L21/02; G10L15/02; H04N7/18

JP2002264058A
JP2001188779A
JP2001212780A
JP2000148184A
JP2001175869A

Kazuyuki Hirayama

Previous Patent: ROBOT SEAT AND CUSTOMIZED ORDER SYSTEM FOR SEAT FOR VEHICLE BY USING ROBOT SEAT

Next Patent: SHEET CONVEYANCE DEVICE