Title:
CANDIDATE LEVEL MULTI-MODAL INTEGRATION SYSTEM
Document Type and Number:
WIPO Patent Application WO2002042242
Kind Code:
A3
Abstract:
A multi-modal integration system includes sensing devices and a multi-modal integration unit. The sensing devices provide lists of candidate pairs, each pair including a candidate characterization and a probability expressing a confidence with respect to that candidate. The multi-modal integration unit receives the lists from the sensing devices, and provides multi-modal contextual information to each sensing device responsive to the lists. The sensing devices then provide new lists of candidate pairs iteratively, using the new information from the multi-modal integration unit to alter sensing or other performance. A super-system including a hierarchy of these multi-modal integration units may be constructed.
Inventors:
COLMENAREZ ANTONIO
GUTTA SRINIVAS
GUTTA SRINIVAS
Application Number:
PCT/EP2001/013414
Publication Date:
November 28, 2002
Filing Date:
November 16, 2001
Export Citation:
Assignee:
KONINKL PHILIPS ELECTRONICS NV (NL)
International Classes:
G06K9/62; G06K9/68; G06T7/00; G10L15/24; (IPC1-7): G06K9/68
Foreign References:
| US5586215A | 1996-12-17 | |||
| US6009199A | 1999-12-28 | |||
| EP0921509A2 | 1999-06-09 |
Other References:
A. JAIN ET AL.: "A Multimodal Biometric System using Fingerprints, Face and Speech", 2ND INT. CONF. ON AUDIO- AND VIDEO-BASED BIOMETRIC PERSON AUTHENTICATION,, 23 March 1999 (1999-03-23) - 24 March 1999 (1999-03-24), Washington D. C., USA, pages 182 - 187, XP002211742, Retrieved from the Internet [retrieved on 20020829]
"DECODING OF A CONSISTENT MESSAGE USING BOTH SPEECH AND HANDWRITING RECOGNITION", IBM TECHNICAL DISCLOSURE BULLETIN, IBM CORP. NEW YORK, US, vol. 36, no. 1, 1993, pages 415 - 418, XP000333898, ISSN: 0018-8689
TSE MIN CHEN ET AL: "A generalized look-ahead method for adaptive multiple sequential data fusion and decision making", MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS, 1999. MFI '99. PROCEEDINGS. 1999 IEEE/SICE/RSJ INTERNATIONAL CONFERENCE ON TAIPEI, TAIWAN 15-18 AUG. 1999, PISCATAWAY, NJ, USA,IEEE, US, 15 August 1999 (1999-08-15), pages 199 - 204, XP010366571, ISBN: 0-7803-5801-5
A. ROSS ET AL: "Information Fusion in Biometrics", PROC. INT. CONF. ON AUDIO- AND VIDEO-BASED PERSON AUTHENTICATION (AVBPA), 6 June 2001 (2001-06-06) - 8 June 2201 (2201-06-08), Halmstad, Sweden, pages 354 - .359, XP002211743, Retrieved from the Internet [retrieved on 20020829]
SERPICO S B ET AL: "Structured neural networks for the classification of multisensor remote-sensing images", GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 1993. IGARSS '93. BETTER UNDERSTANDING OF EARTH ENVIRONMENT., INTERNATIONAL TOKYO, JAPAN 18-21 AUG. 1993, NEW YORK, NY, USA,IEEE, 18 August 1993 (1993-08-18), pages 907 - 909, XP010114470, ISBN: 0-7803-1240-6
BORGHYS D ET AL: "MULTILEVEL DATA FUSION FOR THE DETECTION OF TARGETS USING MULTISPECTRAL IMAGE SEQUENCES", OPTICAL ENGINEERING, SOC. OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS. BELLINGHAM, US, vol. 37, no. 2, 1 February 1998 (1998-02-01), pages 477 - 484, XP000742662, ISSN: 0091-3286
PAVLOVIC V ET AL: "MULTIMODAL SPEAKER DETECTION USING ERROR FEEDBACK DYNAMIC BAYESIAN NETWORKS", PROCEEDINGS 2000 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2000. HILTON HEAD ISLAND, SC, JUNE 13-15, 2000, PROCEEDINGS OF THE IEEE COMPUTER CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, LOS ALAMITOS, CA: IEEE COMP. SOC, vol. 2 OF 2, 13 June 2000 (2000-06-13), pages 34 - 41, XP001035625, ISBN: 0-7803-6527-5
MCCULLOUGH C L ET AL: "Multi-level sensor fusion for improved target discrimination", DECISION AND CONTROL, 1996., PROCEEDINGS OF THE 35TH IEEE CONFERENCE ON KOBE, JAPAN 11-13 DEC. 1996, NEW YORK, NY, USA,IEEE, US, 11 December 1996 (1996-12-11), pages 3674 - 3675, XP010214092, ISBN: 0-7803-3590-2
AALO V A ET AL: "Multilevel quantisation and fusion scheme for the decentralised detection of an unknown signal", IEE PROCEEDINGS: RADAR, SONAR & NAVIGATION, INSTITUTION OF ELECTRICAL ENGINEERS, GB, vol. 141, no. 1, 1 February 1994 (1994-02-01), pages 37 - 44, XP006002055, ISSN: 1350-2395
DASARATHY B V: "FUSION STRATEGIES FOR ENHANCING DECISION RELIABILITY IN MULTISENSORENVIRONMENTS", OPTICAL ENGINEERING, SOC. OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS. BELLINGHAM, US, vol. 35, no. 3, 1 March 1996 (1996-03-01), pages 603 - 616, XP000597449, ISSN: 0091-3286
"DECODING OF A CONSISTENT MESSAGE USING BOTH SPEECH AND HANDWRITING RECOGNITION", IBM TECHNICAL DISCLOSURE BULLETIN, IBM CORP. NEW YORK, US, vol. 36, no. 1, 1993, pages 415 - 418, XP000333898, ISSN: 0018-8689
TSE MIN CHEN ET AL: "A generalized look-ahead method for adaptive multiple sequential data fusion and decision making", MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS, 1999. MFI '99. PROCEEDINGS. 1999 IEEE/SICE/RSJ INTERNATIONAL CONFERENCE ON TAIPEI, TAIWAN 15-18 AUG. 1999, PISCATAWAY, NJ, USA,IEEE, US, 15 August 1999 (1999-08-15), pages 199 - 204, XP010366571, ISBN: 0-7803-5801-5
A. ROSS ET AL: "Information Fusion in Biometrics", PROC. INT. CONF. ON AUDIO- AND VIDEO-BASED PERSON AUTHENTICATION (AVBPA), 6 June 2001 (2001-06-06) - 8 June 2201 (2201-06-08), Halmstad, Sweden, pages 354 - .359, XP002211743, Retrieved from the Internet
SERPICO S B ET AL: "Structured neural networks for the classification of multisensor remote-sensing images", GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 1993. IGARSS '93. BETTER UNDERSTANDING OF EARTH ENVIRONMENT., INTERNATIONAL TOKYO, JAPAN 18-21 AUG. 1993, NEW YORK, NY, USA,IEEE, 18 August 1993 (1993-08-18), pages 907 - 909, XP010114470, ISBN: 0-7803-1240-6
BORGHYS D ET AL: "MULTILEVEL DATA FUSION FOR THE DETECTION OF TARGETS USING MULTISPECTRAL IMAGE SEQUENCES", OPTICAL ENGINEERING, SOC. OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS. BELLINGHAM, US, vol. 37, no. 2, 1 February 1998 (1998-02-01), pages 477 - 484, XP000742662, ISSN: 0091-3286
PAVLOVIC V ET AL: "MULTIMODAL SPEAKER DETECTION USING ERROR FEEDBACK DYNAMIC BAYESIAN NETWORKS", PROCEEDINGS 2000 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2000. HILTON HEAD ISLAND, SC, JUNE 13-15, 2000, PROCEEDINGS OF THE IEEE COMPUTER CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, LOS ALAMITOS, CA: IEEE COMP. SOC, vol. 2 OF 2, 13 June 2000 (2000-06-13), pages 34 - 41, XP001035625, ISBN: 0-7803-6527-5
MCCULLOUGH C L ET AL: "Multi-level sensor fusion for improved target discrimination", DECISION AND CONTROL, 1996., PROCEEDINGS OF THE 35TH IEEE CONFERENCE ON KOBE, JAPAN 11-13 DEC. 1996, NEW YORK, NY, USA,IEEE, US, 11 December 1996 (1996-12-11), pages 3674 - 3675, XP010214092, ISBN: 0-7803-3590-2
AALO V A ET AL: "Multilevel quantisation and fusion scheme for the decentralised detection of an unknown signal", IEE PROCEEDINGS: RADAR, SONAR & NAVIGATION, INSTITUTION OF ELECTRICAL ENGINEERS, GB, vol. 141, no. 1, 1 February 1994 (1994-02-01), pages 37 - 44, XP006002055, ISSN: 1350-2395
DASARATHY B V: "FUSION STRATEGIES FOR ENHANCING DECISION RELIABILITY IN MULTISENSORENVIRONMENTS", OPTICAL ENGINEERING, SOC. OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS. BELLINGHAM, US, vol. 35, no. 3, 1 March 1996 (1996-03-01), pages 603 - 616, XP000597449, ISSN: 0091-3286
Download PDF:
Previous Patent: A HEAT CONDUCTIVE MATERIAL
Next Patent: PROCESSES FOR PREPARATION OF TETRAHYDRONAPHTHALENE DERIVATIVES
Next Patent: PROCESSES FOR PREPARATION OF TETRAHYDRONAPHTHALENE DERIVATIVES