Title:
SYSTEM AND METHOD FOR TRACKING A GLOBAL SHAPE OF AN OBJECT IN MOTION
Document Type and Number:
WIPO Patent Application WO2004081875
Kind Code:
A3
Abstract:
A system and method for tracking a global shape of an object in motion is disclosed. One or more control points along an initial contour of the global shape are defined. Each of the one or more control points is tracked as the object is in motion. Uncertainty of a location of a control point in motion is represented using a number of techniques. The uncertainty to constrain the global shape is exploited using a prior shape model. In an alternative embodiment, multiple appearance models are built for each control point and the motion vectors produced by each model are combined in order to track the shape of the object. The movement of the shape of the object can be visually tracked using a display and color vectors.
Inventors:
COMANICIU DORIN (US)
KRISHNAN SRIRAM (US)
ZHOU XIANG SEAN (US)
GEORGESCU BOGDAN (US)
KRISHNAN SRIRAM (US)
ZHOU XIANG SEAN (US)
GEORGESCU BOGDAN (US)
Application Number:
PCT/US2004/007068
Publication Date:
October 06, 2005
Filing Date:
March 08, 2004
Export Citation:
Assignee:
SIEMENS CORP RES INC (US)
SIEMENS MEDICAL SOLUTIONS (US)
COMANICIU DORIN (US)
KRISHNAN SRIRAM (US)
ZHOU XIANG SEAN (US)
GEORGESCU BOGDAN (US)
SIEMENS MEDICAL SOLUTIONS (US)
COMANICIU DORIN (US)
KRISHNAN SRIRAM (US)
ZHOU XIANG SEAN (US)
GEORGESCU BOGDAN (US)
International Classes:
G06K9/00; G06T5/00; G06T7/20; (IPC1-7): G06T7/20
Foreign References:
| US5999651A | 1999-12-07 |
Other References:
BAUMBERG A M ET AL: "An efficient method for contour tracking using active shape models", MOTION OF NON-RIGID AND ARTICULATED OBJECTS, 1994., PROCEEDINGS OF THE 1994 IEEE WORKSHOP ON AUSTIN, TX, USA 11-12 NOV. 1994, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, 11 November 1994 (1994-11-11), pages 194 - 199, XP010100207, ISBN: 0-8186-6435-5
JACOB, NOBLE, BEHRENBRUCH, KELION, BANNING: "A Shape Space Based Approach to Tracking Myocardial Borders and Quantifying Regional Left-Ventricular Function Applied in Echocardiography", IEEE TRANSACTIONS ON MEDICAL IMAGING, vol. 21, no. 3, March 2002 (2002-03-01), pages 226 - 238, XP002310531
NASCIMENTO J ET AL: "Robust shape tracking in the presence of cluttered background", IEEEE TRANSACTIONS ON MULTIMEDIA, vol. 3, 10 September 2000 (2000-09-10), pages 82 - 85, XP010529408
BRAND M ET AL: "Flexible flow for 3d nonrigid tracking and shape recovery", PROCEEDINGS 2001 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2001. KAUAI, HAWAII, DEC. 8 - 14, 2001, PROCEEDINGS OF THE IEEE COMPUTER CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, LOS ALAMITOS, CA, IEEE COMP. SOC, US, vol. VOL. 1 OF 2, 8 December 2001 (2001-12-08), pages 315 - 322, XP010583762, ISBN: 0-7695-1272-0
COMANICIU DORIN: "Bayesian Kernel Tracking", LECTURE NOTES IN COMPUTER SCIENCE LNCS 2449, PROCEEDINGS OF 24TH DAGM SYMPOSIUM, ZURICH, 16 September 2002 (2002-09-16), SPRINGER-BERLIN HEIDELBERG, ISSN 0302-9743, pages 438 - 445, XP002310572
I. COHEN, N. AYACHE, AND P. SULGER: "Tracking Points on Deformable Objects Using Curvature Information.", LECTURE NOTES IN COMPUTER SCIENCE, PROCEEDINGS OF ECCV 1992, vol. 588, May 1992 (1992-05-01), SPRINGER VERLAG, pages 458 - 466, XP009041628
KANAZAWA Y ET AL: "DO WE REALLY HAVE TO CONSIDER COVARIANCE MATRICES FOR IMAGE FEATURE POINTS?", ELECTRONICS & COMMUNICATIONS IN JAPAN, PART III - FUNDAMENTAL ELECTRONIC SCIENCE, SCRIPTA TECHNICA. NEW YORK, US, TRANSLATION, vol. 86, no. 1, PART 3, 2003, pages 1 - 10, XP001127586, ISSN: 1042-0967
MALASSIOTIS S ET AL: "Tracking the left ventricle in echocardiographic images by learning heart dynamics", IEEE TRANSACTIONS ON MEDICAL IMAGING, IEEE INC. NEW YORK, US, vol. 18, no. 3, March 1999 (1999-03-01), pages 282 - 290, XP002285161, ISSN: 0278-0062
DUNCAN J S ET AL: "Measurement of non-rigid motion using contour shape descriptors", PROCEEDINGS OF THE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. LAHAINA, MAUI, HAWAII, JUNE 3 - 6, 1991, LOS ALAMITOS, IEEE. COMP. SOC. PRESS, US, 3 June 1991 (1991-06-03), pages 318 - 324, XP010023226, ISBN: 0-8186-2148-6
RAMACHANDRAN G ET AL: "Left Ventricle Wall Motion Analysis During Various Phases Of Cardiac Cycle From 2D-Echocardiographic Images", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, 1991. VOL.13: 1991., PROCEEDINGS OF THE ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ORLANDO, FL, USA 31 OCT.-3 NOV. 1991, NEW YORK, NY, USA,IEEE, US, 31 October 1991 (1991-10-31), pages 235 - 236, XP010102263, ISBN: 0-7803-0216-8
BOHS L N ET AL: "Real Time Ultrasonic Flow Imaging NSF/ERC Unit 2.1 B", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, 1990., PROCEEDINGS OF THE TWELFTH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE PHILADELPHIA, PA, USA 1-4 NOV. 1990, NEW YORK, NY, USA,IEEE, US, 1 November 1990 (1990-11-01), pages 670 - 670, XP010036083, ISBN: 0-87942-559-8
GUSE R ET AL: "RGPSview: a tool for RGPS data visualization", GEOSCIENCE AND REMOTE SENSING SYMPOSIUN, 2000. PROCEEDINGS. IGARSS 2000. IEEE 2000 INTERNATIONAL 24-28 JULY 2000, PISCATAWAY, NJ, USA,IEEE, vol. 7, 24 July 2000 (2000-07-24), pages 3006 - 3008, XP010506260, ISBN: 0-7803-6359-0
COMANICLU D: "Density estimation-based information fusion for multiple motion computation", MOTION AND VIDEO COMPUTING, 2002. PROCEEDINGS. WORKSHOP ON 5-6 DEC. 2002, PISCATAWAY, NJ, USA,IEEE, 5 December 2002 (2002-12-05), pages 241 - 246, XP010628808, ISBN: 0-7695-1860-5
JACOB, NOBLE, BEHRENBRUCH, KELION, BANNING: "A Shape Space Based Approach to Tracking Myocardial Borders and Quantifying Regional Left-Ventricular Function Applied in Echocardiography", IEEE TRANSACTIONS ON MEDICAL IMAGING, vol. 21, no. 3, March 2002 (2002-03-01), pages 226 - 238, XP002310531
NASCIMENTO J ET AL: "Robust shape tracking in the presence of cluttered background", IEEEE TRANSACTIONS ON MULTIMEDIA, vol. 3, 10 September 2000 (2000-09-10), pages 82 - 85, XP010529408
BRAND M ET AL: "Flexible flow for 3d nonrigid tracking and shape recovery", PROCEEDINGS 2001 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. CVPR 2001. KAUAI, HAWAII, DEC. 8 - 14, 2001, PROCEEDINGS OF THE IEEE COMPUTER CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, LOS ALAMITOS, CA, IEEE COMP. SOC, US, vol. VOL. 1 OF 2, 8 December 2001 (2001-12-08), pages 315 - 322, XP010583762, ISBN: 0-7695-1272-0
COMANICIU DORIN: "Bayesian Kernel Tracking", LECTURE NOTES IN COMPUTER SCIENCE LNCS 2449, PROCEEDINGS OF 24TH DAGM SYMPOSIUM, ZURICH, 16 September 2002 (2002-09-16), SPRINGER-BERLIN HEIDELBERG, ISSN 0302-9743, pages 438 - 445, XP002310572
I. COHEN, N. AYACHE, AND P. SULGER: "Tracking Points on Deformable Objects Using Curvature Information.", LECTURE NOTES IN COMPUTER SCIENCE, PROCEEDINGS OF ECCV 1992, vol. 588, May 1992 (1992-05-01), SPRINGER VERLAG, pages 458 - 466, XP009041628
KANAZAWA Y ET AL: "DO WE REALLY HAVE TO CONSIDER COVARIANCE MATRICES FOR IMAGE FEATURE POINTS?", ELECTRONICS & COMMUNICATIONS IN JAPAN, PART III - FUNDAMENTAL ELECTRONIC SCIENCE, SCRIPTA TECHNICA. NEW YORK, US, TRANSLATION, vol. 86, no. 1, PART 3, 2003, pages 1 - 10, XP001127586, ISSN: 1042-0967
MALASSIOTIS S ET AL: "Tracking the left ventricle in echocardiographic images by learning heart dynamics", IEEE TRANSACTIONS ON MEDICAL IMAGING, IEEE INC. NEW YORK, US, vol. 18, no. 3, March 1999 (1999-03-01), pages 282 - 290, XP002285161, ISSN: 0278-0062
DUNCAN J S ET AL: "Measurement of non-rigid motion using contour shape descriptors", PROCEEDINGS OF THE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. LAHAINA, MAUI, HAWAII, JUNE 3 - 6, 1991, LOS ALAMITOS, IEEE. COMP. SOC. PRESS, US, 3 June 1991 (1991-06-03), pages 318 - 324, XP010023226, ISBN: 0-8186-2148-6
RAMACHANDRAN G ET AL: "Left Ventricle Wall Motion Analysis During Various Phases Of Cardiac Cycle From 2D-Echocardiographic Images", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, 1991. VOL.13: 1991., PROCEEDINGS OF THE ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ORLANDO, FL, USA 31 OCT.-3 NOV. 1991, NEW YORK, NY, USA,IEEE, US, 31 October 1991 (1991-10-31), pages 235 - 236, XP010102263, ISBN: 0-7803-0216-8
BOHS L N ET AL: "Real Time Ultrasonic Flow Imaging NSF/ERC Unit 2.1 B", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, 1990., PROCEEDINGS OF THE TWELFTH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE PHILADELPHIA, PA, USA 1-4 NOV. 1990, NEW YORK, NY, USA,IEEE, US, 1 November 1990 (1990-11-01), pages 670 - 670, XP010036083, ISBN: 0-87942-559-8
GUSE R ET AL: "RGPSview: a tool for RGPS data visualization", GEOSCIENCE AND REMOTE SENSING SYMPOSIUN, 2000. PROCEEDINGS. IGARSS 2000. IEEE 2000 INTERNATIONAL 24-28 JULY 2000, PISCATAWAY, NJ, USA,IEEE, vol. 7, 24 July 2000 (2000-07-24), pages 3006 - 3008, XP010506260, ISBN: 0-7803-6359-0
COMANICLU D: "Density estimation-based information fusion for multiple motion computation", MOTION AND VIDEO COMPUTING, 2002. PROCEEDINGS. WORKSHOP ON 5-6 DEC. 2002, PISCATAWAY, NJ, USA,IEEE, 5 December 2002 (2002-12-05), pages 241 - 246, XP010628808, ISBN: 0-7695-1860-5
Download PDF: