Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
APPARATUS AND METHOD FOR DETERMINING MOVING RANGE OF REGIONS OF HUMAN BODY
Document Type and Number:
WIPO Patent Application WO/2001/027563
Kind Code:
A1
Abstract:
Disclosed is an apparatus and method for measuring a moving range of a human body region. The apparatus includes an information selection section for selecting and inputting information required for an exercise of the human body region, a shade forming section for forming a shade difference between a background and the human body region by irradiating light to the human body region, an image input section for inputting an image of the human body region having a shade difference from the background, a control and information processing section for converting the input shaded image into binary image data, measuring the moving range of the human body region according to lapse of time, and simultaneously comparing and analyzing information on the measured human body region, and an output section for outputting a result of measurement. According to the apparatus, the position recognition, coordinate calculation, and moving range calculation of the human body region can be effected. Also, a posture correction and a real-time measurement of a reaction time and moving path of the human body region can be performed according to the lapse of time.

Inventors:
CHOI JONG JU (KR)
Application Number:
PCT/KR2000/001134
Publication Date:
April 19, 2001
Filing Date:
October 11, 2000
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
CHOI JONG JU (KR)
International Classes:
G01C22/00; A61B5/103; A61B5/107; G01S3/784; G06F3/00; G06F3/01; G06T7/20; A63B71/06; (IPC1-7): G01C22/00; G01B11/00
Foreign References:
JPH06326912A1994-11-25
JPH11216996A1999-08-10
JPH02115702A1990-04-27
KR970007740A1997-02-21
Attorney, Agent or Firm:
Kim, Yeon Soo (Dacom Bldg 706-1 Yeoksam-dong Kangnam-gu Seoul 135-987, KR)
Download PDF:
Claims:
WHAT IS CLAIMED IS :
1. An apparatus for measuring a moving range of a human body region, comprising: information selection means for selecting and inputting information required for an exercise of the human body region; shade forming means for forming a shade difference between a background and the human body region by irradiating light to the human body region; image input means for inputting an image of the human body region having a shade difference from the background; control and information processing means for converting the input shaded image into binary image data, recognizing a position of the human body region using the image data, calculating coordinates of the human body region using the position of the recognized human body region, and measuring the moving range of the human body region according to the lapse of time using the calculated coordinates of the human body region, the control and information processing means simultaneously comparing and analyzing information on the measured human body region; and output means for outputting a result of measurement.
2. The apparatus as claimed in claim 1, further comprising an auxiliary storage means for storing data of image information required for the exercise of the human body region and measured information.
3. The apparatus as claimed in claim 1,. further comprising an information transfer means for transferring image information required for the exercise selected through the information selection means to a person in experiment.
4. The apparatus as claimed in claim 1, wherein the information selection means selects the human body region to be measured, a total measuring time and a measuring period of the human body region.
5. The apparatus as claimed in any one of claims 1 to 4, the shade forming means comprises: a screen member installed in front or rear of the human body; one or more light sources for irradiating light to the human body region; and an illumination section for turning on or off the light sources.
6. The apparatus as claimed in claim 5, wherein the human body is positioned between the light sources and the screen member, and the image input means inputs an image projected on a rear surface of the screen member.
7. The apparatus as claimed in claim 5, wherein the human body is positioned in front of the screen member, the light sources are positioned in rear of the screen member, and the image input means inputs an image of the human body with a front surface of the screen member for a background.
8. The apparatus as claimed in claim 5, in case that a plurality of light sources are installed, the control means controls the illumination section to selectively turn on the light sources in accordance with the human body region to be measured.
9. The apparatus as claimed in claim 1, wherein the information processing means performs binarization of the input shaded image of the human body region and the background region, recognizes the human body region using the binary image, calculate coordinate of the recognized the human body region, measures the moving. range, moving path, and reaction time with a lapse of time using the coordinates of the recognized human body region, and compares and analyzes information of the measured human body region.
10. A method for measuring a moving range of a human body region, comprising: an information selection step of selecting and inputting information required for an exercise of the human body region; a shade forming step of forming a shade difference between a background and the human body region by irradiating light to the human body region ; an image input step of inputting an image of the human body region having a shade difference from the background; a measuring step of measuring coordinates of the human body region and the moving range thereof by processing the input data; and an output step of outputting a result of measurement.
11. The method as claimed in claim 10, further comprising a step of storing the measured resultant information.
12. The method as claimed in claim 10, further comprising an information transfer step of transferring image information required for the exercise selected at the information selection step to a person in experiment.
13. The method as claimed in claim 10, wherein at the information selection step, measuring time point information such as a measuring period, measuring time point, and a random measuring time point, and information required for the exercise are selected.
14. The method as claimed in claim 10, wherein at the information selection step, the human body region to be measured, total measuring time, and measuring period are selected.
15. The method as claimed in claim 12, wherein at the information selection step, the person in experiment selects kinds of images of the stored human body region.
16. The method as claimed in claim 12, wherein at the information selection step, the person in experiment selects types of information on performance of the exercise.
17. The method as claimed in claim 12, wherein at the information selection step, standard image information on performance of the exercise is provided to the person in experiment at a predetermined measuring time point, and the person in experiment performs an imitated posture using the provided standard image information.
18. The method as claimed in claim 12 or 17, wherein at the information selection step, standard image information on performance of the exercise is provided to the person in experiment at a predetermined measuring time point, the person in experiment performs an imitated posture using the provided standard image information, a similarity to provided image information is detected by measuring the imitated posture of the person in experiment, and a result of detection of the similarity is displayed.
19. The method as claimed in claim 12 or 17, wherein at the information selection step, position information on performance of the exercise is provided to the person in experiment at a random measuring time point, and the person in experiment performs the exercise using the provided position information.
20. The method as claimed in claim 1Q, wherein at the measuring step, binarization of the preprocessed human body region and screen background region is performed, a coordinate of the human body region is calculated using the binary image, and a position, moving range, and moving path of the human body region are measured according to the calculated coordinate.
21. A method for measuring a moving range of a human body region, comprising: an exercise information selection and input step of selecting and inputting information required for an exercise; an exercise start information step of outputting exercise start information; a measured information transfer step of transferring the selected exercise information to a person in experiment at a measuring time point; an irradiation step of selecting a light source, and irradiating light to the measured human body region that performs an exercise; an image input step of inputting a shaded image by forming the shaded image by projecting an image for the human body region on a screen member using the light source irradiating the light to the human body region; an image preprocessing step of binarizing the input shaded image; a human body region position recognizing step of recognizing a position of the human body region to be measured using a binary image; a human body region position calculating step using the recognized position of the human body region; a human body region moving range measuring step of measuring a moving range of the human body region according to lapse of time by measuring a positional coordinate of the human body region at intervals of a measuring period; and a measurement result output step of outputting a result of measurement.
22. A method for measuring a moving range of a human body region, comprising: a standard image information item selection step of selecting and inputting information required for an exercise; an exercise start information step of outputting a start information of the exercise; a standard image information transfer step of transferring standard image information required at a measuring time point during performance of the selected exercise to a person in experiment; an irradiation step of selecting a light source, and irradiating light to the measured human body region that performs an exercise; an image input step of inputting a shaded image by forming the. shaded image by projecting an image for the human body region on a screen using the light source irradiating the light to the human body region; an image preprocessing step of binarizing the input shaded image; a human body region position recognizing step of recognizing a position of the human body region to be measured using a binary image; a human body region position calculating step using the recognized position of the human body region; a human body region moving range measuring step of measuring a moving range of the human body region, according to lapse of time by measuring a positional coordinate of the human body region at the measuring time point; an image information comparison step of receiving the image that performs the exercise at the measuring time point, measuring the position coordinate and the moving range of the human body region, and comparing the measured image information with the standard image information; and a resultant information output step of outputting a resultant information.
23. A method for measuring a moving range of a human body region, comprising : a standard image information item selection step of selecting and inputting information required for an exercise; an exercise start information step of outputting a start of the exercise; a positional information transfer step of transferring positional information required for the exercise selected at the information selection step to a person in experiment at a random measuring time point; an irradiation step of selecting a light source, and irradiating light to the measured human body region that performs an exercise; an image input step of inputting a shaded image by forming the shaded image by projecting an image for the human body region on a screen using the light source irradiating the light to the human body region; an image preprocessing step of binarizing the input shaded image; a human body region position recognizing step of recognizing a position of the human body region to be measured using a binary image; a human body region position calculating step using the recognized position of the human body region; a human body region moving range measuring step of measuring a moving range of the human body region according to lapse of time by measuring a positional coordinate of the human body region at the measuring time point; a reaction time and moving path measuring step of measuring a reaction time and a moving path of the human body region using the information on the human body region that performs the exercise; and a resultant information output step of outputting a result of measurement.
Description:
APPARATUS AND METHOD FOR DETERMINING MOVING RANGE OF REGIONS OF HUMAN BODY FIELD OF THE INVENTION AND DESCRIPTION OF THE RELATED ART The present invention relates to an apparatus and method for measuring a moving range of a human body region. In particular, the present invention relates to an apparatus and method for measuring a moving range of a human body region by recognizing a position of the human body region by binarization of an input image using an image input means for a predetermined time, calculating coordinates of the human body region, and then measuring the moving range of the human body region according to the lapse of time.

Generally, one among human body measuring apparatuses uses a pressure plate for measuring an amount of exercise of the human body. This apparatus measures the exercising state of the human body by normalizing a pressure state between the human body region and the ground during the exercise of the human body.

That is, according to the human body measuring apparatus, a plurality of load cells are attached to a main body of the pressure plate, and pressure sensors are installed on the load cells. The pressure change between the. human body region and the load cells attached to the pressure plate during the exercise of the human body is converted into a voltage change, the voltage is normalized by converting it into a digital form, and then the amount of exercise of the human body is detected by measuring the pressure change caused by the continuous exercise of the human body.

Another conventional apparatus for measuring a moving range of a human body region attaching a marker on a specified region of the human body, and receives a position change of a human body region through a camera, and calculating the moving range of the human body region by calculating coordinate values of the position of the. marker attached to the specified region.

TECHNICAL SUBJET TO BE ACCOMPLISHED BY THE INVENTION The conventional apparatuses for detecting the amount of exercise of the human body, however, have the drawbacks in that since it measures the amount of exercise by converting the moving range of the human body region (for example, a foot) contacted to the pressure plate with the lapse of time into the pressure state, the measurement of the position of the specified human body region and the moving range of the human body region should be performed using the pressure state between the pressure plate and the human body.

Also, according to the convention apparatus for measuring the moving range of the human body, since the marker is attached to the specified region of the human body to be measured, the exercising range and the posture of the human body are restrictive, and the psychological burden of the person in experimentation becomes heavier.

Therefore, an object of the invention is to solve the problems involved in the related art, and to provide an apparatus and method of measuring a moving range of a human body region which can recognize the position of the human

body region and calculate coordinates of the human body region by binarizing an image of the human body region inputted through an image input means and extracting a human body area using the binary coded image during measurement of the human body region, and which can calculate the moving range of the human body region using the measurement of the human body region, presents a posture correction method for the exercise of the human body region, and perform a real-time measurement of a reaction time of the human body region according to the lapse of time and moving path of the human body region.

BRIEF DESCRiPTION OF THE DRAWINGS The above object, and other features and advantages of the present invention will become more apparent after a reading of the following detailed description when taken in conjunction with the drawings, in which: FIG. 1 is a schematic view illustrating the apparatus for measuring a moving range of a human body region according to an embodiment of the present invention; FIG. 2 is a block diagram of a control section of the apparatus for measuring a moving range of a human body region according to an embodiment of the present invention; FIG. 3A is a partial expanded view of an image input means according to an embodiment of the present invention; FIG. 3B is a partial expanded view of an image input means according to another embodiment of the present invention;

FIG. 4A is a flowchart illustrating the method of measuring a moving range of a human body region according to an embodiment of the present invention; FIG. 4B is a flowchart illustrating the method of measuring a moving range of a human body region according to another embodiment of the present invention; FIG. 4C is a flowchart illustrating the method of measuring a moving range of a human body region according to still another embodiment of the present invention; FIG. 5A is a view illustrating a human body region irradiated by a light source for the recognition of the human body region according to an embodiment of the present invention; FIG. 5B is a view illustrating a human body region irradiated by a light source of a different position for the recognition of the human body region according to an embodiment of the present invention; FIG. 6A is a view illustrating an input binary image and areas determined for the recognition of a human body region to be measured according to an embodiment of the present invention; FIG. 6B is a view explaining the measurement of a human body region in an input binary image according to an embodiment of the present invention; FIG. 7A is a sectional view where coordinates of three-dimensional space are projected on X and Z axes to explain the measuring method of coordinates ZM of a human body region; FIG. 7B is a sectional view where coordinates of three-dimensional space are projected on X and Y axes to explain the measuring method of

coordinates YM of a human body region; FIG. 7C is a sectional view where coordinates of three-dimensional space are projected on X and Y axes to explain the measuring method of coordinates XM of a human body region; FIG. 8A is a data table showing moving ranges of a human body region measured in a measurement period according to an embodiment of the present invention; FIG. 8B is a graph showing moving range data of a human body region measured in a measurement period according to an embodiment of the present invention; FIG. 9A is a view illustrating standard image information and standard position information at a measurement time point according to another embodiment of the present invention; FIG. 9B is a view explaining a feature value extraction using standard position information at a measurement time point according to another embodiment of the present invention; FIG. 9C is a view illustrating input'image information and measured position information at a measurement time point according to another embodiment of the present invention; FIG. 9D is a view expiaining a feature value extraction using measured position information at a measurement time point according to another embodiment of the present invention; FIG. 9E is a view illustrating standard image information and input image information outputted to an information transfer means at a measurement time point according to another embodiment of the present

invention; FIG. 10A is a table showing standard image information during the total measurement time and standard position information of a standard human body at a measurement time point according to another embodiment of the present invention; FIG. 10B is a comparative table of image information using standard position information and measured position information according to a measurement time point according to another embodiment of the present invention; FIG. 11A is a view illustrating an input image at a specified time point t according to still another embodiment of the present invention; FIG. 11B is a view illustrating an overlay image at a specified time point t according to still another embodiment of the present invention; FIG. 11C is a view illustrating an image outputted to an information transfer means at a specified time point t according to still another embodiment of the present invention; FIG. 11D is a view illustrating an image outputted to an information transfer means at a specified time point t+i according to still another embodiment of the present invention; FIG. 11E is a view illustrating an image outputted to an information transfer means at a specified time point t+i+1 according to still another embodiment of the present invention; and FIG. 11F is a view illustrating an image outputted to an information transfer means at a specified time point t+i+2 according to still another embodiment of the present invention.

STRUCTURE AND OPERATION OF THE INVENTION In one aspect of the present invention, there is provided an apparatus for measuring a moving range of a human body region, comprising an information selection means for selecting and inputting information required for an exercise of the human body region, a shade forming means for forming a shade difference between a background and the human body region by irradiating light to the human body region, an image input means for inputting an image of the human body region having a distinct shade difference from the ground, a control and information processing means for converting the input shaded image into binary image data, recognizing a position of the human body region using the image data, calculating coordinates of the human body region using the position of the recognized human body region, and measuring the moving range of the human body region according to the lapse of time using the calculated coordinates of the human body region, the control and information processing means simultaneously comparing and analyzing information on the measured human body region, and an output me. ans for outputting a result of measurement.

In another aspect of the present invention, there is provided a method of measuring a moving range of a human body region, comprising an information selection step of selecting and inputting information required for an exercise of the human body region, a shade forming step of forming a shade difference between a background and the human body region by irradiating light to the human body region, an image input step of inputting an image of the human body region having a distinct shade difference from the ground, a

measuring step of measuring coordinates of the human body region and the moving range thereof by processing the input data, and an output step of outputting a result of measurement.

Hereinafter, the present invention will be described with respect to the preferred embodiments illustrated in the annexed drawings.

FIG. 1 is a schematic view illustrating the apparatus for measuring a moving range of a human body region according to an embodiment of the present invention, and FIG. 2 is a block diagram of a control section of the apparatus for measuring a moving range of a human body region according to an embodiment of the present invention. FIG. 3A is a partial expanded view of an image input means according to an embodiment of the present invention, and FIG. 3B is a partial expanded view of an image input means according to another embodiment of the present invention. FIG. 4A is a flowchart illustrating the method of measuring a moving range of a human body region according to an embodiment of the present invention.

As shown in FIG. 1, the apparatus for measuring a moving range of a human body region according to the preferred embodiment of the present invention includes an information selection section 100, an information transfer section 200, an image input section 350, a control section 400, an information processing section 401, an auxiliary storage section 420, and an output section 500.

The information selection section 100 selects and inputs exercise information required for an measurement of the human body region. For instance, the information selection section 100 selects a motion for the exercise using a keyboard, mouse, touch screen, etc.

The information transfer section 200 transfers information on the selected motion to a person in experiment who performs the exercise. For instance, the information transfer section 200 may be a monitor, screen projector, sound device, etc., and is installed in a front position that comes within the range of the person in experiment.

The image input section 350 comprises an illumination section 300, screen member 320, camera 330, and image input board 340. A shaded image S of a human body region M is projected on the screen member 320 by selecting and irradiating light to the human body region M that performs the exercise, and the shaded image S projected on the screen member-320 is inputted to the camera 330.

The illumination section 300 in the image input means 350 comprises light sources 301,302, and 303 located in different positions, and a device for controlling on/off of the light sources. If needed, additional light sources may be employed. The light sources are installed in the front of the human body who performs the exercise, and irradiate light to the human body region so that the shaded image for the human body region M is projected on the screen member.

For instance, according to the apparatus for measuring the moving range of the human body region as shown in FIG. 3A, a specified reference point (0,0,0) is determined in a three-dimensional space. The light source 301 is positioned at a point PL1= (XL1, YL1, ZL1), the light source 302 is positioned at a point PL2= (XL2, YL2, ZL2), and the light source 303 is positioned at a point PL3= (XL3, YL3, ZL3).

Accordingly, in case of performing the measurement of the human body region, a proper light source among the light sources 301,302, and 303, that

can form the shaded image S on the screen member 320 by irradiating light to the human body region M.

Also, the illumination section 300 in the image input section 350 is connected to the image input board or the control section 400 and information processing section 401 so that the light sources 301,302, and 303 located in different positions are controlled to be turned on/off simultaneously with the input of the image at the measurement time point.

The screen member 320 in the image input section 350 is installed in the rear of the human body. The light sources 301,302, and 303 irradiate light to the human body, and an image of the human body region M is projected on the screen member 320 to form the shaded image S thereon. The screen member 320 is made of materials such as semitransparent glass that shows on its rear surface the image projected onto its front surface.

The camera 330 in the image input section 350 is installed in the rear of the screen member 320, and photographs the shaded image of the human body region formed on the screen member. In case that the human body region M moves fast, or on/off operation of the light sources 301,302, and 303 in the different positions is required at a specified time point, the camera 330 for photographing the image may be installed with its specification modified.

For instance, a general RS-170 type camera receives 30 frames of image per second, and produces a time delay of 30msec in order to receive a frame. In case that the input of sequential images formed by other light sources in different positions is required during at a specified time point for the coordinate measurement of the human body region, a high frame rate area scan camera (for example, a CA-D1-0128 camera of 840 frame/second

manufactured by DALSA INC.) may be used, or two or more cameras may be installed and used.

The human body region M is positioned between the light sources 301, 302, and 303 and the screen member 320, and the camera 330 is installed in the rear of the screen member 320. However, the positions of the light sources and the camera may be changed if needed.

For example, as shown in FIG. 3B, if the light source 305 irradiate light uniformly to the area of the screen member 320 after the camera 330 is installed in the position of the light sources 301,302, and 303 located in the front of the human body region M and the screen member 320 is installed in the rear of the human body region M, the same shaded image S with the screen member 320 for a background can be obtained. In case of changing the measuring position of the human body region, the camera may be installed in the position of the light sources 301,302, and 303 of the human body region to be measured.

The image input board 340 in the image input section 350 receives the shaded image S photographed by the camera at the measurement time point t, and transfers the shaded image S to the information processing section 401 and the control section 400. Also, the image input board 340 transfers an image input signal produced from the control section to the camera 330 to photograph the image from the camera, or connects the signal to the illumination section 300 to turn on/off the light sources 301,302, and 303 when the shaded image S is inputted, or the light sources are turned on/off.

The control section 400 and the information processing section 401 can be divided into the control section 400 for input/output and control of the

image information, and the information processing section 401 for extracting information on the human body region using the input image. The control section 400 and the information processing section 401 may be implemented using a computer main body, I/0 board, memory, and processor.

The control section 400 is for the input/output and control of the image information, and performs the selective input of information required for the exercise inputted from the information selection section 100, output of information to the information transfer section 200, control of the illumination section 300, control of the image input board 340 at the measurement time point t of the human body region, search and storage of information through the auxiliary storage section 420, and output of a result of measurement to the output section 500.

The information processing section 401 performs binarization of the input shaded image S, position recognition of the human body region using the binary image, coordinate calculation of the human body region using the recognized position of the human body region, moving range measurement of the human body region with the lapse of time using the calculated coordinate of the human body region, and information comparison and analysis using information stored in the auxiliary storage section 420.

The auxiliary storage section 420 such as a hard disc is used for storage of the image information data required for selecting the exercise of the human body and the measured image information.

Now, the operation of the apparatus for measuring the moving range of the human body region according to the present invention as constructed above will be explained with reference to F ! Gs. 1, and 4A to 8B.

At an initialization step 800 of FIG. 4A, the information selection section 100, information transfer section 200, image input section 350, control section 400, information processing section 401, auxiliary storage section 420, and output section 500 are initialized when the power is supplied from the outside.

In addition, in the auxiliary storage section 420 is stored the data for the items for selecting the information on the exercise (for example, items for kinds of exercise such as a standing run, high jump, etc.).

At an exercise information selection and input step 810, the person in experiment selects information on the exercise using the information selection section 100. If the person in experiment instructs to start the measurement after inputting the total measuring time TS, measuring period Tn, and. human body region to be measured, a signal produced from the information selection section 100 is inputted to the control section 400.

At an exercise start information step 815, a program including an image preprocessing algorithm for analyzing the image stored in the auxiliary storage device 420 in the control section 400 and information processing section 401, algorithm for recognizing a position of the human body region, algorithm for calculating coordinates of the human body region, and image processing algorithm for the measurement of the moving range of the human body region is loaded using the information produced at the exercise information selection and input step 810.

Also, at the exercise start information step 815, the information on the exercise selected by the person in experiment is outputted to the information transfer section 200, and an exercise start signal is displayed through the

information transfer section 200, so that the person in experiment performs the exercise.

At a measured information transfer step 820, the real-time information on the image of the human body region, positional coordinates of the human body region, and moving range of the human body region is outputted to the information transfer section 200.

At a measuring period comparison step 825, the step proceeds to an irradiating step 830 to perform the measurement of the human body region if the measuring time point is the time point of the measuring period Tn during the performance of the exercise.

Next, the illumination section 300 for controlling the light sources 301, 302, and 303 using the image input section 350, the camera 330 for receiving the shaded image S of the human body region M projected on the screen member 320, and the image input board 340 for transferring the input shaded image S to the control section 400 and information processing section 401 will be explained in detail.

At an irradiation step 830, a selection signal for selecting the light sources positioned on the human body region measured at the measurement time point t is outputted from the control section 400 to the illumination section 300, and the illumination section 300 selectively turns on the light sources 301,302, and 303 using the signal inputted from the control'section 400.

For example, as shown in FIG. 5A, in case of performing the measurement of the upper part of the human body region M, the shaded image S is projected on the screen member 320 by the irradiation of the light source

301 to the upper part of the human body region.

Also, as shown in FIG. 5B, in case of performing the measurement of the lower part of the human body region M, the shaded image S is projected on the screen member 320 by the irradiation of the light source 303 to the lower part of the human body region.

At an image input step 840, the shaded image S of the human body region projected on the screen member 320 by the irradiation of the light source is inputted using the camera 330, the image signal inputted by the camera is transferred to the image input board 340, and then the image signal inputted by the image input board is transferred to the information processing section 401.

At an image preprocessing step 850, the image is converted into a binary image composed of black and white using the shaded image S inputted by the image input section 350. Specifically ; if a threshold value is applied to the shaded image S, the area of the screen member 320 represents white, and the area of the human body region M represents black.

At a human body region recognizing step 860, the information on the position of the human body region is extracted using the binary image P produced at the image preprocessing step 850. This operation will be explained in detail with reference to FlGs. 6A and 6B.

For example, the selection information (i. e., measuring time, period of the measuring time, human body region to be measured-tiptoe, and moving range of the human body region to be measured for the measuring time) for calculating the position of the tiptoe during the performance of the standing run is processed at the exercise information selection and input step 810 using the

information selection section 100. The selection information inputted by the information selection section 100 is transferred to the control section 400 and information processing section 401, and the information on the selection section 100 transferred to the control section 400 and information processing section 401 is loaded with an algorithm required for the image processing using the auxiliary storage section 420.

Also, the control section 400 and information processing section 401 transfers to the information transfer section 200 the exercise start information 815 for performing the selected exercise to display the start signal of the exercise through the information transfer section 200. The information transfer section 200 display the start signal, and thus the person in experiment recognizes the start signal and performs the exercise.

At the human body region recognizing step 860, the image input section 350 transfers the image input signal to the illumination section 300 and the image input board 340 using the control section 400 in order that the person in experiment receives the image of the human body region inputted by the selection section at the time point of the measuring period, and selects the light source 303 located on the human body region to be measured using the image input signal inputted to the illumination section 300. The light irradiated from the light source 303 is transmitted to the human body region M to form the shaded image S projected on the screen member 320, and the shaded image is inputted through the camera 303.

At the human body region recognizing step 860, the camera 330 receives the shaded image S from the screen member 320, and transfers the image signal to the image input board 340. The image input board 340

transfers the input image signal to the information processing section 401.

At the human body region recognizing step 860, the input image of the human body region M is converted into the binary image P as shown in FIG. 6A.

At the human body region recognizing step 860, the binary image P is divided into an area A and area B as shown in FIG. 6A, and the value of the black potion closest to the lower end of the respective area is calculated.

Specifically, as shown in FIG. 6B, the recognized coordinate value (YPFL, ZPFL) of the end position of the left foot can be calculated from the image in the area A, and the recognized coordinate value (YPFR, ZPFR) of the end position of the right foot can be calculated from the image in the area B.

Also, in order to calculate the positional coordinates of the human body region, it is assumed that the image inputted by the screen member 320 is calibrated. The calibration method is as follows.

For example, if it is assumed that the horizontal width YST of the y axis of the screen member 320 is 250 [cm], and the vertical height ZST of the Z axis of the screen member 320 is 240 [cm], and if it is assumed that the camera 330 receives the image in coincidence with the screen member 320, and the resolution of the image is horizontal (Y) 640 pixels * vertical (Z) 480 pixels, the resolution of the screen member 320 corresponding to one horizontal (Y) pixel is 250 [cm]/640 = 0.390625 [cm], and the resolution of the screen member 320 corresponding to one vertical (Z) pixel is 240 [cm]/480 = 0.5 [cm].

Then, the coordinate value of the image projected on the screen member is calculated using the horizontal and vertical resolutions calculated as above.

For example, if the coordinates of Y axis of the position of the human

body region in the binary image P inputted from the screen member 320 are 320 pixels and the coordinates of Z axis are 300 pixels, the Y coordinates positioned on the screen member are 0.390625320 = 125 [cm], and the Z coordinates are 0.5300 = 150 [cm].

Accordingly, the recognized coordinate value (YPFL, ZPFL) of the end portion of the left foot in the image of the area A is converted into the position (0.390625xYPFL, 0.5xZPFL) of the screen member, and the recognized coordinate value (YPFR, ZPFR) of the end portion of the right foot in the image of the area B is converted into the position (YS, ZS) = (0.390625xYPFL, 0.5xZPFL) of the screen member.

At a step 870 of calculating coordinates of the human body region, the coordinates of the actual human body region is calculated using the coordinates of the human body region positioned on the screen member 320, and will now be explained with reference to FIGs. 7A, 7B, and 7C.

According to the apparatus for measuring the moving range of the human body region, a specified reference point P= (0,0, 0) is determined in a three-dimensional space. The light source 301 is positioned at a point PL1= (XL1, YL1, ZL1), the light source 302 is positioned at a point PL2= (XL2, YL2, ZL2), and the light source 303 is positioned at a point PL3= (XL3, YL3, ZL3). The measured region of the human body region M irradiated from the light sources 301,302, and 303 is positioned at (XM, YM, ZM), and is positioned on the screen member 320 (XS, YS1, ZS1) that represents the shaded image S of the human body region projected. by the irradiation of the light sources 301,302, and 303.

For example, in case that the person in experiment performs the

exercise in a predetermined position, the positional coordinate XM of the human body region of X axis becomes a fixed value.

Accordingly, the calculation of the Z-axis coordinate ZM and the Y-axis coordinate YM except for the positional coordinate XM of the human body region, after the person in experiment selects the upper end of the head as the human body region to be measured at the exercise information selection and input step 810, will be explained with reference to FIGs. 7A and 7B.

In order to calculate the coordinate ZM on Z axis, the light source 301 for irradiating the upper end portion of the human body region is selected, and the shaded image S for the human body region is formed on the screen member by the light source 301. If the coordinate in the space is projected on X and Z axes, the sectional view as shown in FIG. 7A is obtained, and an equation using this is given by [Equation 1] (ZL1-ZM) : (XM-XL1) = (ZL1-ZS1): (XS-XL1) ZM = ZL1- (XM-XL1) (ZL1-ZS1)/ (XS-XL1) In order to calculate the coordinate YM on Y axis, the light source 301 for irradiating the upper end portion of the human body region is selected, and the shaded image S for the human body region is formed on the screen member by the light source 301. If the coordinate in the space is projected on X and Y axes, the sectional view as shown in FIG. 7B is obtained, and an equation using this is given by [Equation 2] (YL1 YM) : (XM-XL1) = (YL1-YS1) : (XS-XL1) YM = YL1- (XM-XL1) (YL1-YS1)/ (XS-XL1)

Meanwhile, in case that the value of the positional coordinate XM of the human body region on X axis is not determined for the predetermined position, it is calculated as follows.

For instance, in case of performing the measurement of the upper end of the head and the calculation of the coordinate value of XM, the image input process is as follows.

In order to calculate the value of the positional coordinate XM of the human body region in a period of the image input time during performing the exercise, the control section 400 selects the light source 301 located in a specified position (XL1, YL1, ZL1) close to the human body region to be measured, and inputs an image by irradiating light for a short time (for example, within 1000 msec). Then, the control section 400 selects the light source 302 in another specified position (XL2, YL2, ZL2), and sequentially inputs an image by irradiating light for a short time.

The input image is converted into the binary image P at the image preprocessing step 850, and transferred to the human body region recognizing step 860. At the human body region recognizing step 860, the coordinate where the human body region is projected on the screen member is calculated using the binary image at the image preprocessing step, and then transferred to the step 870 of calculating the coordinate of the human body region. At the step 870, the value of the coordinate XM of the human body region is calculated using the positional coordinates (XS, YS1, ZS1) and (XS, YS2, ZS2) of the two images projected on the screen member.

In order to calculate the coordinate XM on X axis, the coordinate. in the space with respect to the positional coordinates (XS, YS1, ZS1) and (XS, YS2,

ZS2) projected on the screen member is projected on X and Y axes as shown in FIG. 7C. The coordinate XM is obtained by calculating the cross point of the straight line effected by two points (XL1, YL1) and (XS, YS1) and the straight line effected by two points (XL2, YL2) and (XS, YS2).

[Equation 3] (YM-YL1) = (YS1-YL1) (XM-XL1)/(XS-XL1) <BR> <BR> <BR> <BR> <BR> <BR> (YM-YL2) = (YS2-YL2) (XM-XL1)/ (XS-XL2)<BR> <BR> <BR> <BR> VM (XSYL1) (XSXL2)<BR> <BR> (YSl-YLl) (XS-XL2)- (YS2--YL2) (XS-XLl)<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> XL2(YS2 - YL2) XL1(YS1 - YL1)<BR> *{(YL2 - YL10 - }<BR> (XS - XL2) XS - XL1 Accordingly, at the step 870 of calculating the coordinate of the human body region, the coordinates of the actual human body region can be calculated using the coordinate (XM, YM, ZM) of the human body region positioned on the screen member 320 calculated at the step of recognizing the position of the human body region.

At a step 880 of measuring a moving range of a human body region, the moving range of the human body region at intervals among time points with the lapse of time is measured after the positional coordinate (XM, YM, ZM) of the human body region is measured at intervals of the measuring period Tn for a predetermined time at the step 870 of calculating the coordinates of the human body region. This step 880 will be explained in detail with reference to FIGs. 8A and 8B.

FIG. 8A is a data table showing a moving range of a human body region measured in a measurement period according to an embodiment of the present invention. In the data table, the coordinate (XM, YM, ZM) of the human body region positioned on the screen member 320 calculated at the step 870 of

calculating the coordinates of the human body region is calculated, and then the moving range according to the measurement period is measured.

For example, the number of periodic round trips and the moving range of the tiptoe during the standing run are measured as an example of measuring the moving range of the human body region of the person in experiment for a predetermined time. If it is assumed that the total measuring time TS is 10 seconds and the measuring period Tn of the human body region is 1 second, the coordinate value (XM, YM, ZM) of the position of the human body region for each time point t (0) <t (1) <t (2).. <t (9) <t (10) with the lapse of time is calculated.

Also, if the coordinate value (XM2, YM2, ZM2) of the position of the end portion of the right foot at the time point t (2) is (350,120,0), and the coordinate value (XM3, YM3, ZM3) of the position of the end portion of the right foot at the time point t (3) is (343,116,34), the distance in the 3-dimensional space will be 37.8682 [cm] by the following equation.

[Equation 4] d = SQRT { (XM2-XM3) 2 + (YM2-YM3) 2 + (ZM2-ZM3) } Accordingly, the moving range of the human body region when the above process is performed for the exercise time (i. e., 10 seconds) may be given as shown in FIG. 8A, and the graph using the moving range of human body region measured as shown in FIG. 8A may be obtained as shown in. FIG.

8B.

At a step 910 of comparing the completion of the total measuring time, the completion of measurement is judged using information on the total measuring time TS, measuring period Tn, and measuring time point t selected

at the exercise information selection and input step 810.

For example, if the measuring time point t in the measuring period Tn is judged to be below the total measuring time TS, the step returns to the measured information transfer step 820 to perform the display of the input image, coordinate calculation of the human body region, and measurement of the moving range. If the measuring time point t exceeds the total measuring time TS, the measurement of the human body region is completed.

At a measurement result output step 920, the total measuring time TS, measuring period Tn, measuring time point t, items of the selected exercise information, human body region to be measured, these being selected at the exercise information selection and input step 810, and information on the moving range of the human body region measured for the total measuring time are outputted to the output section 500.

As a result, according to one embodiment of the present invention, using the information on the moving range of the human body region, the information on the measurement of the total moving range of the human body region (i. e., left foot or right foot) according to the total measuring time TS and the measurement of fatigue feature of the person in experiment according to the lapse of time (for example, the moving range of the right foot and left foot is big at the start time of the exercise, but the moving range of the left foot and the right foot gradually becomes smaller due to the fatigue as the time passes), and information on the analysis of information during the exercise of the human body region (for example, if the moving range of the left foot of the person in experiment is smaller than that of the right foot, correction information for the human body region is presented) can be obtained.

Hereinafter, the apparatus and method of measuring a moving range of a human body region according to another embodiment of the present invention will be explained with reference to F ! Gs. 4B, 9A to 9E, 10A and 10B.

In another embodiment of the present invention, the apparatus and method of measuring a position and a moving path of a human body region at a given time point is provided.

An initialization step 801 is the same as the initialization step 800 of one embodiment of the present invention as described above.

In the auxiliary storage section 420 is stored the data of the standard image information for selecting the information on the exercise, and the standard image information includes the standard image for the total measuring time TS, information on the measuring time point Tn, and information on the measured region of the standard human body at the measuring time point (for example, items for kinds of diverse dances and moving image information).

At a step 811 of selecting an item of the standard image information, if the person in experiment instructs to start the measurement by selecting the item of the standard image information using the information selection'section 100, a signal produced from the information selection section 100 is inputted to the control section 400.

The exercise start information step 816 uses the information produced at the step 811 of selecting an item of the standard image information, and is the same as the exercise start information step 815 of one embodiment of the present invention.

At a standard image information transfer step 821, the moving image

for the standard image information selected during the total measuring time TS is displayed through the information transfer section 200.

FIG. 10A shown the standard image information (for example, FIG. 9A) to be displayed during the total measuring time, and the standard position information (for example, the position information of the human body region for PH (j), PHL (j), PHR (j), PFL (j), and PFR (j) in FIG. 9A) at the measuring time point.

At the measuring time point comparing step 826, if the standard image information includes the standard position information at the measuring time point j, the standard image is displayed through the information transfer section 200 at the measuring time point j, and then the step proceeds to the irradiation step 830 to output to the information transfer section 200 the real- time information on the image of the human body region for the image information inputted by the image input section, positional coordinate of the human body region, and moving range of the human body region.

A step 900 of extracting image information of the human body region includes the irradiation step 830, image input step 840, image preprocessing step 850, human body region recognizing step 860, step 870 of calculating the coordinate of the human body region, and step 880 of measuring the moving range of the human body region. This step. 900 is the same as the step of extracting the image information of the human body region according to an embodiment of the present invention.

At the image information comparing step, the standard image (for example, image as shown in FIG. 9A) is outputted to the person in experiment who is performing the exercise through the information transfer section 200, and simultaneously the step proceeds to the irradiation step 830 to calculate

the real-time information on the image of the human body region for the image information inputted by the image input section, positional coordinate of the human body region, and moving range of the human body region.

FIG. 9C shows the binary image P of the posture for performing the exercise in imitation of the standard image information inputted through the image input process. Using the human body region recognizing step 860, step 870 of calculating the coordinate of the human body region, and the step 880 of measuring the moving range of the human body region, the position information on the measured human body region information PH', PHL', PHR', PFL', and PFR'can be calculated.

FIG. 9E shows an example of the standard image and the input image displayed through the information transfer section 200 at a certain measuring time point j. The information transfer section 200 may comprises one or more display devices.

Now, the comparison of the images using the standard position information (PH, PHL, PHR, PFL, PFR) and human body region information (PH', PHL', PHR', PFL', PFR') measured from the binary image will be explained in detail.

In comparing the images of the two human bodies, a normalization technique is required to uniformly compare the height and body shape of the standard human body and those of the person in experiment. For this, the calculation thereof using the moving range of the human body region is as follows.

FIG. 9B shows the moving range of the human body region using the position information in the standard image. In FIG. 9B, definite straight lines

L1, L2, L3, L4, and L5 indicate the moving ranges of the standard position information PH, PHL, PHR, PFL, and PFR at the measuring time point i and measuring time point j in the standard image, and the moving range from the measuring time point i to the measuring time point j can be calculated using the equation 4.

For example, the moving range LI of the human body region (head portion) from PH (i) to PH (j) can be calculated using the equation 4, and the moving ranges L2, L3, L4, and L5 can be calculated in the same manner.

FIG. 9D shows the moving range of the human body region using the information of the human body region measured from the input binary image.

In FIG. 9D, definite straight lines L'1, L'2, L'3, L'4, and L'5 indicate the moving ranges of the measured human body region position information PH', PHL', PHR', PFL', and PFR'measured at the measuring time point i and measuring time point j from the input binary image, and the moving range from the measuring time point i to the measuring time point j can be calculated using the equation 4.

For example, the moving range L'1 of the human body region (head portion) from PH' (i) to PH' (j) can be calculated using the equation 4, and the moving ranges L'2, L'3, L'4, and L'5 can be calculated in the same manner.

Accordingly, by substituting the moving range for the calculated standard image information for a variable xi, and substituting the moving range of the human body region measured from the input binary image for a variable yi, the comparison of the two images according to the correlation therebetween can be effected using the following equation.

[Equation 5]

Also, FIG. 10B is a comparative table of the image information using the standard position information and the measured position information of the human body region at another measurement time point according to another embodiment of the present invention. This can be presented as a result of whether or not the person in experiment performs the exercise in imitation of the standard image information.

At a step 911 of comparing the completion of the standard image information, the completion of measurement is judged using information selected at the step 811 of selecting the item of the standard image information.

For example, if the measuring time point t is judged to be below the total measuring time TS, the step returns to the measured information transfer step 821 to perform the display of the standard image and the input shaded image S, and to perform the comparison of the image information using the standard human body region information and the measured human body information. If the measuring time point t exceeds the total measuring time TS, the measurement of the human body region is completed, and the step goes to a resultant information output step 921.

At the resultant information output step 921, an analysis result of performing the imitated posture at the measuring time point t during the total measuring time TS using the standard image information selected by the

person in experiment is transferred to the output section 500.

As a result, according to another embodiment of the present invention, using the selection of the standard image information, the measurement of performance for the imitation of the person in experiment with the lapse of time (for example, the measurement of performance of the imitation action caused by the selection of a specified dance) can be effected, and the real-time measurement of the moving range and the posture of the human body region can be effected, thereby enabling the real-time correction of the posture of the human body region for each time point.

Hereinafter, the apparatus and method of measuring a moving range of a human body region according to still another embodiment of the present invention will be explained with reference to F ! Gs. 4C, and 11A to 11F.

In still another embodiment of the present invention, the apparatus and method of measuring a reaction time and a moving path of a human body region at a given time point is provided.

An initialization step 802 is the same as the initialization step 800 of one embodiment of the present invention as described above.

In the auxiliary storage section 420 is stored a program (for example, game program) for the position measurement at a certain time using a timer for producing random time point information as a means for selecting information on the performance of the exercise, and a position generating section for displaying the random position information through the information transfer section 200.

At the exercise information selection and input step 812, if the person in experiment instructs to start the measurement by selecting the item of the

program for the random position measurement using the information selection section 100, a signal produced from the information selection section 100 is inputted to the control section 400.

The exercise start information step 817 uses the information produced at the exercise information selection and input step 812, and is the same as the exercise start information step 815 of one embodiment of the present invention.

A bomb removing game as shown in F) Gs. 11A to 11F will be explained as an example of the above-described step.

For example, in the bomb removing game, the person in experiment can remove the bomb and continue the game by bring the human body region into contact with the bomb B1 region located in a certain position and outputted to the information transfer section 200 within a given time, and otherwise, the game is terminated.

Also, in performing the removal of the bomb, the person in experiment should avoid the contact with the detonator portion when moving to the bomb, and if the human body region becomes in contact with the detonator portion, the game is terminated.

Accordingly, at the initialization step 802, various kinds of games are stored in the auxiliary storage section 420, and at the exercise information selection and input step 812, the person in experiment selects, for example, the bomb removing game among the various kinds of games. At the exercise start information step 817, a signal for informing the bomb removing game and an initial position of the human body region are displayed through the information transfer section 200.

At the position information transfer step 822, a synthesized image (for

example, the image as shown in FIG. 11C) of an overlay image for the selected random position measuring program and the binary image P is displayed through the information transfer section 200, and the step goes to the irradiation step 830.

FIG. 11A shows a binary information P for the human body region M inputted to the image input section 350 at a time point t during the exercise, and FIG. 11B shows an overlay image indicating a random position information B1 at a time point t during the exercise. The random position information B1 indicates the operation of the timer TR1.

FIG. 11C shows the synthesized image of an overlay image at the random measuring time point t during the exercise and a binary image P sequentially inputted is displayed through the information transfer section 200.

The step 900 of extracting the image information of the human body region includes the irradiation step 830, image input step 840, image preprocessing step 850, human body region recognizing step 860, step 870 of extracting the coordinate of the human body region, and step 880 of measuring the moving range of the human body region, and thus is the same as the step 900 of extracting the image information of the human body region of one embodiment of the present invention.

The reaction time and moving path measuring step 891 is for measuring the moving path and the reaction time of the person in experiment who performs the exercise. This step will be explained in detail with reference to FIGs. 11 D and 11 E.

For example, the overlay image (for example, the image as shown in FIG. 11B) and the sequentially-inputted shaded image S received from the

person in experiment who performs the exercise are binarization, the state of the initial value of the timer TR1 is calculated to measure the reaction time using the binary image P, and the value of the timer TR1 is reduced with the lapse of time.

In measuring the moving path, it is measured whether or not the coordinate value of the human body region calculated at the step 900 of extracting the image information of the human body violates the moving path K given from the overlay image.

Also, if the measured human body region is in contact with the moving path K area, it is judged that the posture of the person in experiment violates the moving path K.

Accordingly, in measuring the reaction time and the moving path, the exercise of the person in experiment and the position information required for the exercise are displayed through the information transfer section 200, and then the reaction time and the moving path are calculated using the position information of the human body region with lapse of time.

The step 912 of comparing the completion of the exercise measurement goes to the resultant information output step 922 if the time of the timer TR1 measured at the reaction time and moving path measuring step 891 is terminated or the posture of the person in experiment violates the moving path K, while otherwise, it returns to the position information transfer step 822.

Also, if the human body region of the person in experiment is in contact with the random position information B1 without violating the moving path K as shown in FIG. 10D, an overlay image that indicates a signal BC for the

successful action (for example, successful removal of the bomb) as shown in FIG. 11E is outputted to the information transfer section along with the input binary image P, and then new random position information (for example, B2, B3, and B4) with timers TR2, TR3, and TR4 added thereto are outputted to the information transfer section along with the input binary image P as the overlay image as shown in FIG. 11F. Then, the step returns to the position information transfer step 822, and the person in experiment performs the exercise using the exercise information on the information transfer section 200.

At the resultant information output step 921, the result of analysis of the reaction time of the human body region and the moving range of the human body region is transferred to the output section 500 using the information selected by the person in experiment.

The effect of still another embodiment of the present invention is as follows.

Currently, typically and widely used games are performed by the human eyesight and the measurement of a simple physical exercise (for example, keyboard manipulation only by fingers). However, according to still another embodiment of the present invention, the games can be performed by the measurement of the reaction time and the moving path of the whole body region of the person in experiment.

As a result, the apparatus and method according to the present invention enables the person in experiment to enter into the world of virtual space deeply in comparison to the existing method. The apparatus and method of the present invention can be applied to the fields of measuring the position, moving range, and reaction time of the human body region such as the

exercise, medical science, game, education, simulation, etc.

For reference, the main features of the respective embodiments of the present invention are summarized as follows.

One embodiment of the present invention refers to the calculation of the position and moving range of the human body region using the measuring period, another embodiment refers to the performance of similarity of the imitated posture using the standard image at a specified measuring time point, and still another embodiment refers to the measurement of the reaction time and moving range of the human body region in a random position and at a random time point.

EFFECT OF THE INVENTION As described above, according to the present invention, the position of the human body region can be recognized and coordinates of the human body region can be calculated by binarizing an image of the human body region inputted through an image input means and extracting a human body area using the binary coded image during measurement of the human body region.

Also, the moving range of the human body region can be calculated using the measurement of the human body region, a posture correction method for the exercise of the human body region can be presented, and a real-time measurement of a reaction time of the human body region can be performed according to the lapse of time and moving path of the human body region.

Also, according to the present invention, the measurement of the fatigue feature of the human body region of the person in experiment according

to the lapse of time can be performed, and information on the correction of the human body region during the exercise can be obtained using a simple construction. Also, the measurement of performance for the imitation of the person in experiment with the lapse of time, and the real-time correction of the posture of the human body region for each time point can be effected.

Since the present invention enables the person in experiment to enter into the world of virtual space deeply in comparison to the existing method, it can be applied to the fields of measuring. the position, moving range, and reaction time of the human body region such as the exercise, medical science, game, education, simulation, etc.

Although the preferred embodiments of the present invention has been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.




 
Previous Patent: RATE OF TURN SENSOR

Next Patent: DOSER FOR SOLID MATTER