Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD FOR CREATING A 3D-MODEL AND 3D-BODY-SCANNER
Document Type and Number:
WIPO Patent Application WO/2018/011332
Kind Code:
A1
Abstract:
The invention relates to a method for creating a 3D-Model of an object, which is turning around during a scanning process in front of one or a number of, in particular stationary, depth sensors (2) mounted on a mast or carrier (1), wherein the scanning process includes the following steps: scanning the object which moves around itself by motion of its leg,segmenting of a body (3),fitting a virtual skeleton in the segmented body with anatomic correct degrees of freedom, which follows the required motions of the bodies turnaround,non-rigid modelling the body shape for one or more defined or normalized poses around the virtual skeleton. Furthermore, the invention relates to a 3D-Body-Scanner.

Inventors:
FARAHBAKHSHIAN FARHAD (US)
SCHULTES GERHARD (AT)
NGUYEN WILLIAM (AT)
Application Number:
PCT/EP2017/067667
Publication Date:
January 18, 2018
Filing Date:
July 13, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
NAKED LABS AUSTRIA GMBH (AT)
International Classes:
G01S7/48; G01S13/89; G01S15/89; G01S17/894; G06T7/00
Domestic Patent References:
WO2014037939A12014-03-13
Foreign References:
US20130286012A12013-10-31
US20130230211A12013-09-05
Attorney, Agent or Firm:
BERGMEIER, Werner (DE)
Download PDF:
Claims:
P a t e n t C l a i m s

1 . Method for creating a 3D-Model of an object,

which is turning around during a scanning process in front of one or a number of, in particular stationary, depth sensors (2) mounted on a mast or carrier (1 ),

wherein the scanning process includes the following steps:

scanning the object which moves around itself by motion of its legs, segmenting of a body (3),

fitting a virtual skeleton in the segmented body with anatomic correct degrees of freedom, which follows the required motions of the bodies turnaround,

non rigid modelling the body shape for one or more defined or normalized poses around the virtual skeleton.

2. Method according to the previous claim, wherein the body (3) is

mathematical separated in body parts, in particular at least head, chest and limbs.

3. Method according to one or several of the previous claims, wherein the virtual skeleton is composed by bones (4) and joints (5).

4. Method according to one or several of the previous claims, wherein some pose normalization is made by using a-priory information about individual parameters, in particular the length of the limbs, of the body to be scanned.

5. Method according to one or several of the previous claims, wherein body shapes recorded at different times, in particular within one day, whereby the poses of the body are significant different, in particular from different directions, are compared.

6. 3D-Body-Scanner for creating a 3D-Model of an object comprising: a mast or a carrier (1 ) and

one or a number of, in particular stationary, depth sensors (2) mounted on the mast or the carrier (1 ) for recording an object which is itself turning around,

wherein the 3D-Body-Scanner is designed to operate with a method for creating a 3D-Model of an object in one or several of the previous claims.

Description:
METHOD FOR CREATING A 3D-MODEL AND 3D-BODY-SCANNER

The invention relates to a method for creating a 3D-Model of an object, which is turning around during a scanning process in front of one or a number of, in particular stationary, depth sensors mounted on a mast or carrier. Furthermore, the invention relates to a 3D-Body-Scanner.

Today accurate 3D human body models are demanded by various fields of applications as are:

• Fitness and body styling applications,

• Medical applications,

• Cloth manufacturing industry,

• Cloth internet and retail shops,

• Automotive industry.

To generate 3D human body models 3D body scanners are used. The field of the disclosed invention deals with reducing the required mechanics and electronics of 3D body scanners but keeping the performance of 3D body model as recorded with conventional approaches.

To generate a 3D model of human body a 3D scanner is used. Such 3D body scanner uses whatever type of Depth Sensors (DS's) to determine the three dimensions of the body (object) to obtain a full set of information to generate the 3D body model. The body has to be seen by the DS's from multiple positions. In market leading 3D body scanners a motor driven relative motion of the body against one or more depth sensors is used to give the depth sensors a view of the body from all sides.

Today's 3D scanner works basically with four principles:

1 . Moving depth sensors by hand freely around the body (object) 2. Rotating the body (object) in front of one or more depth sensors

3. Rotating or shifting the depth sensors in the surrounding of the body (object)

4. Multiple steady-state depth sensors around the body (object)

5. Combination of concepts above

If the body is in an as far as possible steady state pose and rotated by a turntable powered by a motor to give the DS's visibility to all sides of the body, there are the disadvantages of consuming to much space and the increasing costs caused by the turntable to rotate the body (object).

If the body is in an as far as possible steady state pose and DS's are rotated by a mechanics powered by a motor around the body to give them visibility to all sides of the body, this structure is very sensitive against damage and the rotation mechanism is very expensive.

If the DS's are placed fix in two or more positions around the body to give the 3D scanner visibility to all sides of the body, this is very space consuming, the high number of depth sensors is expensive and it is complicated and time consuming in preparing and setting up.

Combined concepts typically turn around the body (object) by a motor powered turntable and move one depth sensor motor powered linearly in height instead of using multiple depth sensors at different constant heights. Using only a single depth sensor causes increasing costs by a very complicated mechanic construction and long scanning times, consequently this reduces accuracy in conjunction with natural body motion.

To create a 3D model of a body (object) with the concepts described in the state of the art, there is a relative motion between the body and one or more depth sensors needed to give the depth sensors view from all sides of the body. This is typically realized (i) that the body is moved in front of stationary depth sensors or (ii) the depth sensors have to be moved around the body (object) in order to give the DS's full visibility of the body (object). This motion is done by one or more motors in circular or linear way. The body is assumed to be steady state, stiff or rigid and making no motions during the scanning process. However when scanning an alive human body this assumption is not true. The body moves slowly forward and backward to stay in balance at standing. Furthermore, breathing shifts slightly the center of gravity and the heart beat modulates the surface of the chest.

Consequently to obtain a comparable scan such natural body motions have to be corrected for such motions.

From scan precision, cost and space consumption, the concepts are most competitive and future oriented.

From the WO 2014/037939 A a method for deriving accurate body size measures of a user from a sequence of 3D images is known.

The object of the present invention is to provide a method for generating an improved 3D-Model.

The aforementioned object is achieved by means apparatus exhibiting the features disclosed in the independent patent claims.

Proposed is a method for creating a 3D-Model of an object, which is turning around during a scanning process in front of one or a number of, in particular stationary, depth sensors mounted on a mast or carrier. The scanning process includes steps of scanning, segmenting, fitting and modelling the 3D- Model. The person is scanned while moving around itself by motion of its leg. Meanwhile the body is segmented into parts. Afterwards a virtual skeleton is fitted into the segmented body with anatomic correct degrees of freedom, which follows the required motions of the body's turnaround. Subsequent the body shape for one or more defined or normalized poses around the virtual skeleton is non rigid modelled.

If 3D models, recorded at different times, shall be compared, it is normal that the pose at different events is not exactly the same. Therefore, some pose normalization has to be done by post processing by using some a-priory information about the body mechanics (degree of freedom of the joints) and individual parameters (length of the limbs) of the body to be scanned.

The invented method extends the concept of dealing with a slightly moving, non-rigid alive body to avoid the mechanics to turn around the body with e.g. a turntable or to move around the depth sensors with circular and/or linear or spiral like motion.

It is an advantage to separate the body mathematical in in body parts, in particular at least head, chest and limbs.

For simplifying the non-rigid modelling it is an advantage to make some pose normalization by using a-priory information about individual parameters, in particular the length of the limbs, of the body to be scanned.

It is an advantage to compare body shapes which are recorded at different times, whereby the poses of the body are significant different. It might be useful to compare the body shapes which are recorded within one day. The poses might be recorded from different directions.

A further advantage is composing the virtual skeleton by bones and joints. Proposed is a 3D-Body-Scanner for creating a 3D-Model of an object. The 3D-Body-Scanner comprises a mast or a carrier and one or a number of, in particular stationary, depth sensors mounted on the mast or the carrier for recording an object which is turning around. The 3D-Body-Scanner is designed to operate with a method for creating a 3D-Model according to one or more of the following or preceding characteristics of the description.

The invented method avoids the motorized driven relative motion between the body to be scanned moving the depth sensors and therewith saves a major part of hardware of such 3D body scanners.

Therefore, the person to be scanned slowly moves around itself by motion of its legs. An advanced 3D fusion process is creating the 3D model of the body using skeletonization and a non-rigid modeling technique to calculate the dimensions of the slowly moving body parts.

The resulting 3D body model is then presented in a pre-defined normalized body pose and can be used for accurate tracking of body development over time.

Additional advantages of the invention are described in the following exemplary embodiments. The drawings show in:

Figure 1 a self-moving person and segmentation and skeletonization for creating the 3D body model.

Therefore the person 3 to be scanned slowly moves around itself by motion of its legs. The 3D fusion process itself creating the 3D model uses segmentation, skeletonization a non-rigid modeling technique to calculate the dimensions of the moving body parts.

The resulting 3D body model is then presented in a pre-defined normalized body pose. Segmentation means the mathematical separation of the body 3 in head, chest and limbs. Skeletonization means that a virtual skeleton of stiff, bone 4 like elements and joints 5 of assumed freedom is fitted into the segmented body. Non rigid body modeling means that a 3D body model in a normalized position is created using the segmentation and the

skeletonization.

It should be clear that the resulting 3D body model is not exactly in the pose the person has at starting or finishing of the scan.

The advantages of the described method are that heavy motorized

mechanics for body or depth sensor motion can be omitted. Furthermore, one part of a conventional 3D body scanner, including its energy supply and communication link is removed. The space consumption of the scanner is strongly reduced. The production costs are strongly reduced.

A 3D body scanner is consisting only of a mast or carrier 1 where one or a number of depth sensors 2 are mounted on fully omitting another part usually bringing the body 3 in motion.

The relative motion between the body 3 and the depth sensors 2 on a mast or on a carrier 1 is provided in an advantageous way by the body 3 to be scanned itself whereas the deformation of the body 3 to perform this relative motion is accepted.

The calculation (3D fusion) of the body model is performed in an

advantageous way at turning around of the body 3 during the scanning process by at first segmentation of the body 3 in main body, limbs and head followed by fitting in a virtual skeleton composed by stiff bones 4 and joints 5 with anatomic correct degrees of freedom, which follows the required motions of the bodies turnaround and finally the body 3 shape is modeled for one or more defined or normalized poses by non-rigid modeling of the body shape around the virtual skeleton 4, 5. The calculation (3D fusion) of the 3D body model for one or more defined or normalized poses enables a precise comparison of body shapes recorded at different times where the pose of the body accept of the turn-around motions may be significant different.

In market leading 3D body scanner concepts, a motor driven relative motion of the body 3 against one or more depth sensors 2 is used to give the depth sensors 2 a view of the body from all sides.

The invented device and method avoids the motorized driven relative motion between the body 3 and the depth sensors 2 and therewith saves a major part of hardware of such 3D body scanners.

As invented the person 3 to be scanned itself slowly moves around by motion of its legs.

An advanced 3D fusion process is creating the 3D model of the body 3 for one or more normalized poses using body segmentation, skeletonization and a non-rigid modeling technique to calculate the dimensions of the slowly moving body parts.

The 3D scan result may be presented in normalized poses and allows also accurate comparisons of body scans recorded at different times.

The invention is not limited to the embodiments shown or described. Rather, any and all combinations of the individual features described, as shown in the figures or described in the description, and to the extent that a corresponding combination appears possible and sensible, are subject matters of the invention. LIST OF REFERENCE CHARACTERS

carrier or mast

depth sensor

person turning around

bones

joints