Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
CONNECTION OF POINT CLOUDS MEASURED BY A COMPUTER VISION SYSTEM
Document Type and Number:
WIPO Patent Application WO/2003/042924
Kind Code:
A1
Abstract:
The invention relates to the connection of point clouds measured by a compurter vision system. The object to be measured is placed on a rotating table (20), which has reference points (22) previously placed on it. First, the reference points (22) are measured, whereupon the object is illuminated by a laser (LASER) and the points thus produced are measured by means of a camera system (CAM1, CAM2). To cover any blind areas, the table is turned, whereupon the reference points (22) are measured again and the magnitudes of the rotation and movement are calculated. By utilizing this information, the points measured from the new position are transformed into the original coordinate system.

Inventors:
LEIKAS ESA (FI)
Application Number:
PCT/FI2002/000888
Publication Date:
May 22, 2003
Filing Date:
November 13, 2002
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
MAPVISION OY LTD (FI)
LEIKAS ESA (FI)
International Classes:
G01B11/00; (IPC1-7): G06T17/00; G01B11/00
Domestic Patent References:
WO1999015945A21999-04-01
Foreign References:
US5396331A1995-03-07
US5978521A1999-11-02
US4590578A1986-05-20
US4993836A1991-02-19
US5285397A1994-02-08
Attorney, Agent or Firm:
PAPULA OY (P.O. Box 981 Helsinki, FI)
Download PDF:
Claims:
CLAIMS
1. Method for connecting point clouds meas ured by computer vision system, in which method an ob ject is placed on a movable support and which method comprises the steps of: producing on the surface of the object to be meas ured a number of points by an illuminating technique; measuring the illuminated points to form a point cloud; changing the position of the object; repeating the steps of illumination and measure ment of points until a desired set of point clouds has been obtained; and the measurement results are combined c h a r a c t e r i z e d in that the method further comprises the steps of: mounting reference points on the movable support or on the object itself; measuring the reference points; calculating the change in the coordinates of the movable support on the basis of the change in the ref erence points; and transforming the measurement results for each point cloud into the original coordinate system.
2. Method according to claim 1, c h a r a c t e r i z e d in that reference points are attached to the movable support or to the object so that they can be seen by a camera from several different directions.
3. Method according to claim 1, c h a r a c t e r i z e d in that an original reference coordinate system is formed in connection with the first measure ment by measuring the reference points.
4. Method according to claims 1 and 3, c h a r a c t e r i z e d in that, after the object has been moved, the positions of the reference points are measured and a coordinate transformation is calculated by comparing the measured coordinates to the reference points in the reference coordinate system.
5. Method according to claim 1 and 4, c h a r a c t e r i z e d in that the points produced on the surface of the object are measured by a camera system.
6. Method according to claims 1,3 and 4, c h a r a c t e r i z e d in that the measured points are transformed into the reference coordinate system by utilizing the detected change in the coordinates.
7. System for connecting point clouds, said system comprising: a movable support (20) ; a camera system (CAM1, CAM2); a laser illuminator (LASER); and a data system (DTE) c h a r a c t e r i z e d in that the system further comprises : reference points (22) arranged on the movable sup port or on the object (20) itself.
8. System according to claim 7, c h a r a c t e r i z e d in that the reference points (22) are fi xedly arranged on the movable support (20).
9. System according to claim 7 or 8, c h a r a c t e r i z e d in that the camera system (CAM 1, CAM2) has been fitted to measure a change in coor dinates by utilizing the reference points.
10. System according to claims 79, c h a r a c t e r i z e d in that the data system (DTE) has been fitted to transform the measured point cloud into the oa coordinate system by utilizing the change in the coordinates.
Description:
CONNECTION OF POINT CLOUDS MEASURED BY A COMPUTER VISION SYSTEM FIELD OF THE INVENTION The present invention relates to three- dimensional camera measurement. The present invention concerns a method and a system for connecting point clouds measured by a computer vision system.

BACKGROUND OF THE INVENTION Computer vision systems are based on informa- tion obtained from various measuring devices. Informa- tion can be measured using e. g. a laser device, a measuring head or via recognition from an image. The information obtained can be utilized e. g. in quality control systems, where, on the basis of this informa- tion, it is possible to determine e. g. the correctness of shape of an object, coloring errors or the number of knots in sawn timber.

A computer vision system is generally com- posed of cameras. Traditional computer vision systems comprised only one camera, which took a picture of the object. By processing the picture, various conclusions could be drawn from it. By using different algorithms, it is possible to distinguish different levels in im- ages on the basis of their borderlines. The border- lines are identified on the basis of intensity changes. Another method of recognizing shapes in an image is to connect it to masks and filters so that only certain types of points will be distinguished from the image. The patterns formed by the points in the image can be compared to models in a database and thus recognized.

In a three-dimensional computer vision sys- tem, several cameras are needed. To determine a three- dimensional coordinate, an image of the same point is needed from at least two cameras. Most three- dimensional computer vision systems therefore comprise several cameras to allow an object to be imaged from different directions without having to move the ob- ject. The points are formed on the surface of the ob- ject via illumination. The illumination is typically implemented using a laser. The point is imaged by cam- eras calibrated in the same coordinate system. When an image of the point can be produced by at least two cameras, it is possible to determine three-dimensional coordinates for the point. For the same position, a number of points are measured. The set of points thus formed is called a point cloud.

The object to be measured can be placed on a movable support, e. g. a rotating table. Rotating ta- ble'means a support that rotates about its axis. If the object can be rotated, then the camera system need not be able to measure the entire object from one po- sition and normally fewer cameras are needed than when measurements are carried out with the object on a fixed support. The movable support may also be a car- rier moving on rails.

With a computer vision system, it is also possible scan the object and produce from it a model that can be processed. The methods of three- dimensional scanning and discrimination are considera- bly more complicated than corresponding two- dimensional methods.

To measure the overall shape of an object, the point clouds scanned in different positions have to be connected to the same coordinate system. In prior art, point clouds scanned in different positions were combined using various mathematical methods in which different overlapping areas are measured. The overlapping areas must represent the same surface and they must therefore be congruent. The method works poorly if the object has relatively flat shapes.

In an embodiment, known shapes are disposed near the object, e. g. balls, which are repeatedly measured from every position. The overlapping measure- ments and the repeated measurements of the balls in each position take measuring time. Measuring time is also spent on matching the mathematical models meas- ured from different positions. One solution to this problem is to place the object to be measured onto a support and measure the movements of the support by means of various angle or motion detectors. However, the accuracy of these wear-prone components limits the overall measuring accuracy.

OBJECT OF THE INVENTION The object of the invention is to eliminate the above-mentioned drawbacks or at least to signifi- cantly alleviate them. A specific object of the inven- tion is to disclose a new type of method for connect- ing point clouds measured by a computer vision system.

A further object of the invention is to simplify and accelerate the process of measuring the three- dimensional shape of an object.

BRIEF DESCRIPTION OF THE INVENTION The invention describes a method for connect- ing point clouds measured from an object in its dif- ferent positions to the same coordinate system. The system of the invention comprises a movable support, an illuminating device and a sufficient number of cam- eras. In addition, the system comprises means for storing the measured information and calculating coor- dinate transformations.

The object to be measured is fastened to a movable support. The support is provided with a mecha- nism which is used to move it so that the cameras could see it from different directions. The support plate typically has a circular shape and it is rotated about a central shaft, but the support plate may also have some other shape in it may be moved in several directions. The circular support plate movable about a shaft is called a rotating table. Several reference marks are fastened onto the rotating table. The marks may be individually designed to allow them to be iden- tified by the cameras, but they may also be of identi- cal design. The reference marks need not be three- dimensional bodies; instead, two-dimensional marking is sufficient. At the start of a measurement, the cam- eras measure the reference marks on the support plate.

Reference marks may also be attached to the object it- self e. g. by means of a magnet, and it is even possi- ble to place all the reference marks on the object. In this case the procedure involves the drawback that the reference marks may happen to be placed on the area to be measured, thus changing the object shape perceived by the measuring device.

The measurement is carried out by illuminat- ing points on the surface the object to be measured.

The illumination is typically carried out by producing luminous points. Normally, a number of luminous points forming e. g. a matrix are created, thus illuminating a plurality of points simultaneously. The points are im- aged by cameras, and the system can be provided with as many cameras as required. The position of each in- dividual point can be measured accurately when at least two cameras can see it. The point matrix can be moved over the object by deflecting the beams produc- ing the luminous points using e. g. two mirrors. The set of points measured from the same position is called a point cloud. After the object has been meas- ured completely in one position, its orientational po- sition must be changed to allow any blind areas to be scanned.

When the object is turned, the coordinate system comprising it will also have to be turned to allow the new measured points to be placed in the original coordinate system to fill the blind areas.

After the turning, measurement is started by measuring the reference marks. The positions of the reference marks are compared to the positions measured at the beginning of the measurement. The marks are of indi- vidual shape, they can be identified by a camera, but the marks may also be mutually identical. In this case, each mark is identified on the basis of its po- sition in relation to the others, for it does not change although the set of points is moved as an array from one place to another. From the change in the po- sitions of the reference marks, it is possible to cal- culate a transformation of the coordinates of the mov- able support, and the point cloud measured from the new position can be placed mathematically in the original coordinate system on the basis of the coordi- nate transformation.

By utilizing the system and method of the in- vention, the requirements regarding accuracy of motion of the movable support are eliminated, because the change in the coordinates is verified subsequently by measuring the reference points. The elimination of the accuracy requirement makes it possible to move the support plate with a simpler and more advantageous mechanism, by means of which a sufficient number of points can be measured quickly and advantageously. In addition, the elimination of mechanical sensors also improves the measuring accuracy. In the methods used, the required calculation power is low, so the connec- tion of large numbers of points is a fast operation and requires no more than normal calculation capacity.

LIST OF ILLUSTRATIONS In the following, the invention will be de- scribed in detail with reference to drawings, wherein Fig. 1 presents a function diagram represent- ing the method of the invention, Fig. 2 presents an embodiment of the system of the invention.

DETAILED DESCRIPTION OF THE INVENTION In the method represented by Fig. 1, measure- ment is started by placing the measuring object and the reference points onto the movable support 10. The reference points can also be fixedly mounted on the support, in which case they need not be placed again for each measurement but are only moved when neces- sary. If a sufficiently large number of reference points are mounted on the support, they will not nec- essarily have to be moved at all, because even if some of the points should be hidden behind the object, there will still be a sufficient number of them avail- able.

After the placement, the positions of the reference points and object points are measured 11.

The reference points are measured by cameras and their positions are stored in memory. Next, the object is illuminated by means of a laser or other radiation source to produce points on the surface of the measur- ing object that are visible to the cameras. The points are measured by the cameras and stored in memory. Af- ter the object has been measured completely from one position, the support is moved 12 to a new position.

After the support has been moved, measurement is started by measuring the reference points and per- forming a coordinate transformation 13. Based on the measured and the original reference point positions, a transformation of the coordinates of the movable sup- port can be calculated. Next, the object is illumi- nated again and new coordinates are calculated for the points produced. These new coordinates are connected to the earlier ones, transforming them into the origi- nal coordinate system 14.

If any blind areas still exist, the rotating table can be turned again 15. The extent of blind ar- eas can be estimated by qualitative criteria or e. g. by using a predetermined number of movements and an approximate change. If the object is moved again, then the procedure is resumed at step 13, otherwise the measurement is ended 16.

Fig. 2 represents a system according to the invention. The system comprises a movable support, which in the example embodiment is a rotating table 20, cameras CAM1 and CAM2, a laser pointer LASER, ref- erence points 22 and a data system DTE for the storage and transformation of results. The rotating table 20 is provided with a mechanism that allows it to be turned and locked in place. The magnitude of the turn- ing angle need not be accurately predetermined, so it is not necessary to provide the rotating mechanism with any special measuring devices or mechanical pre- cision components. Reference points 22 are mounted on the rotating table. The reference points, or some of them, may also be fixedly placed on the table.

The object 21 attached to the rotating table is illuminated with laser beams. The illuminating de- vice LASER may consist of several lasers, which are typically mounted in the form of a matrix. The laser beams illuminate points on the surface of the measur- ing object mounted on the rotating table and these are measured by a camera system, which in the example em- bodiment comprises cameras CAM1 and CAM2. The system is provided with as many cameras as needed, usually four to eight cameras being used. The measured points are stored into the data system DTE. After the object 21 has been measured completely, it can be rotated to measure blind areas. After the rotation, the change in its position is measured on the basis of the reference points. The object is rotated again until all blind areas have been measured.

The invention is not limited to the embodi- ment examples described above; instead, many varia- tions are possible within the scope of the inventive concept defined in the claims.