Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD FOR PROVIDING SORTING INFORMATION FOR POSTAL SORTING ITEMS
Document Type and Number:
WIPO Patent Application WO/2018/015097
Kind Code:
A1
Abstract:
The present invention discloses a method for providing sorting information (6) for postal items (2), such as letters, brochures, parcels and the like, each postal item (2, 2a, 2b, 2c) comprising an address information (4), comprising the steps of: a) providing an overhead positioned camera (8); said camera (8) being capable of taking images of the postal items (2, 2a, 2b); b) providing an image recognition means (14) in order to extract the address information (4) from the postal item (2, 2a, 2b); c) providing a process control (16) being enabled to assign the sorting information (6) to the postal item (2, 2a, 2b) in response to the extracted address information (4); d) forming a stack (20) of postal items (2, 2a, 2b) wherein the postal items (2, 2a, 2b) are oriented to allow reading the respective address information (4) from the overhead positioned camera (8) wherein the stack (20) of postal items (2, 2a, 2b) is positioned in a determined area of view (24) with respect to the camera (8); e) disposing at least one optical mark (28) adjacent to the determined area of view (24); f) removing the postal item (2a) on top of the stack (20) and occlude the at least one optical mark (28) temporarily for the camera (8) during the movement for removing; g) detecting that the at least one optical mark (28) has been occluded temporarily by an evaluation of the images taken by the cam- era (8); and h) in response to the detection deducting that the successive postal item (2b) is now present on the top of the stack (20), taking a newimage of the successive postal item (2b) and extracting the address information (4) from this new image and assigning the respective sorting information (6) to the successive postal item (2b).

Inventors:
GIUGNO LUCIANO (DE)
LI DR ZHE (DE)
RICHARDSON SAMUEL X (US)
RÖHM EBERHARD (DE)
SALEMIZADEH ABDUL HAMID (US)
SCHAD DR JÜRGEN (DE)
SCHULTE-AUSTUM MATTHIAS (DE)
SIPE STANLEY W (US)
Application Number:
PCT/EP2017/065272
Publication Date:
January 25, 2018
Filing Date:
June 21, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
SIEMENS AG (DE)
International Classes:
B07C7/00
Domestic Patent References:
WO2014057185A12014-04-17
Foreign References:
EP2260952A12010-12-15
US6748294B12004-06-08
US5794789A1998-08-18
EP2906367A12015-08-19
Attorney, Agent or Firm:
MAIER, Daniel (DE)
Download PDF:
Claims:
Patent Claims

1. A method for providing sorting information (6) for postal items (2), such as letters, brochures, parcels and the like, each postal item (2, 2a, 2b, 2c) comprising an address information (4), said method comprising the steps of:

a) providing an overhead positioned camera (8); said camera (8) be¬ ing capable of taking images of the postal items (2, 2a, 2b);

b) providing an image recognition means (14) in order to extract the address information (4) from the postal item (2, 2a, 2b);

c) providing a process control (16) being enabled to assign the sorting information (6) to the postal item (2, 2a, 2b) in response to the extracted address information (4);

d) forming a stack (20) of postal items (2, 2a, 2b) wherein the postal items (2, 2a, 2b) are oriented to allow reading the respec¬ tive address information (4) from the overhead positioned camera (8) wherein the stack (20) of postal items (2, 2a, 2b) is posi¬ tioned in a determined area of view (24) with respect to the camera (8) ;

e) disposing at least one optical mark (28) adjacent to the deter¬ mined area of view (24);

f) removing the postal item (2a) on top of the stack (20) and oc¬ clude the at least one optical mark (28) temporarily for the camera (8) during the movement for removing;

g) detecting that the at least one optical mark (28) has been oc¬ cluded temporarily by an evaluation of the images taken by the camera ( 8 ) ; and

h) in response to the detection deducting that the successive post¬ al item (2b) is now present on the top of the stack (20), taking a new image of the successive postal item (2b) and extracting the ad¬ dress information (4) from this new image and assigning the respective sorting information (6) to the successive postal item (2b) .

2. The method according to claim 1, wherein the steps f) to h) are repeated a number of times in order to reduce the number of postal items (2) present in the stack (20) .

3. The method according to claim 1 or 2, wherein the optical mark (28) is provided in form of a symbol, such as a cross, an X or the like, having high contrast as compared to the surrounding area.

4. The method according to any of the preceding claims wherein the address information (4) is provided in form of hand- and/or type¬ writing and/or fluorescent bar code (16) .

Description:
Method for providing sorting information for postal sorting items

The present invention relates to a method for providing sorting information for postal items, such as letters, brochures, parcels and the like, each comprising an address information.

Currently, postal sorting centers around the world use manual labor and highly trained personal to sort mail items which are rejected by automation or not able to be run on automated machines.

Postal processing applications require reading and recognition of the address of the postal items being processed, in order to pre ¬ pare the items for delivery. For example, all of the postal items that will be delivered on the same delivery route would be separat- ed from all of the other postal items, so that they can be loaded into a delivery vehicle in preparation for the delivery route. Manual methods of reading and recognition of postal items during pro ¬ cessing requires a great deal of labor and expertise. Fully auto ¬ matic methods of processing postal items can be large, inflexible, and can require significant volume of postal items to justify their cost. When space and volume of postal items are limited, the ideal system is small, flexible, adds productivity to manual processing steps, and reduces the expertise required to perform the pro ¬ cessing. Automatic scanning and recognition equipment can be ap- plied to postal processing in these situations. The scanning equip ¬ ment captures an image of a postal item, automatic recognition software extracts and derives relevant processing information, and the information is provided in the form of simple instructions to the operator regarding processing of that postal item. An example for this postal processing is given in the European Patent Applica ¬ tion EP 2 906 367 Al . Traditional methods of manually scanning postal items for automatic reading have required complex methods and systems to determine when a new item requires scanning, repre ¬ senting a signal to the automatic recognition software to extract and derive new processing information to be presented as instruc ¬ tions to the operator. The solution disclosed in EP 2 906 367 Al exactly suffers the same problem. The present invention therefore has the objective to provide a method for providing sorting information for postal sorting items allowing postal sorting centers to reduce manual labor and scheme knowledge throughout its networks, including but not limited to last mile delivery optimization. The invention shall further allow sortation of mail items to final destination or next destination via non-schemed trained personnel at very high throughputs from many different physical streams. This will represent a significant decrease in direct labor cost as well as training.

This objective is achieved according to the present invention by a method for providing sorting information for postal items, such as letters, brochures, parcels and the like, each postal item compris ¬ ing an address information, comprising the steps of:

a) providing an overhead positioned camera; said camera being capa ¬ ble of taking images of the postal items;

b) providing an image recognition means in order to extract the address information from the postal item;

c) providing a process control being enabled to assign the sorting information to the postal item in response to the extracted address information;

d) forming a stack of postal items wherein the postal items are oriented to allow reading the respective address information from the overhead positioned camera wherein the stack of postal items is positioned in a determined area of view with respect to the camera; e) disposing at least one optical mark next to the determined area of view;

f) removing the postal item on top of the stack and covering the at least one optical mark temporarily during the movement for remov- ing;

g) detecting that the at least one optical mask has been disap ¬ peared temporarily by an evaluation of the images taken by the camera; and

h) in response to the detection deducting that the successive post- al item is now present on the top of the stack, taking a new image of the successive postal item and extracting the address infor ¬ mation from this new image and assigning the respective sorting information to the successive postal item. This method allow the unanimous recognition of the address infor ¬ mation of the next postal item once the topmost postal item has been removed for being further processed according to the sorting information. The sorting information thereby may comprise an optical and/or acoustical indication where to sort the current postal item. Just by occlusion and the re-appearance of the optical mark the image recognition is triggered to recognize the address infor ¬ mation of the next postal item present on the top of the stack. Therefore, this process is more reliable as compared to prior art processes where low contrasts images of subsequent postal items have to be compared in order identify the presence of the subse ¬ quent postal item on top of the stack. In the present invention, just high contrast images taken from the optical mark have to be compared.

In order to sort more postal items, it is recommended to repeat the steps f) to h) a number of times in order to reduce the number of postal items present in the stack. Usually, one stack is sorted completely prior to loading the next stack into the predetermined area .

A preferred embodiment provides for an optical mark being in form of a symbol, such as a cross, an X or the like, having high con- trast as compared to the surrounding area. Typically, a symbol, such as a letter or a cross, printed in black on a white paper or white underlay are a suitable pair of high contrast for the recog ¬ nition of the occlusion and the re-appearance of the optical mark. Typically, the address information is provided in form of hand- and/or typewriting and/or fluorescent bar code being readable on one surface of the postal item.

Preferred embodiments of the present invention are hereinafter ex- plained more detailed with respect to the attached drawing that de ¬ picts schematically the method for providing sorting information 6 for postal items 2, such as letters, brochures, newspapers, maga ¬ zines and the like, each comprising an address information 4. The drawing shows an overhead positioned camera 8 having a field of view 10 illustrated by dotted lines 12. This camera 8 is used to take images of the postal items 2. The images taken by the camera 8 are processed by an image recognition module 14. The processing of the image recognition module 14 lead to the extraction of the ad ¬ dress information 4 which is part of the video image taken by the camera 8. The address information 4 can be handwritten or machine- written but may also comprise a bar code 16 printed onto the postal item 2a in a preceding sorting process.

The image recognition module 14 forms logically a part of a process control module 16 which is enabled to assign the sorting infor ¬ mation 6 to the postal item 2 in response to the extracted address information 4. In the present example, the sorting information 6 is contained in a database 18. The sorting process now works as fol ¬ lows :

Firstly, a stack 20 of postal items 2a, 2b, etc. is formed wherein the postal items 2a, 2b, etc. are oriented to allow reading the re- spective address information 4 from the overhead positioned camera 8 wherein the stack 20 of postal items 2a, 2b, etc. is positioned on a board 22 within the determined area 24 which corresponds to the area of view 10 with respect to the camera 8. The determined area 24 is defined by marks 26 which help an operator (here not shown) to position the stack 20 accordingly. Further, three optical marks 28, here three crossed circular boxes, are disposed adjacent to the determined area 24 on the board 22. These optical marks have (28) a high contrast as compared to the board 22. During the sort ¬ ing process, the camera 8 take continuously images form these opti- cal marks 28 and the image recognition module 14 determines for every image whether the optical marks 28 are present.

Once the address information 4 is extracted from the image taken from the postal item 2a on the top of the stack 20, the sorting in- formation 6 is assigned to the postal item 2a. The sorting infor ¬ mation 6 in this example is materialized in terms of a lamp 30 be ¬ ing illuminated in order to indicate to the operator the exact po ¬ sition for the postal item 2a in a sorting register 32. While now removing the postal item 2a on top of the stack 20 for sorting the postal item 2a into the indicated position in the sorting register 32, the optical marks 28 are temporarily occluded during the move ¬ ment for removing the postal item 2a which shall be indicated by arrow 34. The image recognition module 14 detects that the optical marks 28 have been disappeared temporarily during the removal move ¬ ment of the postal item 2a by an evaluation of the images taken by the camera 8. In response to the detection, the re-appearance of the optical marks 28 in the images taken by the camera 8 for the specific area which domiciles the optical marks 28 leads to the de ¬ duction that the successive postal item 2b is now present on the top of the stack 20. Now, the camera 8 takes a new image (or a num ¬ ber of images) of the stack 20 and in particular of the postal item 2b now present on the top of the stack 20. The address information 4 for this postal item 2b is then extracted and the respective sorting information 6 is assigned to the successive postal item 2b. Consequently, a lamp 30 is illuminated thereby indicating the cor ¬ rect sorting position for the postal item 2b when being removed from the stack 20 and sorted into the sorting register 32.

This removal movement triggers then again a capture of a new image taken from the postal item 2c now on top of the stack 20. This pro ¬ cess can repeated until all postal items 2 contained in the stack 20 are sorted into the sorting register 32.

It has to be mentioned that the sorting register 32 is only one possible recipient for the postal items 2. Alternatively, the post ¬ al items 2 can be sorted into all kind of suitable containers and the like according to the sorting logic applied by the process con- trol module 16.

The present invention therefore utilizes a novel approach to de ¬ tecting that the postal item being scanned has been changed. The components involved in this method are mobile allowing it to be used in more than one location and operation. Flexible destination sortation to cases, bins, trays or tubs based upon the postal oper ¬ ation requirements and the respective sorting logic is easily achievable. The method can easily be integrated into postal opera- tions both physically and through IT networks. The destination sortation is programmable or can be supplied by the customer (visu ¬ al point to light, graphic screens, Heads Up Displays and overlays, voice, etc) based upon customer specific requirements. This can be in the form of carrier designation, physical address location, geo- coordinates and a variety of other schemes such as What3Words.

The present invention therefore provides a self-contained scanning system with camera and lighting. It further provides for adjustable lighting for different environments (natural light, florescent, etc) . It also provides height adjustment of the board 22 to accom ¬ modate the operator stature. The system and the method are adjusta ¬ ble with respect to the field of view 10 and the image resolution. One can provide a designed background pattern for the scanning cam- era 8. It allows the camera 8 to continuously scanning the surface of the board 22 with a certain frame rate and provides a mechanism for automatic brightness regulation of the camera. The image recog ¬ nition module 14 can provide a method of automatically selecting the best image of each postal item 2 which is visible in the field of view 10 for further processing. The sorting items 2 can be fed individually or - as shown - can be fed as a stack 20.