Field of technology

The embodiments in this disclosure relate to processing drugs pouches, and, in particular, though not exclusively, a pouch detection module and systems and methods for processing drugs pouches using such pouch detection module.

Background

To facilitate and automate drugs administration, drugs (e.g. in the form of pills, capsules and/or tables) may be packed into pouches (e.g. packages, pouches, blisters or bags of a foil) using automated pouch processing systems. These drugs may both include medicaments based on a doctor’s prescription or over the counter drugs, including food supplements and/or vitamins. Such system may include a pouch packaging system configured to selected drug and package the selected drugs in a pouch structure, typically a string of sealed pouches, based on a packaging foil. Each pouch may contain drugs for a customer according to an order. Each of the pouches may be provided with information, e.g. a passive information carriers, e.g. printed text and/or a bar or QR code or an active information carriers such as an RFID tag, for identifying the pouch and possibly its contents. Such identification information may be linked to information stored in a database associated with the pouch processing system. Typically, the packaging system is configured to produce a pouch structure, e.g. a long string of pouches comprising different sections, wherein each section may define a string of pouches for a customer and for a particular time period.

Incorrect packaging of a prescription may result in a wrong (combination of) drugs or an incorrect dosage of drugs, which may cause health risks for the patient. Therefore, a pouch processing system may further include a pouch inspection system configured to inspect the content of a pouch structure before different parts of the pouch structure belonging to different patients are separated. EP2951563 and W02005/017814 describe examples of inspection systems comprising an infeed structure configured to unwind a roll of pouches wrapped around a reel and to feed the string of pouches onto a transporting system for guiding the string through an inspection chamber. Images of the content of the pouches are analysed based on shape, dimensions, marks and/or colours. Based on this information the system may decide whether the content of a pouch is correct or not. An outfeed system comprising a reel at the output of the inspection system may be used to wind approved pouches into a roll.

The increasing demand for drugs stimulates development of inspection systems having increased throughput and processing capacity without compromising the accuracy of the system. To that end, systems are developed that are capable of handling large reels at high transport speed. Additionally, for certain use cases, it may be desired to increase the accuracy of the inspection system and/or to expand the functionality of the inspection system. For example, after inspection a cutter may be used to cut the string at a certain positions, e.g. at one of the cross-seals which typically have a width of approx. 5 mm. The cutting process needs to be performed accurately to avoid cutting pouches open during processing. The size of pouches in a string of pouches however is not standardized. Further, the size of a pouch may fluctuate due to imperfections in the packaging process. Additionally, in some situations it may be desired that a pouch processing system is capable of processing a string of pouches that have different sizes. Further inspection tools, such a hyperspectral imaging may be added to the inspection process to check the quality of the medicine. Increasing the accuracy and/or expanding the functionality may require additional pouch processing units along the transport line.

Known pouch processing systems typically only include one pouch processing unit, wherein a pouch of a string of pouches that enters the pouch processing system is identified by scanning a code, e.g. a bar code or the like, that is printed on the pouches. For example, US2013/0282159 describes a pouch inspection system, which includes a transport system that is controlled based on a pouch detection unit which is configured to detect printed text and/or symbols that is printed on the translucent pouches. The identification of the text and/or symbols triggers inspection of a pouch by imaging the pouch and using the image to examine the contents of pouch. However, the quality of the printed text and the position of the printed text on pouches is not standardized and may vary, so that the reliability and accuracy of the pouch processing will decrease. This problem may become more problematic, if the pouch sizes vary, the pouch processing speed increases and/or further pouch processing functionality is added to the pouch processing scheme. In that case, pouches entering the system can no longer be reliably detected which may cause problems in the subsequent processing of the pouches. This problem may further increase because the accuracy of the print position will decrease as the speed of the pouch packaging systems increases.

Hence, from the above, it follows that there is a need in the art for improved methods and systems that accurately detects pouches that are transported through the pouch processing system. Additionally, there is a need for improved methods and systems for processing pouches based on an accurate pouch detection system.

Summary

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module" or "system." Functions described in this disclosure may be implemented as an algorithm executed by a microprocessor of a computer. Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied, e.g., stored, thereon.

The methods, systems, modules, functions and/or algorithms described with reference to the embodiments in this application may be realized in hardware, software, or a combination of hardware and software. The methods, systems, modules, functions and/or algorithms may be realized in a centralized fashion in at least one computing system, or in a distributed fashion where different elements are spread across several interconnected computing systems. Any kind of computing system or other apparatus adapted for carrying out the embodiments (or parts thereof) described in this application is suited. A typical implementation may comprise one or more digital circuits such as application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), and/or one or more processors (e.g., x86, x64, ARM, PIC, and/or any other suitable processor architecture) and associated supporting circuitry (e.g., storage, DRAM, FLASH, bus interface circuits, etc.). Each discrete ASIC, FPGA, processor, or other circuit may be referred to as “chip,” and multiple such circuits may be referred to as a “chipset.” In an implementation, the programmable logic devices may be provided with fast RAM, in particular block RAM (BRAM). Another implementation may comprise a non-transitory machine-readable (e.g., computer readable) medium (e.g., FLASH drive, optical disk, magnetic storage disk, or the like) having stored thereon one or more lines of code that, when executed by a machine, cause the machine to perform processes as described in this disclosure.

The flowcharts and block diagrams in the figures may represent architecture, functionality, and operation of possible implementations of the methods, systems and/or modules to various embodiments of the present invention. In this regard, each block in a flowchart or a block diagrams may represent a module, segment, or portion of code, which may be implemented as software, hardware or a combination of software and hardware.

It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that performs the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is an aim of the embodiments in this application to provide fast and accurate processing of pouches by a pouch processing system, e.g. a pouch inspection system.

In particular, it is an aim of the embodiments in this application to use one or more pouch localisation sensors configured to detect one or more physical features that are present in the foil of a pouch structure, e.g. a string of pouches, that enters the input of the pouch inspection system. In particular, a pouch location sensor may be used that is configured to detect cross-seal regions in the string of pouch, wherein each cross-seal region separates neighbouring pouches. In an embodiment, a pouch detection system may include an ultrasonic sensor positioned at the input of the pouch inspection system. The ultrasonic sensor may include an ultrasonic transmitter configured to emit ultrasonic waves in the direction towards a moving string of pouches and an ultrasonic detector configured to detect an amount of the transmitted ultrasonic waves that passes through the moving string of pouches. In another embodiment, a pouch location sensor may include an optoelectronic sensor positioned at the input of the pouch detection system. The opto-electric sensor may include an optical transmitter, e.g. a laser, configured to emit light towards a moving string of pouches and an optical detector may be configured to detect an amount of light that passes through the moving string of pouches.

When a structural (physical) feature in the foil of a pouch structure passes the detection area of the sensor, the sensor may detect this physical feature. For example, when the pouch structure passes through the ultrasonic detection area between the ultrasonic transmitter and receiver, a detection signal will be generated each time a physical feature passes through the detection area. This way, the detection signal may include pulses indicating the passage of a structural feature in the foil of a pouch structure. This way, the detection signal indicates that a pouch has entered the system. This pouch detection method provides a very accurate and reliable method for detecting pouches entering the input of the pouch processing system at high speed.

In an aspect, the invention may relate to a pouch processing apparatus comprising: a transport system configured to receive the string of pouches and to transport the string of pouches to one or more pouch processing units arranged at one or more positions respectively along the transport system; a pouch detection system configured to detect a structural feature in a foil structure of the string of pouches, the structural feature being associated with one or more pouches in the string of pouches that passes the input of the pouch detection system; a position determination unit configured to determine position information of the one or more detected pouches in the transport system; and, a controller configured to control the one or more pouch processing units based on the position information and the one or more positions of the one or more pouch processing units along the transport system. In another aspect, the invention may relate to a pouch processing apparatus comprising: a transport system configured to transport a string of pouches to one or more pouch processing units arranged at one or more positions respectively along the transport system, a pouch detection system comprising a sensor configured to produce a detector signal if a predetermined structural feature in a foil structure of the string of pouches passes the input of the pouch detection system; a position determination unit associated with the transport system, the position determination being configured to determine position information for the transport system as a function of time; and, a scheduler configured to assign initial position to a detected pouch based on position information at the time the pouch was detected, to monitor positions of detected pouches as a function of time based on their initial positions and the position information and to control the one or more processing units based on the positions of the detected pouches and the positions of the one or more pouch processing units along the transport system.

In an embodiment, at least one of the pouch processing units is an pouch inspection unit so that the apparatus may be a pouch inspection apparatus.

In an embodiment, the pouch detection system may be positioned at input of the transport system.

Hence, a structural feature may be used to detect the passing of one or more pouches. This way, a detection signal may be generated if a structural pouch feature passes through the detection area. Based on this detection method very fast and accurate detection of pouches may be realized, which is essential for processing pouches at high speed. Based on a structural feature the passing of more than one pouch may be determined. For example, a structural feature, e.g. a cross-seal, may be ‘missed’ by the detection system. In that case, if the dimensions of the pouches in the string of pouches have a predetermined size that is known to the system, the system may continue the process based on an expected length of a pouch.

Thus when the pouch processing system starts processing pouches, it may monitor pouches that enter the pouch processing system based on the detection signal of the pouch detection system. Further, position information, e.g. position values, determined by the position determination unit may be used to keep track of the position of the pouches in the transport system relative to the position of the pouch processing. If the pouch detector system detects a pouch (indicated for example by a pulse in a detector signal), the position (e.g. the value of the position counter) of the transport system at which the pouch as detected may be sorted. This stored position may be regarded as an initial position of the detected pouch in the transport system. Each time a pouch is detected, its initial position (representing the position of the transport band) may be stored.

During the processing of the string of pouches, a distance over which a pouch has been transported in the transport system can be determined based on the initial position of the detected pouch, i.e. the position of the band when the pouch was detected and a current position of the transport system (as e.g. indicated by the position counter). Thus, during the transport of the pouches by the transport band, the computer can monitor the distance each pouch has travelled over the transport band. If this distance matches the known distance between the pouch detector system and a pouch processing unit, the computer may control the pouch processing unit to process the pouch. The computer may use this scheme to control the processing of all pouches that are transported to the pouch processing units.

In an embodiment, the position determination unit and the controller may be separate functional units. In an embodiment, the position determination unit and the controller may be part of a computer system. In further embodiments, (parts of the) functionality of the position determination unit and the controller may be divided over different functional units that are configured to control the pouch processing system.

In an embodiment, the controller may be configured to: start a first pouch processing unit of the one or more pouch processing units if the position information indicates that the one of the one or more detected pouches has arrived at the first pouch processing unit.

In an embodiment, the position determination unit may include a position counter indictive of the position of the transport system as a function of time.

In an embodiment, the controller may be configured to: receive initial position information from the position determination unit, the initial position information being associated with a detection of one or more pouches passing the input of the pouch detection system; receiving further position information associated with the one or more detected pouches from the position determination unit during transport of the detected pouch by the transport system; determining on the basis of the initial position information and the further position information if the position of the one or more detected pouches in the transport system matches one of the one or more positions of the one of more pouch processing units.

In an embodiment, the one or more structural features may include at least one of: a cross-seal part that separates neighbouring pouches in the string of pouches, a perforation, a notch and/or hole in a seal of a pouch, preferably a seal along one of the sides of the string of pouches.

In an embodiment, the pouch detector may be an ultrasonic sensor system configured to detect transmission of an ultrasonic signal through the foil structure comprising the one or more structural features and/or reflection of an ultrasonic signal from the foil structure comprising the one or more structural features.

In another embodiment, the pouch detector is may be optical sensor system configured to detect transmission of an optical signal through the foil structure comprising the one or more structural features and/or reflection of an optical signal by the foil structure comprising the one or more structural features.

In an embodiment, the pouch detector may be configured to generate a sensor signal indicative that a pouch is detected, the sensor signal including pulses, a pulse being indicative of a detected pouch.

In an embodiment, the a position determination unit may be configured to determine a time instance associated with the detection of a pouch. In another embodiment, the a position determination unit may be configured to: determine pouch detection time instances based on a pouch detection signal of the pouch detection system; and, determine positions of detected pouches that are transported by the transport system to the one or more pouch processing units based on the pouch detection time instances and based on information on the velocity at which the string of pouches is transported to the one or more processing units. In this embodiment, positions of pouches may be determined based a pouch detection time and the velocity of the transport system as a function of time.

In an embodiment, the pouch detection system may include a transmitter for transmitting a signal towards the foil structure and a detector for detecting a signal transmitted through the foil structure.

In an embodiment, the pouch detection system may include a transmitter for transmitting signal towards the foil structure and a detector for detecting a signal reflected by the foil structure.

In an embodiment, the pouch detection system further may include a reader, for example an optical scanner, a camera or an RFID reader, for reading an information carrier associated with a pouch, preferably the reader being triggered to read the information carrier by the sensor signal.

In an embodiment, the pouch processing system may further comprise: a winding roll rotatable connected to a second motor for unwinding a string of pouches wound around the winding roll and feeding the string of pouches to an input of the transport system; a deflection sensor configured to determine a deflection signal indicative of a deflection of a part of the string of pouches that is suspended between the winding roll and the input of the transport system; wherein the controller is configured to control the second motor for unwinding the string of pouches from the winding roll based on the deflection signal.

In an embodiment, the one or more pouch processing units may include at least one of: a visible light imaging system, a hyperspectral imaging system, a sticker applicator, a text and/or code printer, a pouch cutter, a line scanner, a pouch winding unit, a pouch fan folding unit, inline boxing units, inline packaging unit, banding device, pouch roll soring unit. In an embodiment, the scheduler maybe configured to store initial positions of detected pouches, positions of detected pouches as a function of time and/or position information as a function in time in a memory

In an embodiment, the transport system may include a transport band for transporting the string of pouches

In an embodiment, the pouches in the string of pouches may have different sizes.

In a further aspect, the invention may relate to a method of processing a string of pouches by a pouch processing system comprising: detecting a structural feature in a foil structure of the string of pouches, the structural feature being associated with one or more pouches in the string of pouches that passes the input of a pouch detection system, the pouch processing system comprising one or more pouch processing units arranged at one or more positions respectively along the transport system; determining position information of the one or more detected pouches in the transport system; controlling the one or more pouch processing units based on the position information and the one or more positions of the one or more pouch processing units along the transport system.

In yet a further aspect, the invention may relate to a method of inspecting a string of pouches by a pouch inspection system comprising: detecting a structural feature in a foil structure of the string of pouches, the structural feature being associated with one or more pouches in the string of pouches that passes the input of a pouch detection system positioned an input of a transport system, the pouch inspection system comprising one or more pouch processing units arranged at one or more positions respectively along the transport system; determining position information of the transport system as a function of time; assigning an initial position to a detected pouch based on position information at the time the pouch was detected and monitoring positions of detected pouches as a function of time based on their initial positions and the position information; and, controlling the one or more processing units based on the positions of the detected pouches and the positions of the one or more pouch processing units along the transport system.

In an embodiment, the method may further comprise: starting a first pouch processing unit of the one or more pouch processing units if the position information indicates that the one or more detected pouches have arrived at the first pouch processing unit.

In an embodiment, controlling the one or more pouch processing units may include: receiving initial position information from the position determination unit, the initial position information being associated with a detection of one or more pouches passing the input of the pouch detection system; receiving further position information associated with the detected pouch from the position determination unit during transport of the one or more detected pouches by the transport system; and, determining on the basis of the initial position information and the further position information if the position of the one or more detected pouches in the transport system matches one of the one or more positions of the one of more pouch processing units.

In an embodiment, the one or more structural features may include at least one of: a cross-seal part that separates neighbouring pouches in the string of pouches, a perforation, a notch and/or hole in a seal of a pouch, preferably a seal along one of the sides of the string of pouches.

The invention may also relate to a computer program product comprising software code portions configured for, when run in the memory of a computer, executing the method steps according to any of process steps described above.

The invention will be further illustrated with reference to the attached drawings, which schematically will show embodiments according to the invention. It will be understood that the invention is not in any way restricted to these specific embodiments.

Brief description of the drawings

Fig. 1A and 1B illustrate schematics of a pouch processing system for processing a string of medicine pouches;

Fig. 2 illustrates a pouch processing system according to an embodiment;

Fig. 3A-3D depict detection signals and processing of detection signals according to an embodiment;

Fig. 4 illustrates a pouch processing system according to an embodiment;

Fig. 5 depicts a flow diagram of a method for processing a pouch in a string of pouches according to an embodiment

Description of the embodiments

Fig. 1A and 1B illustrate schematics of a pouch processing system for processing a string of pouches such as drugs pouches or medicine pouches. Pouch processing systems or parts thereof described with reference to the embodiments in this application may include one or more pouch processing units 102, wherein each pouch processing unit may be configured to process medicine pouches as shown in Fig. 1A. The processing of drugs pouches by the system may include examining, verifying and/or inspecting the structure of a pouch, its content and/or information carriers associated with a pouch.

The drugs pouches may be processed as a string of sealed pouches 108 as shown in Fig. 1B. These pouches may be fabricated using e.g. a plastic foil that is sealed using a sealing process, e.g. a thermal sealing process. Cross-seal parts 114 _1-4 separating the pouches 112^ may include a perforation so that pouches can be easily detached from the string. Typically, the cross-seal may be approximately 4-8 mm, typically 5-6 mm. Typically, the string of pouches may further include a seal 116 along the length of the string. These seals are realized during the packaging of the drug.

In some embodiments, the pouches may include structural pouch markers that may be introduced in the foil of the string of pouches during the packaging. For example, in an embodiment, notches 1181-3 may be introduced at certain positions in the side seal of the string of pouches. In another embodiment, a hole 120i-» may be introduced in the side seal. In other embodiments, structural markers in the side seal of a string of pouches may be located at predetermined positions, e.g. at the cross-seal or at the same height as an information carrier of a pouch. This way, the structural pouch maker may also indicate at which position the information carrier is printed on the pouch. As will be explained below in more detail, these physical pouch markers of the (string of) pouches may be used to reliably detect a pouch in the string of pouches.

Further, pouches may include an information carrier, e.g. printed text and/or symbols 110 _1-3 , which may be detected or scanned so that a pouch can be linked to information, e.g. patient, doctor, pouch content, prescription, etc. that may be stored in a database or the cloud. Depending on the prescription, different pouches may include different sets of drugs 113 _1-3 that a user may need to take a predetermined times over a certain period of time. Hence, a drugs packaging system may generate a string of pouches based on information related to drugs prescriptions of customers.

In case the one or more processing units form a pouch inspection system, then the system may include a pouch infeed system 104 for feeding a string of pouches to the input of the pouch inspection system and a pouch outfeed system 106 for guiding an inspected string of pouches out of the system and onto a winding roll. The system for processing medicine pouches may be a modular system wherein the infeed and/or the outfeed system may be connected as a module to one or more pouch processing units. In other embodiments the infeed and/or the outfeed system may form an integral part of the pouch processing system.

The pouch processing units may be configured to process the pouches at a high rate, four example 10.000 pouches per hour or more. Further, the pouch inspection system should be capable of processing pouches that may vary in size, e.g. small fluctuations in size due to the packaging process or pouches of dimensions in one batch as prepared by the pouch packaging system. Hence, in such case the system should be able to accurately localize pouches throughout the processing system so that a pouch processing unit knows when a pouch arrives at its input for processing.

Fig. 2 illustrates a pouch processing system according to an embodiment of the invention. The pouch processing system may include an infeed apparatus 202 and a pouch processing apparatus 204. The pouch processing apparatus may include a transport system 212, e.g. a conveyor band or the like, connected to a first motor 214. The transport system may be configured to transport the string of pouches downstream towards one or more pouch processing units 222 _1-n that are located at predetermined positions along the transport system. A pouch processing unit may be configured to process a pouch in a predetermined manner. For example, a pouch processing unit may be a pouch inspection unit including a camera system for visual inspection of pouches that are transported through the pouch processing unit. Non-limiting examples of pouch processing units may include one of: a hyperspectral imaging unit, a pouch quality check unit, a stickering unit, a printing unit, a pouch cutter unit, etc.

A pouch detection system 216a, 216b may be positioned at the input of the transport system. The pouch detection system may be configured to detect pouches entering the input of the transport system. The (motor of) the transport system, the pouch processing units and the pouch detection system may be controlled by a computer 224. In particular, the computer may receive sensor information and, optionally, identification information of pouches entering the pouch processing system. A scheduler 225 in the computer may schedule the processing of the localized and identified pouches by the one or more pouch processing units.

In an embodiment, the pouch detection system may be configured to detect a pouch based on one or more structural pouch features. For example, in an embodiment, the pouch detection system may be configured to detect structural pouch markers in that are present in the foil of the pouch structure. In an embodiment, structural pouch markers may include cross-seals of pouches in the string of pouches. The pouch detection system is configured to detect one or more physical features of pouches. For example, in an embodiment, the pouch detection system may be configured to detect structural pouch markers in the foil of the string of pouches. In an embodiment, the pouch detection system may include an transmitter 216a configured to emit a first signal, e.g. one or more first ultrasonic pulses or first optical pulses, in the direction towards a moving string of pouches and an detector 216b configured to detect a second signal, e.g. one or more second ultrasonic pulses or second optical pulses, indicative of the amount of the first signal that passes through the moving string of pouches. As shown in the figure, the string of pouches may be transported through an detection area, i.e. an area between the transmitter and detector.

At certain structural pouch features, such as cross-seal parts, notches and/or holes in the seal along the sting of pouches, a larger portion of the ultrasonic waves will pass the string of pouches when compare to the pouch parts. Thus, when the string of pouches passes through the ultrasonic detection area between the ultrasonic transmitter and receiver, a detection signal will be generated each time a structural pouch feature passes through the detection area. This way, the detection signal may form a sequence of pulses indicating the passage of a structural feature of a pouch entering the pouch processing system at certain time instances. This detection method provides a very fast and accurate detection of a pouch, which is essential for processing pouches at high speed. The pouch detection system may further include an sensor 217, e.g. a scanner or a camera, for readout of an information carrier associated with a pouch that enters the pouch processing system.

In some embodiments, the computer may comprise a clock which may be used to associate a detection pulse representing a pouch entering the input of the transport system to a detection time (i.e. a time a pouch is detected). For example, in some embodiments, a detection pulse may be time-stamped using the time indicated by the clock. In some embodiments, the computer may comprise a position determination unit to determine a position of a detected pouch as indicated by a detection pulse. Further, the information carrier sensor, e.g. a bar code or QR scanner or a camera, may determine identification information, e.g. an identifier associated with the detection pulse, which allows the scheduler to schedule processing of each pouch by the one or more pouch processing units.

Examples of detection signals are shown in more detail in Fig. 3A and 3B. For example, Fig. 3A depicts a schematic of a top view of a string of pouches that enters the pouch processing system with a certain velocity v(t). At the input pouches will pass through the pouch detection area as described with reference to Fig. 2.

Absorption and/or reflection of a signal transmitted by a transmitter of the pouch detection system may depend on the structure of the part of the pouch that passes through the detection area. For example, if a pouch passes the detection area a substantial amount of ultrasonic waves transmitted by an ultrasonic transmitter may be reflected and/or absorbed when a structural feature that is unique to a pouch passes the detection area. For example, in an embodiment, an ultrasonic sensor may be configured to detect a cross-seals. In that case, the detection signal relies on the fact that ultrasonic waves will easier pass the cross-seal part than the double sheet structure of body of a pouch. In further embodiments, the ultrasonic sensor may be configured to detect notches and/or openings in the side seal of the string of pouches. These notches and/or openings may be introduced during the packaging process.

Absorption and/or reflection of a signal transmitted by a transmitter of the pouch detection system may be translated by the detector system into pulse signals. An example of such signal is shown in Fig. 3A. In this example, the size of the pouches may be substantially the same. Further, the speed of the pouches entering the pouch processing system may be substantially constant. In that case, the pouch detection system may generate a sequence of substantially equidistant pulses, wherein each pulse identifies a passage of physical feature of the pouch (e.g. a cross-seal and/or a notch and/or opening in the side seal) at a certain detection position and/or detection time, for example cross-seal ci associated with IDi at detection position pi and detection time ti , cross-seal C associated with ID at detection time t and detection position p , etc. Here, the detection position may be the position of the transport system when a cross seal is detected.

Each signal that is associated with an identified pouch may be used by the scheduler to schedule processing of the pouch by the different pouch processing units that are located downstream of the transport system. The scheduler may monitor the position of the pouches based on information provided by the position determination unit (for example the detection time and the velocity of the string of pouches as a function of time or the determination of pouches in the transport system based on a position counter that indicates the position of the transport system, e.g. a conveyer belt, as a function of time). Hence, the system knows the position of each pouch when it is transported through the pouch processing system. This way, the pouch processing system is able to accurately process the pouches at high speed, including reliably cutting the string of pouches at a cross-seal even when the size of the pouches may vary due to inaccuracies of the packaging process. In case, the pouches have a predetermined pouch size, the system may expect pulses at predetermined distances. This way, if a structural feature, e.g. a cross-seal, is ‘missed’ by the detection system, the system may continue the detection process on the basis of an expected length of a pouch.

As the position of a pouch is known, in an embodiment, instead of cutting the pouch at the cross sealing, the pouch can also be cut at other positions, e.g. at a predetermined position behind a seal. This way, the system is also capable op cutting a pouch open.

The pouch detection system may also allow processing of a string of pouches wherein the pouches have different sizes. An example of a detection signal for the case wherein the velocity of the string of pouches is substantially constant is shown in Fig. 3B. Each pulse of the sequence of the pulses may identify the passing of at least one structural feature, e.g. cross-seal, notch and/or hole in a side seal, in the foil of subsequent pouches. This way pouches of at least a first size and at least a second size may be detected, wherein the first size is smaller than the second size. The scheduler may use the detection signal to schedule processing by the processing units and to monitor the position of the pouches on the transport system in time.

Fig. 3C and 3D illustrate the processing of detection signals and the control of a pouch processing system based on detection signals according to an embodiment of the invention. Fig. 3C depicts part of a pouch processing system similar to the one described with reference to Fig. 2, wherein a computer 306 includes a scheduler 308 for controlling one or more pouch processing units 314 _1-n and transport system 312 based on detection signals of a pouch detection system 319. The pouch detection system may comprise one or more sensors, e.g. ultrasonic or optical sensor 316 and an information carrier sensor 317, e.g. an ID scanner such as a bar code or QR scanner or a camera comprising a character recognition module for detecting text and/or codes on the pouch. The pouch processing units 314 _1-n may be arranged at predetermined positions 320 _1-n along the transport system relative to the position of the pouch detector system at the input of the pouch processing system.

The transport system may be connected to a position determination unit 313 configured to determine position information for detected pouches. For example, the motor of the transport system may be linked to counter (e.g. counting revolutions) to a position on the transport band. Hence, the position determination unit use such position counter to determine positions of the transport system, e.g. the transport band such as a conveyor band or the like, as a function of time. Based on this position information, the distance the transport band, including the string of pouches, has progressed over time may be determined. During the processing, the distance travelled by the transport band will increase, wherein the increase may be proportional to the speed of the transport band. The position counter may thus determine the positions based on the number of revolutions that the motor of the transportation system has made since a pouch was detected. This way, the position counter may be used to uniquely identify a position of a detected pouch in the transport system.

When the system starts processing pouches, the scheduler may start monitoring positions of pouches that enter the pouch processing system based on the detection signal of the pouch detection system as illustrated in Fig. 3D. To that end, the scheduler may be use position values as determined by the position determination unit 313. Further, the scheduler may include a memory comprising buffers 326 _1-n , to keep track of the pouches, wherein each buffer 326 _k may be associated with a pouch processing unit 314 _k and a position 320 _k of the pouch processing unit. Here, the position of the pouch processing unit may be expressed as a position relative to the position of the pouch detection system.

If the pouch detector system detects a pouch (indicated for example by a pulse in a detector signal), the scheduler may store the position (e.g. the value of the position counter) of the transport system at which the pouch was detected in the buffers. The stored position may be regarded as an initial position of the detected pouch in the transport system. In some embodiments, also an identifier ID 322 of the detected pouch may be stored and/or a detection time 324 may be stored in the memory. Each time a pouch is detected, a position value (representing the position of the transport band) may be added to the buffers.

The distance over which a pouch has been transported can be determined by the scheduler based on the initial position of the detected pouch, i.e. the position of the band when the pouch was detected and a current position of the transport system (as e.g. indicated by the position counter). Thus, during the transport of the pouches by the transport band, the scheduler can continuously monitor the distance each pouch has travelled over the transport band. This way, the schedular can monitor the position of each pouch continuously. If this distance (or position) matches the known distance (position) between the pouch detector system and a pouch processing unit, the scheduler may control the pouch processing unit to process the pouch. At that point, the scheduler may remove the initial position of the pouch from the buffer of the pouch processing unit. The scheduler may use this scheme to control the processing of all pouches that are transported to the pouch processing units.

It is submitted that the detection and scheduling schemes described with reference to Fig. 2 and 3 may be used in situations where the speed v(t) that is used for transporting the string of pouches through the pouch processing system varies in time. For example, the transport of the pouches may include ramping down the transport speed, e.g. to stop the transport and/or ramping up the transport speed, e.g. to start the transport of pouches. Variations in the speed of the transport system will be reflected in variations in the increase of the position counter. Based on the detection of pouches, position information (e.g. the position of transport system as a function of time as indicated by the position counter) and the position of the processing units relative to the pouch detection system, accurate monitoring of the positions of the pouches in time is realized. Alternatively and/or in addition, position information may also be realized based on the detection time of the pouches and the speed of the transport system comprising the string of pouches as a function of time.

Fig. 4 illustrates a pouch processing system according to an embodiment of the invention. In particular, the figure depicts a pouch processing system 400 comprising an infeed system 402 and a pouch processing apparatus 404 and an outfeed system 406. The infeed system includes a mechanism for feeding a string of pouches from a first rotatable winding roll 430 to the input of the pouch processing apparatus. Similarly, the outfeed system includes a mechanism for receiving the part of the string of pouches that are inspected by the pouch inspection apparatus and for winding the string of pouches around a second rotatable winding roll 440.

The transport system of the pouch inspection system may be connected to a first motor 414 for controlling the transport velocity of the string of pouches that is transported downstream along one or more pouch processing units e.g. cameras, hyperspectral imagers, cutters, detectors, printers, etc. towards the outfeed system. The pouch inspection system may include a pouch detection system 419 positioned at the input of the transport system. The pouch detection system may be configured to generate a pouch detection signal which is used by a (central) computer 410 which controls the various pouch processing units. The pouch detection system may be implemented as a pouch detection system as described with reference to Fig. 2 and 3. In an embodiment, the pouch detection system may be configured to detect a pouch by detecting one or more physical features in the foil of a pouch structure. For example, in an embodiment, the pouch detection system may be configured to detect cross-seals of pouches in the string of pouches that passes the position where the pouch detection system. Each time a cross seal passes the pouch detection system, a sensor signal is generated that is indicative of an edge of a pouch passing the input of the pouch inspection system.

In an embodiment, the pouch detection system 419 may include a sensor 416 which is positioned above and/or under the string of pouches that enters the input of the transport system. The sensor may include an transmitter for transmitting a signal, e.g. ultrasonic pulses or optical pulses, towards pouches and an detector for detecting a signal, e.g. ultrasonic pulses or optical pulses, transmitted through and/or reflected by the pouches. The sensor may be configured to detect structural features of a pouch, e.g. a cross-seal or a structural pouch marker, such as a notch and/or hole in the seal part of a pouch, of a pouch that enters the input of the transport system. This way, one or more pouch features may be detected that are indicative of a new pouch entering the transport system at a certain time (the pouch detection time). At that moment, a position of the transport system may be assigned to the detected pouch. The computer system that controls the pouch processing system may use the pouch detection signals to accurately determine and monitor the position of pouches that are transported by the transport system to the one or more pouch processing units. Additionally, the computer system may control the first motor of the transport system based on the pouch detection signals. This way accurate control of the position of the pouches may be achieved, which is particular important when increasing the speed at which the pouches are transported and processed.

In a further embodiment, the pouch detection system may also include a detector 417 for reading an information carrier associated with a pouch. For example, in an embodiment, the detector may be an optical scanner and/or camera configured to read an information carrier, e.g. a code such as a barcode and/or QR code or text, that is printed on the pouch. In another embodiment, the detector may be an RF scanner for detecting an RF tag that is attached to the pouch. The information carrier may include an identifier for linking a pouch with information that may be stored in a database.

When the string of pouches is transported by the transporting system downstream towards the outfeed system, the pouches may pass one or more pouch processing units, wherein at least one of the pouch processing units is a pouch inspection unit for inspecting, e.g. visually inspecting, the pouches and their content. For example, at a first downstream position, a first pouch processing unit may be a first imaging system 418 may be configured to generate image in the visible and, optionally, in the non-visible spectrum, such as the near-infrared NIR and infrared IR part of the spectrum. In some embodiments, the imaging system may include an illumination system 420, e.g. a back-light illumination system for illuminating the pouches during the imaging. At a further second downstream position, a second pouch processing unit may be a further camera system 422 may be configured to capture images of the backside of the pouches. At a third downstream position, a pouch processing unit may be located that comprises a hyperspectral imaging camera 424 and a hyperspectral illumination lamp 426. In an embodiment, the hyperspectral imaging camera may be a line imaging camera, which performs line scanning while a pouch passes the line scan area of the hyperspectral imager. When performing such line scanning process, accurate information on the position of a pouch can be determined by the computer based on the pouch detection signal that is generated by the pouch detection system.

In an embodiment, the hyperspectral camera may be configured to perform hyperspectral imaging on the content of the pouches, e.g. objects like pills and capsules. Pharmaceutically active compounds in pills and capsules may be responsive to near infrared radiation, i.e. radiation in the range between approximately 900 and 1700 nm. This way, hyperspectral imaging may be a valuable tool for inspecting objects in the pouches, such as inspecting pharmaceutically active compounds. Hence, per pixel of the hyperspectral camera, a plurality of spectral values, preferably 100 or more spectral values, may be detected within a predetermined part of the electromagnetic spectrum, for example, the visible band between 400 nm and 800 nm and/or the near infrared band, e.g. between 800 and 1700 nm. The NIR part of the EM spectrum is especially suitable to determine responses of pharmaceutically active compounds. Hence, each spectral value represents a spectral response of an object, e.g. a medicine, captured by the hyperspectral imaging system.

During hyperspectral imaging an object may be illuminated using an illumination source 426 that is especially suitable for hyperspectral imaging. For hyperspectral applications the illumination source may be selected to have a continuous spectrum in the relevant parts of the spectrum, for example a continuous spectrum in the UV, visible and/or near infrared (NIR) range. Illumination sources that are suitable for this purpose include incandescent light sources, such as halogen lamps, that are based on a high-temperature heated filament An example of such hyperspectral illumination lamp is described in related Dutch application NL2027037 with title Lamp for hyperspectral imaging and an example of such hyperspectral imaging system is described in related Dutch application NL1043858 with title Inspecting medicine objects based on hyperspectral imaging, both of which are hereby incorporated by reference into this application.

Similarly, at (yet) a further position along the transport system, the system may include a pouch processing unit in the form of a pouch cutter 428 to cut the string at a predetermined position, in particular at a position of a cross-seal. The pouch detection system based on structural (physical) features in the foil of the string of pouches allows position information on pouches so the cutter can be controlled to reliably cutting pouches at the cross-seal region irrespective if the dimensions of the pouches vary in size. Other pouch processing units (not shown) may include a printer for printing certain information after inspection onto the pouch and/or a labelling or a stickering unit for labelling a pouch after inspection.

The computer system 410 may centrally monitor and control the various imaging systems, the transport system, the pouch cutter and any further modules and/or sensors that are needed for the pouch processing, including (at least part of the) processes that are executed by the infeed and outfeed systems. Further, the computer system may comprise one or more image processing modules configured to process the data generated by the various imaging systems, sensors and/or detectors so that the pouches and their contents can be reliably inspected.

At the input side of the pouch inspection system, the infeed system controls the infeed pouches. The infeed apparatus includes a winding roll 430 connected to a second motor 432 controlled by an infeed controller 408. The winding roll may be configured to carry a string of pouches wound around the roll. Each pouch may comprise objects representing e.g. pills, tablets, capsules and/or ampules. The winding roll may be mounted on a support structure so that the infeed controller may control the second motor based one or more sensor signals of one or more sensors 416, 418 respectively. This way, the rotation of the winding roll can be controlled to unwind the string of pouches from the winding roll and fed onto a transport system at the input side of the pouch processing apparatus based on the sensor signals.

As shown in the figure, when unwinding the string of pouches that is wound around the winding roll, part of the string of pouches is suspended in the air between the winding roll and the input side of the pouch processing apparatus. Thus, the first motor of the transport band will transport the string of pouches into the pouch processing apparatus based on a certain first velocity, while the second motor that controls the rotation of the winding roll may be controlled to cause the string of pouches to unwind with a second velocity which substantially matches the first velocity so that that the suspended part of the string of pouches maintains a certain deflection. This deflection is the result of an interplay between gravity and the tension in the plane of the string of pouches. As will be described hereunder in more detail, the deflection will be used as a measure of the tension, i.e. the pulling forces, that the string of pouches will experience during the infeed process.

The deflection of the suspending part of the string of pouches may be determined by a first sensor 434. The first sensor may be configured as a contactless distance sensor for measuring a height 435 of the deflection relative to a reference position. For example, in an embodiment, the sensor may be a time-of-flight (TOF) sensor that is capable to determine the height of the suspending string at a certain position relative to a reference position. The infeed controller 408 may control the motor based a first sensor signal generated by the first sensor. In particular, based on the first sensor signal the infeed controller may control the first motor and thus the velocity for unwinding the string of pouches such that the deflection is substantially constant in time.

In an embodiment, the infeed system may include a further second sensor 436 which is adapted to determine a measure representing the extent to which the string of pouches has unwound from the roll. In an embodiment, the second sensor may be a TOF sensor. For example, the sensor may measure a diameter of the roll that comprises the wound string of pouches. This information may be used by the second controller to control the velocity of the unwinding of the string of pouches more accurately. For example, during the unwinding of the string of pouches, the radius at which the string leaves the roll to become part of the suspending part of the string will decrease. The second controller may use this information to control the motor that drives the winding roll. This way, the second controller may control the motor that drives the roll to accurately maintain the deflection in the suspended part of the string of pouches between the winding roll and the input of the pouch processing apparatus.

Thus, the infeed system shown in the figure is configured to control the infeed of the string of pouches based on a simple sensor system, without the need of complex mechanical mechanisms configured to regulate the tension in the string of pouches and/or to damp effects relating to the inertia of the winding roll. It substantially reduces the necessity to use mechanical means for controlling the tension in the string of pouches. This way the mechanical and structural complexity of the system can be substantially reduced, which makes the system less sensitive for errors and failures. Further, the infeed system allows independently control of the infeed of the string of pouches without the need of being fully controlled by the pouch processing apparatus. Here, independent control may refer to the fact that a controller of the infeed or outfeed system controls the motor solely based on sensor information without the need of further information from the pouch inspection system it is connected to.

At the output side of the pouch inspection system, the string of inspected pouches may be received by the outfeed system 406, which may include a second winding roll 440 connected to a third motor 438 to wind the inspected pouches on the second winding roll. The third motor may be controlled by an outfeed controller 412. In an embodiment, the pouch inspection system, the infeed system and the outfeed system may be controlled by the computer system of the pouch inspection system. To that end, the first and third controller may be connected to the computer system which is configured to control the pouch inspection system. In some embodiments, at least the first controller of the pouch infeed system may control the unwinding of the winding roll independently from the computer of the pouch inspection system that controls the pouch inspection system.

The computer system 410 of the pouch processing apparatus may be connected to the infeed controller and outfeed controller. Further, the computer system may be further connected via one or more networks to a database system (not shown) for storing information of processed pouches and/or for retrieving information about pouches that are going to be processed by the pouch processing system. Different pouch processing systems at different locations may be connected to such database system.

In one embodiment, the computer system and the controllers may form a distributed system, wherein each motor controller is arranged locally with the motor. In other embodiments, the controllers for the motors may be centrally implemented with the computer system. In further embodiments, part of the controllers and/or computer system may be implemented at a remote location, e.g. in the cloud and/or on a server system. Further, the controllers may be implemented as hardware modules, software modules or a combination thereof.

In the embodiments described in this application, the deflection of the string of pouches may be measured based on a contactless sensor method. For example, in an embodiment, a sensor may be configured to determine a distance between the sensor (or another reference point) and the suspended part of the string.

Such distance sensor may be configured to determine a distance value based on a signal transmitted towards the suspended part of the string and a signal reflected from the suspended part of the string, for example a first time-of-flight sensor or camera.

Further, the number of pouches wound around a winding roll may be measured based on a contactless sensor method. For example, in an embodiment, a sensor may be configured to determine a distance between the sensor (or another reference point) and the string of pouches that are wound around the winding roll. Such distance sensor may be configured to determine a distance value based on a signal transmitted towards the suspended part of the string and a signal reflected from the suspended part of the string, for example a first time-of-flight sensor or camera.

In further embodiments, any type of sensing method for determining the deflection of the string of pouches and/or for determining the number of pouches wound around a winding roll may be used. The sensing methods may include optical or acoustic sensors. Alternatively, and/or in addition the sensing methods may include imaging methods wherein the deflection and/or the number of pouches is determined by analysing pictures (video frames) of the string of pouches at the deflected part of the string or at the winding roll.

Fig. 5 depicts a flow diagram of a method for processing pouches according to an embodiment of the invention. The process may include detecting a structural feature in a foil structure of the string of pouches, the structural feature being associated with a pouch in the string of pouches that passes the input of a pouch detection system (step 502). Different sensors as described with reference to the embodiments in this disclosure may be used to detect the structure feature (for example a cross-seal, a perforation, a notch and/or hole in a seal of a pouch, e.g. a side-seal of a pouch). Here, the pouch processing system may comprise one or more pouch processing units arranged at one or more positions respectively along the transport system. A detector signal may be generated that is indicative of a detection of the structural feature. Further, position information of the detected pouch in the transport system may be determined (step 504). The position information may be determined by a position determination unit as described above with reference to Fig. 3C and 3D. The position determination unit may include a position counter indictive of the position of the transport system as a function of time. Then the one or more pouch processing units may be controlled based on the position information and the one or more positions of the one or more pouch processing units along the transport system (step 506). This way, a first pouch processing unit of the one or more pouch processing units may be started if the position information indicates that the detected pouch has arrived at the first pouch processing unit.

The controlling of the one or more pouch processing units may include receiving an initial position information from the position determination unit, wherein the initial position information is associated with a detection of a pouch passing the input of the pouch detection system; receiving further position information associated with the detected pouch from the position determination unit during transport of the detected pouch by the transport system; and, determining on the basis of the initial position information and the further position information if the position of the detected pouch in the transport system matches one of the one or more positions of the one of more pouch processing units. Using structural features in the foil structure of the string of pouches to detect pouches entering the pouch processing system allows accurate processing of the pouches by multiple pouch processing units in the system at a high rate by the pouch processing system. The method is insensitive to fluctuations in the size of the pouches.

The techniques of this disclosure may be implemented in a wide variety of devices or apparatuses, including a wireless handset, an integrated circuit (IC) or a set of ICs (e.g., a chip set). Various components, modules, or units are described in this disclosure to emphasize functional aspects of devices configured to perform the disclosed techniques, but do not necessarily require realization by different hardware units. Rather, as described above, various units may be combined in a codec hardware unit or provided by a collection of interoperative hardware units, including one or more processors as described above, in conjunction with suitable software and/or firmware.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.