Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
MEASUREMENT SYSTEM AND MEASUREMENT METHOD FOR MEASURING VIDEO PROCESSING QUALITY
Document Type and Number:
WIPO Patent Application WO/2014/175823
Kind Code:
A1
Abstract:
A measuring system for measuring video processing quality of a device under test (4) comprises a measuring device (2) comprising transmission means (11) set up for transmitting a video to the device under test (4). The device under test (4) is set up for receiving the video and displaying it using a display comprised by the device under test (4). The video comprises at least a first barcode to be displayed for a first duration. The measuring system (1) comprises a barcode reader (3) set up for reading the first barcode from the display of the device under test (4). The measuring system (1) is set up for determining the video processing quality of the device under test (4) based upon measuring results of the barcode reader (3).

Inventors:
TAY CHUN GUAN (SG)
DURAI RAJASHEKAR (SG)
Application Number:
PCT/SG2013/000471
Publication Date:
October 30, 2014
Filing Date:
October 31, 2013
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
ROHDE & SCHWARZ ASIA PTE LTD (SG)
International Classes:
H04N17/04; H04M1/24
Foreign References:
EP0888019A11998-12-30
EP2239952A12010-10-13
EP0789497A21997-08-13
EP1926325A22008-05-28
EP1377080A12004-01-02
DE10112528A12002-09-19
Attorney, Agent or Firm:
DREW & NAPIER LLC (#10-01 Ocean Financial Centre, Singapore 5, SG)
Download PDF:
Claims:
Claims

1. Measuring system for measuring video processing quality of a device under test (4), with a measuring device (2) comprising transmission means (11) set up for transmitting a video to the device under test (4),

wherein the device under test (4) is set up for receiving the video and displaying it using a display comprised by the device under test (4),

characterized in that

the video comprises at least a first barcode (30-34, 60- 67, 90-95, 111-132) to be displayed for a first duration (tl, t8, t9, tlO, til, tl2, tl3),

the measuring system (1) comprises a barcode reader (3) set up for reading the first barcode (30-34, 60-67, 90-95, 111-132) from the display of the device under test (4), and the measuring system (1) is set up for determining the video processing quality of the device under test .(4) based upon measuring results of the barcode reader (3) .

2. .Measuring system according to claim 1,

characterized in that

the video comprises a second barcode to be displayed for a second duration, and

the barcode reader is set up for reading the second barcode from the display of the device under test.

3. Measuring system according to claim 1 or 2,

characterized in that

the video comprises a plurality of barcodes to be

displayed consecutively for a constant or decreasing or increasing duration.

4. Measuring system according to any of the claims 1 to 3, characterized in that

the video comprises a gap of a certain duration, during which no barcode is displayed after each comprised

barcode, and

in case of more than one barcodes being present in the video, the duration of consecutive gaps is constant or increasing or decreasing.

5. Measuring system according to any of the claims 1 to characterized in that

the video comprises a distinct barcode for each frame of the video . .

6. Measuring system according to one of the claims 1 to characterized in that

the barcode reader is set up .for processing barcodes wit at least the frame rate of the video.

7. Measuring system according to any of the. claims 1 to characterized in that

the transmission means (11) of the measuring device are set up for transmitting the video at a changing frame ra and/or bitrate and/or bit error rate and/or resolution and/or latency between packet transmission and/or video coding scheme, and

the measuring system (1) is set up for determining the video processing quality based upon a correct barcode reception by the barcode reader (3) .

8. Measuring system according to any of the claims 1 to 7, characterized in that

the measuring system comprises a control unit (12) set up for controlling the function of the measuring device and of the barcode reader, and the control unit (12) is set up for determining the video processing quality of the device under test.

9. Measuring method for measuring video processing quality of a device under test (4),

wherein a video is transmitted to the device under test (4), and

wherein the device under test (4) is set up for receiving the video and displaying it using a display .comprised by the device under test (4),

characterized in that

the video comprises at least a first barcode (30-34, 60- 67, 90-95, 111-132) to be displayed for a first duration (tl, t8, t9, tlO, til, tl2, tl3),

the first barcode (30-34, 60-67, 90-95, 111-132) is read from the display of the device under test (4), and

the video processing quality of the device under test (4) is determined based upon measuring results of reading the barcode.

10. Measuring method according to claim 9,

characterized in that

the video comprises a second barcode to be displayed for a second duration, and

the second barcode is read from the display of the device under test.

11. Measuring method according .to claim 9 or 10,

characterized in that

the video comprises a plurality of barcodes to be

displayed consecutively for a constant or decreasing or increasing duration.

12. Measuring method according to any of the claims 9 to 11,

characterized in that

the video comprises a gap of a certain duration, during , which no barcode is displayed after each comprised

barcode, and

in case of more than one barcodes being present in the video, the duration of consecutive gaps is constant or increasing or decreasing.

13. Measuring method according to any of the claims 9 to 12,

characterized in that

the video comprises a distinct barcode for each frame of the video.

14. Measuring method according to any of the claims 9 to 13,

characterized in that

barcodes are processed with at least the frame rate of the video.

15. Measuring method according to any of the claims 9 to characterized in that

the transmission of the video is performed at a changing frame rate and/or bitrate and/or bit error rate and/or resolution and/or latency between packet transmission and/or video coding scheme, and

the video processing quality is determined based upon a correct barcode reception by the barcode reader.

Description:
Measurement system and measurement method for measuring video processing quality

The invention relates to a measuring system and measuring method for measuring a video processing quality of a device under test, preferably a user equipment such as a smart-phone .

For determining a user experience when viewing a video, especially a streaming video on a smartphone, the correct reception and display of each single frame is the most important criteria. Although image errors or skipped frames can be tolerated up to a certain amount, the measurement of. these parameters is of relevance to a user experience determination.

There exist systems for measuring the image quality of a video transmission. For example the German patent

application DE 101 12 528 Al shows such a system. The system though is disadvantageous, since a high

computational power is required in order to analyze the images that have been received by the device under test, since an image recognition comprising a correlation with a transmitted test image is performed.

The object of the present invention is to create a

measuring system and a measuring method capable of

determining the video processing quality of a device under test without requiring expensive hardware or a high computational complexity.

The invention is solved by . the features of claim 1 for the measurement system and by the features of claim 9 for the measuring method. Dependent claims contain further developments.

An inventive measuring system for measuring video

processing quality of a device under test comprises a measuring device comprising transmission means set up for transmitting a video to the device under test. The device under test is set up for receiving the video and

displaying it using a display comprised by the device under test. The video comprises at least a first barcode to be displayed for a first duration. The measuring system comprises a barcode reader set up for reading the first barcode from the display of the device under test. The measuring system is set up for determining the video processing quality of the device under test based upon measuring results of the barcode reader. This setup allows the measurement of video processing quality with a low computational complexity and low hardware costs.

Advantageously, the video comprises a second barcode to be displayed for a second duration. The barcode reader is then set up for reading the second barcode from the display of the device under test. It is thus possible to detect a minimum duration necessary for displaying the barcode in order for the device under test to correctly display it.

Even more advantageously, the video comprises a plurality of barcodes to be displayed consecutively for a constant or decreasing or increasing duration. This allows an even more accurate detection of the video processing quality.

Advantageously, the video comprises a gap. of a certain duration, during which no barcode is displayed after each comprised barcode. In case of more than one barcode being present in t¾e video, the duration of consecutive gaps is constant or increasing or decreasing. This allows. for a processing time of the barcode reader. A lower cost barcode reader can therefore be used.

Even more advantageously, the video comprises a distinct barcode for each frame of the video. This allows for a very accurate detection of the video processing quality.

The barcode reader is advantageously set up for processing barcodes with at least the frame rate of the video. This even further increases the measurement accuracy.

The transmission means of the measuring device are

advantageously set up for transmitting the video at a changing frame rate and/or bitrate and/or bit error rate and/or resolution and/or latency between packet

transmission and/or video coding scheme. The measuring system is then set up for determining the video processing quality based upon a correct barcode reception by the barcode reader. This allows for testing the video

processing quality of the device under test under

different conditions.

The measuring system advantageously comprises a control unit set up for controlling the function of the measuring device and of the barcode reader. The control unit is then set up for determining the video processing quality of the device under test. This enables an automatic measurement process. -

An inventive measuring method serves the purpose of measuring a video processing quality of a device under test. A video is transmitted to the device under test. The device under test is set up for receiving the video and displaying it using a display comprised by the device under test. The video comprises at least a first barcode to be displayed for a first duration. The first barcode is read from the display of the device under test. The video processing quality of the device under test is determined based upon measuring results of reading the barcode. This setup allows the measurement of video processing quality with a low computational complexity and low hardware costs.

An exemplary embodiment of the invention is no further explained with respect to the drawings, in which

Fig. 1 shows an exemplary embodiment of the inventive measuring system in a block diagram;

Fig. 2 shows a first exemplary test video in a time- diagram;

Fig. 3 shows a second " exemplary test video in a time- diagram;

Fig. 4 shows a third exemplary test video in a time- diagram;

Fi . 5 shows a forth exemplary test video in a time- diagram, and

Fig. 6 shows an exemplary embodiment of the inventive measuring method in a flow chart. First we demonstrate the construction and function of an exemplary embodiment of the inventive measuring system with respect to Fig. 1. With respect to Fig. 2 - Fig. 5 we furthermore show different possible test video

compositions. Finally, along Fig. 6 we demonstrate the function of an embodiment of the inventive measuring method. Similar entities and reference numbers in

different figures have been partially omitted.

In Fig. 1 an embodiment of the inventive measurement system 1 is shown. The measurement system 1 comprises a measuring device 2, a barcode reader 3 and a personal computer 5. The measuring system 1 is set up for measuring the video processing quality of a device under test 4, for example a mobile phone, for example a smartphone.

The measuring device 2 comprises signal generating means 10, transmission means 11 and control means 12. The control means 12 are set up for controlling the function of the signal generation means 10 and the transmission means 11. The control means 12 controls the signal

generation means 10 so that the signal generation means 10 generate a signal comprising a video to be transmitted to the device .under test . The signal generation means 10 transmits the signal to the transmission means 11, which create a radio frequency signal and transmit it to the device under test 4. The transmission means 11 and the device under test 4 are either connected to each other over-the-air or through a cable connection. In Fig. 1 an over-the-air-connection is depicted.

The signal generated by the signal generation means 10 comprises a video to be displayed by the device under test 4. This video can either be a streaming video or a video file. When the device under test 4 receives the video, it is set up for starting to display the video on its screen. The described barcode reader 3 is set up for reading barcodes from the screen of the device under test 4, which are present within the video, which is displayed by the display of the device under test 4.

The barcode reader 3 and the measuring device 2 are controlled by the personal computer 5. The personal computer 5 instructs the measuring device 2 to generate and transmit the signal comprising the video to the device under test 4. The personal computer 5 instructs the barcode reader 3 to read the barcodes from the display of the device under test 4. Moreover, the personal computer 5 receives measuring results of the barcode reader 3 and processes them.

In an alternative embodiment, the measuring system 1 does not comprise a personal computer 5. The barcode reader 3 is then directly connected to the control means 12 of the measuring device 2. The control means 12 then fulfill the entire function of the personal computer 5. The control means 12 then control the function of the barcode reader 3 and receive measuring results of the barcode reader 3. The control means 12 then also process the measuring results of the barcode reader 3 and the display them on a display connected to the measuring device 2, which is not shown in Fig. 1.

Alternatively, the device under test 4 and the

transmission means 11 are not connected through an ideal channel, but through fading means, producing a sub-optimal transmission channel. Then it is possible to determine the ability of the device under test 4 to receive and display the video under sub-optimal transmission conditions.

Alternatively, the transmission means 11 may be set up for creating the RF-signal so that it is already modified accordingly.

In Fig. 2, a first time-sequence 20 of the video

transmitted to the device under test 4 of Fig. 1 is shown. A first barcode 30 is displayed for a first duration tl. After that, a first gap 40 is displayed for a second duration t2. After that, a second barcode 31 is displayed for the first duration tl. A second gap 41 is displayed for the duration t2. A third barcode 32 is then displayed for a duration tl. Following this sequence, more gaps 42, 43 and more - barcodes 33, 34 are displayed successively. A gap always follows on a barcode. The barcodes always are displayed for the duration tl, while the gaps are

displayed for the duration t2. All barcodes 30-33 are displayed for the same duration tl. All gaps 40-43 are displayed for the same duration t2. The barcodes 30-34 each are different. This difference can be discerned by the barcode reader 3 of Fig. 1. With this setup, it is possible to measure the capability of the device under test 4 of Fig. 1 to correctly display the barcodes 30-34 and to determine, if any of the barcodes are not displayed correctly.

Though, it is not possible to determine, if the device under test 4 is capable of displaying each frame of each . barcode 30-34, and if frames during the gaps 40-43 are not displayed correctly or omitted altogether.

Therefore, in Fig. 3, a second time-sequence 50 of the video is shown. Barcodes 50-67 are displayed alternating with gaps 70-76. The barcodes 60-67 are displayed for the duration tl as the barcodes 30-34 were displayed according to Fig. 2. The time interval of the gaps 70-76 though is changed during the time-sequence 50. First, a rather short gap of a length t3 is used. The gaps 70-73 are displayed for the duration t3. After that, the duration of display of the gaps 73-74 is increased to t4, which is longer than t3. After that, the duration is even more increased, so that the gap 75 is displayed for a duration t5, which is longer than the duration t4 and the gap 76 is displayed for a duration of t6, which again is longer than the duration t5. With the setup, it is possible to discern, how long of a gap 70-76 is needed between the display of barcodes 60-67 in order to reach maximum video processing quality. Alternatively, the time-sequence can be started with a long gap display duration. Then the gap display duration is decreased during the time-sequence.

This setup though is not able to discern, how long a barcode has to be transmitted within the video for the device under test 4 to be able to correctly display it so that, the barcode reader 3 can correctly identify the barcode. In the time-sequence 80 of Fig. 4, this problem is solved by amending the duration of barcode display during the time-sequence 80. Barcodes 90-95 are displayed alternating with gaps 101-106. The gaps 101-106 are. all displayed for the duration of t7, which in this example is identical to the duration tl.

The barcodes 90-95 though are displayed with increasing durations t8-tl3. A first barcode 90 is displayed for a duration of t8, which is shorter than the duration t7, for which the gaps 101-106 are displayed. The second barcode 91 is displayed for a duration t9, which is larger than the duration t8, the third barcode 92 is displayed for a duration tlO, which is larger than the duration t9. The fourth barcode 93 is displayed for a duration til, which is larger than the duration tlO. The fifth barcode 94 is displayed for a duration tl2,. which is larger than the duration til. The sixth barcode 95 is displayed for a duration tl3, which is larger than the duration tl2. With the setup, it is therefore possible to discern, how long a barcode has to be present within the video for the device under test 4 to be able to correctly receive a display in the barcode, so that the barcode reader 3 can correctly identify the barcode 90-95. Alternatively, the duration of display of the barcodes can also be decreased starting from' a large duration instead of increase starting from a small duration.

Furthermore, in an alternative embodiment, it is possible to change the duration of the display of the barcodes and change the duration of the display of the gaps. Also in this embodiment it is possible to increase and/or lower the individual duration of display of gaps or barcodes. Furthermore, it is possible to repeat these sequences, depicted above in order to increase measuring accuracy.

Finally, a fourth time-sequence 110 is displayed in Fig. 5. In Fig. 5 no gaps are displayed between the barcodes

111-132. All of the barcodes 111-132 are displayed for an identical duration, which corresponds to a fixed or varying duration. In a special case, the duration of displaying the barcodes 111-132 is the duration of a single frame at the current frame-rate of the video. Therefore, each barcode is displayed for the length of exactly one frame. When using a time-sequence 110, with a different barcode at each frame of the video, it is necessary to use a barcode reader 3 of Fig. 1, which is able to read barcodes off the screen of the device under test 4 in such a high speed.. If this is the case, it is possible to identify if each single frame of the video is displayed . correctly, by detecting the correct barcodes 111-132 at the correct timing by the barcode reader 3 .

The barcodes detected by the barcode reader 3 and the respective timings are transmitted to the personal

computer 5 in the embodiment of Fig. 1 or alternatively to the control means 12, if no personal computer 5 is

present. The personal computer 5 or respectively the control means 12 are then set up for determining based upon the timing and the detected barcode, whether the barcode was detected correctly and therefore if the barcode was received and displayed correctly by the device under test A.. In Fig. 6, an embodiment of the inventive measuring method is shown. In a first step 200, a video comprising at least one barcode is created. Alternatively, the video can comprise more than one barcode. The barcodes can be separated by gaps. Moreover, the video can be created as a streaming video or as a video file. In a second step 201, the video is transmitted to the device under test.

Optionally, a sub-optimal transmission-channel can be used . In a third step 202, the video is received by the device under test and displayed by the device under test.

Naturally, the device under test can only display parts, of the video that have been correctly received. In a fourth step 203, the barcodes, which are present within the video and now displayed on the screen of the device under test, are read from the screen of the device under test. For example, a barcode reader 3 of Fig. 1 can be used for this. Alternatively, also a video camera or a high resolution still image camera can be used.

In a fifth step 204, based upon the identified barcodes and. the timing of identifying the barcodes, the video processing quality of the device under test is determined. For example, it is determined, if frames are skipped.

Moreover, it is determined, how many frames are so badly distorted, that the barcode cannot be detected correctly.

The invention is not limited to the examples shown above. Especially, the invention is not limited to a specific video format, transmission type, telecommunication

standard or device under test type. Any smartphone, network-capable camera, regular telephone, etc. can be analyzed regarding its video processing quality. The characteristics of the exemplary embodiments can be used in any advantageous combination.