Technical Field

The present invention relates to an adaptive test system which applies test scenarios -that are preferably used for testing a device in terms of functionality and performance and can be determined previously and/or instantly- to a device by means of a robotic arm, confirms device responses and reports test results.

Background of the Invention

It is required to subject devices and/or systems to be used on the market after production, to specific tests and control whether they fulfil functional requirements or not and even determine at which level they are in terms of performance. For these operations, there are test experts who usually apply and comment a test scenario that they determine by creating test scenarios. Test experts perform scenarios and evaluate results manually. However tests performed by test experts often take time and due to the fact that they consist of repeated operations, they increase possibility of making a mistake for experts.

In the prior art, mechanical test robots are also used except for test experts. The said test robots run stress and life tests of mechanical production such as door hinge. Robots used in the related tests are the ones which do not contain smart features but only have a mechanical infrastructure.

Automation systems specially designed for specific devices and/or systems are another test method used today. The said automation systems usually perform test operations for products with touch-sensitive feature such as mobile phone, tablet. However the said automation systems are used for specific products as well and they cannot be used for different products or systems.

The European patent document no. EP1710549, an application in the state of the art, discloses a method for testing motors. In the said invention, it is enabled to test brakes of a motor with a predefined torque and then to compare the position of the motor with its starting position. The test is run at a certain time and the results are stored for comparison.

Consequently, there is need for solutions whereby pre-determined test scenarios are automatically run for all types of devices and/or systems, amendments are made on test scenarios or test scenarios are created again and which continue running the same test even if the position of the device and/or the system to be tested changes today.

Summary of the Invention

An objective of the present invention is to realize a test system which applies test scenarios on a device by using robotic arm, image processing and sound processing, obtains results and reports results upon controlling for the purpose of deciding whether a device is sufficient or not functionally and in terms of performance after production.

Another objective of the present invention is to realize a control system which applies pre-determined test scenarios and/or instant test scenarios created over an interface by user and/or test scenarios that are currently available but whereon changes are made instantly.

A further objective of the present invention is to realize a control system which re detects a new position by using a reference included on a device based on position change of the device to be tested and runs the test scenario by updating it based on the new position.

A still further objective of the present invention is to realize a test system which enables to identify characteristics (physical structure, way of operation, etc.) of different devices to be tested in a short time and to create test scenarios by using these definitions, without being limited to a single device type.

Detailed Description of the Invention

“A Test System for Performing Test Scenarios” realized to fulfil the objectives of the present invention is shown in the figure attached, in which:

Figure 1 is a schematic view of the inventive test system for performing test scenarios.

The components illustrated in the figure are individually numbered, where the numbers refer to the following:

1. Test system

2. Test member

3. Response tracking member

4. Processing member

5. Interface

6. Processor

The inventive test system (1) comprises: at least one test member (2) which performs test operation on a device and/or system; at least one response tracking member (3) which captures the tests performed and/or the responses of the detected device and/or system with visual and/or audio content; at least one processing member (4) wherein the visual and/or audio content received by the response tracking member (3) are processed; at least one interface (5) wherein the test scenarios to be performed will be prepared and test scenarios will be applied, devices and/or systems to be tested are determined and/or elements to be tested for devices and/or systems and positions of elements to be tested are identified; and at least one processor (6) which is configured to present the interface (5) to the user; configured to comprise normal responses of elements to be tested for the selected test device and/or system and/or to provide these on external systems; configured to move the test member (2) in accordance with the test scenarios, to receive results of the device and/or system responses in accordance with the test member (2) movements and to control their accuracy.

In the inventive test system (1), the test member (2) is a robotic arm controlled by the processor (6). The test member (2) performs transactions to be carried out by a test expert -who is a human- particularly pressing, touching, rotating on a device and/or system to be tested based on test scenarios included on the processor (6).

In a preferred embodiment of the invention, the response tracking member (3) determines the first position of a tested device and/or system according to the arm (2) by means of a fiducial marker. Thereby, the processor (6) decides that there is change of position in the event that a change of position occurs according to the test member (2) of the device to be tested. In order that the response tracking member (3) can decide that the location of the device and/or system to be tested changed, the device and/or system must be within the working area of the response tracking member (3). In a preferred embodiment of the invention, the response tracking member (3) is a camera. The response tracking member (3) captures the responses received from a device and/or system visually as a result of movement of the test element (2) and transmits these to the processing member (4) to be interpreted upon being processed. In another preferred embodiment, the response tracking member (3) is a microphone which gathers voice data. The response tracking member (3) enables to perform voice processing by transmitting the responses received from a device and/or system as a result of the movement of the test element (2), to the processing member (4). The response tracking member (3) which is a camera and the response tracking member (3) which is a microphone are used together in the invention.

In a preferred embodiment of the invention, the processing member (4) processes the data, which are gathered by the response tracking member (3) and comprise the sound and/or image provided by a device and/or system as a result of the test steps of the test scenarios applied by the test member (2), and interprets these for the processor (6). Thereby, the processor (6) compares the interpreted responses prepared by the processing member (4) with responses that must be given by the device and/or system that it has and/or obtains from external environment and so enables to evaluate the device and/or system in terms of functionality and performance.

In the inventive test system (1), the interface (5) is presented by the processor (6). The user determines the test steps that s/he wants to be applied on the device and/or system to be tested, over the interface (5). Upon the test steps are determined on the interface (5), test scenarios to be applied on the device and/or system requested to be tested are created. The user performs at least one of transactions of entering test, creating test, generating test, selecting existing test steps, choosing among existing test scenarios on the interface (5). Thus, the user determines the test scenarios that s/he wants to be run on the device and/or system requested to be tested by using the interface (5). In a preferred embodiment of the invention, a device and/or system to be tested is determined on the interface (5). At least one of elements to be tested for devices and/or systems to be tested, positions of elements to be tested and responses that must be given by the elements after test can also be identified over the interface (5). Thereby, the user can identify the test scenarios to be run, the elements to be tested in the device and/or system to be tested and their positions manually in the event that s/he does not have the processor (6) information or cannot access the information by the device and/or system from external environments.

In the inventive test system (1), the processor (6) comprises the test steps and/or the test scenarios to be shared with the user preferably over the interface (5) and applied on the device and/or system to be tested. Thereby, the test scenarios comprising the test steps that is requested to be run in the device and/or system by the motion of the test member (2) are determined on the processor (6) by means of the interface (5). In a preferred embodiment of the invention, the processor (6) shares the test steps that it has and/or the test scenarios comprising the pre-created test steps with the user over the interface (5). The processor (6) stores the user selections made over the interface (5) and share these with external environment when required.

Test scenarios included on the processor (6) are in test scripting language for use of elements that may be button with single/double position, toggle switch, knob; evaluation of all types of feedback of the analysed content; detection of occurrence of texts showing up on a screen of a tested device and/or system or an expected visual; processing the key light status; and using the functions provided for sound analysis.

In a preferred embodiment of the invention, the processor (6) has information about devices and/or systems to be tested, elements to be tested, positions of elements on a device and/or system and responses to be given by the elements. Thereby, upon the device and/or system to be tested over the interface (5) and the test scenario to be run are determined; the processor (6) moves the test member (2) that is a robotic arm, the response tracking member (3) gathers image and sound data, and the processing member (4) starts processing the data. The processor (6) also uses the test member (2) motion as a base for determining positions of elements of a device and/or system to be tested. The element to be tested can be identified on the processor (6) by holding and directing the test member (2) by hand and/or moving it by using a controller.

In another preferred embodiment of the invention, the processor (6) is configured to access the data about elements to be tested, positions and responses to be given by communicating with the external environment based on the device and/or system information entered over the interface (5), and to use these in test step.

In the invention, the processor (6) moves the test member (2) based on a determined test scenario and compares the response data that it receives from the interface (5) with the correct response data that it has or with the correct response data that obtains over the external environment. Thereby, the processor (6) can control accuracy of the responses given by the tested device and/or system. In a preferred embodiment of the invention, responses to be given by elements owned by any device and/or system to be tested are recorded on the processor (6). Thereby, the processor (6) evaluate a device and/or system in terms of functionality and performance by comparing the response results that it receives from the processing member (4) with the correct response results that it has and must be and it also reports these to the user.

In the inventive test system (1), the processor (6) is configured to convert the test content that is entered by entering the test content in spoken (colloquial) language over the interface (5), into the test step to be run. Thereby, the processor (6) ensures that the test content entered by the user in spoken language is converted into test step and/or test scenarios and thus it can be applied with the test member

(2).

In the inventive test system (1), the processor (6) applies the test content that it has or that is determined over the interface (5) on the device and/or system by moving the test member (2) in accordance with the position information of the elements to be tested. The processor (6) controls whether there is a change in the first positon that it determined via the fiducial marker by using the response tracking member (3) during test operation. The processor (6) updates positions of elements to be tested in order that the test continues in case of detecting that there is a change in the first position. Thereby, the processor (6) can continue the test operation even if there is a change in position of a device and/or system to be tested. In order that the processor (6) can detect a position change, the test element must be within the view angle of the response tracking member (3).

The inventive test system (1) can perform functionality control and performance measurement due to the fact that the test member (2) -which is a robotic arm- moves based on the content of the test scenario and performs test operations on the device and/or system. The test member (2) moves based on the content that is determined in the test scenario and it applies all operations that can be performed by a test expert -who is a human- such as pressing, rotating to a test element that may be screen. The test steps applied by the test member (2) are captured by the response tracking member (3) with visual and/or audio content and they are interpreted by the processing member (4) so as to be analysed in the processor (6). Thereby, the processor (6) performs functionality control and performance measurement by comparing the data gathered in the test step with the correct test responses that it has and it optionally reports these for the user. Besides, a fiducial marker included on a device and/or system to be tested and the position information before test are recorded by using the response tracking member (3) in the processor (6). Thereby, in the event that a change occurs in location of a device and/or system to be tested, the processor updates the position information of the test content based on the new position information. In the inventive test system (1), the test content entered as spoken language over the interface (5) are converted into test steps and the test steps can be used in test scenarios. Thereby, a user who is not competent on writing any code or a language to be used for creating a test step can create test steps by means of normal, spoken language.

The inventive test system (1) is an easily adaptable and configurable test automation system. Thereby, devices and/or systems with features different from each other can be tested easily and quickly. Apart from this, the test system (1) can apply the same test for almost infinite times without doing the said mistakes that could be done by test experts who are human. Thereby, the quality level is enhanced in production process of production devices and/or systems. In the inventive system (1), human factor is eliminated in the step of interpretation of results as well except the test step. Thus, no human error occurs in comments too.

The inventive test system (1) reports existing test scenarios by seeing, hearing like a test engineer; interacting with test elements such as button, screen and verifying these. Thereby, functional and performance adequacy of a device and/or system is evaluated after production and the possibility of error occurring in test operations performed by test experts in prior art is eliminated.

Within these basic concepts; it is possible to develop various embodiments of the inventive test system for performing test scenarios (1); the invention cannot be limited to examples disclosed herein and it is essentially according to claims.