Collaboration between a hologram and a robot

Field of invention

The present invention relates to activities and therapies intended for people with autism and similar conditions and problems. More precisely, collaboration between a hologram and a robot is a computer technology that facilitate and assists the participant with socialization and acquiring useful skills through individual general preparation, individual preparation in beginning phase in activities and therapies, and group preparation in beginning phase of activities and therapies.

Background of the invention

Autism is a social development disorder. Main most common characteristics of the condition are: reduced willingness for communication, difficulty in receiving and passing on information, limited, repeated and stereotyped behavior, interests and activities. According to the latest data, every 1 out of 160 children is diagnosed with disorder of the autistic spectrum (www.who.int).

Due to the specifics of the problem, the state of the prior art is limited. It is reduced only the use of robots, namely:

United stated application for a patent US 2013/0078600 Al - System and method of pervasive developmental disorder innervation

The NAO robot, using its application for autistic children. It has not been created especially for them (www.asknao.com)

Summary of the invention

The condition of people with special needs is not a sentence but a path to the best realization of their abilities. There is an absence of complete individual general preparation of the participant. There is an absence of complete individual preparation of the participant to begin a given activity or therapy. There is an absence visual explanation to form and build skills and self-confidence in the participant. There is not a connecting element between the separate activities and therapies that would make them merge into one another and complete one another, thereby the participant to feel safe and comfortable in every situation. There is an absence of all-day activity for the participant with included and rotated different activities and therapies. Until this moment, there is an absence of complete approach in solving the problem.

The collaboration between a hologram and a robot, created for people with autism and similar conditions and problems, used in different explanations, activities and therapies, is the only possible way for them to see themselves, to believe in themselves, in their capabilities and in achieving the desired results.

The collaboration between a hologram and a robot comprises of:

A hologram - independent and programmable. It represents a mirror image of the participant. This image provokes surprise, interest and desire to be touched by hand in the participant. The hologram gives him/her the opportunity to see himself/herself from aside. It is the missing link between the participant and his/hers actual abilities. The hologram image explains to him/her and then demonstrates how to perform each command. The participant sees that he/she is capable and performs the given activity with confidence, ease and self-confidence.

A robot - programmable, humanoid, sensitive and imitating a toy. It is considered as fun and it does not cause distress. Its actions are simple, attract attention and can be imitated.

Software programs for control and synchronization of hologram and robot and for control the collaboration between hologram and robot and participant.

Initially, the participant is introduced to the collaboration between a hologram and a robot alone without the presence of other people. It shows him/her something new and something unusual. Essence of the collaboration:

1. The purpose of the collaboration is:

• To attracts the attention of the participant.

• Unconsciously to put the participant into a group - configuration hologram, robot and participant.

• The participant to get physically acquainted with himself/herself and to accept himself/herself.

• To provoke a willingness for participation, for communication.

• To make the participant involved in the activity.

• Type of repeatability, a ritual, with witch every activity and preparation for therapy begins that helps the participant to thinks that he/she controls the surroundings that he/she does not understand and seems chaotic.

• To reduce or completely eliminate the reluctance to certain chance - new activity or/and new therapy which happens unconsciously for the participant because the transition from known to unknown is smooth and very slow, beforehand explaining, preparing for the new, showing separate parts from the new and discussing.

• To be requiring and not to make compromises when working with the participant.

When communicating with people, the participant consciously or unconsciously, through his/her reactions (screams, refusal), is inclined to manipulate parents, therapists and/or teachers. The participant communicates through the collaboration with himself/herself and with a toy. If for example, in a given explanation the participant begins to scream, the hologram begins to scream as well. It imitates him/her and provokes him/her to stop. It calms him/her down. Then, together with the robot, they return the participant in the same situation but explaining, displaying, implementing a feeling, speech or activity, first separately, then encouraging the participant and together with him/her.

• To cause positive emotions and feelings that be explained, shared and experienced by the hologram, the robot and the participant, • For a game, amusement, training

• The participant to overcome self-isolation

• To reassure and eliminate fear and phobias

2. Operation of the collaboration includes:

A. Technical preparation of the collaboration, namely:

• Diagnostics of the condition of the participant - physical, emotional, degree of development and skills. It is performed with the participation of a parent or parents, psychotherapist, a new personal assistant that will participate and is only for the given participant. It is recommended, if there are others who have worked with the participant - for example personal assistant, speech therapist, trainer from therapy, which the participant has attended, also to be invited. The aim is the picture to be as complete as possible, which will help the work of the collaboration.

• According to the diagnosis, individual programs for training are prepared with specific approach and strategy for each activity and therapy. It is performed with the participation of a patent or parents, psychotherapist and new personal assistant.

• Preparation of the hologram of the participant - his/her mirror image and peculiarity.

• The hologram and the robot are synchronized.

• Preparation of standard variants of situations and reactions of the collaboration, depending on the condition of the participant and non-standard variants for momentarily reactions of it.

B. General preparation of the participant

The participant enters the given hall alone and sees the robot who greats him/her. The robot starts a dialog with him, first introducing itself and then introducing the hologram that appears. It presents the hologram with the name of the participant. Than it turns to the participant and asks for his name. The hologram says or confirms his name. Than the hologram turns to the robot and explains that actually it is the participant and it is here to demonstrate that the participant can do everything. The hologram tries to make a dialog with the participant. It asks him/her if he likes it, pays attention to its appearance, meaning his/her. The appearance is explained in details and after each explanation consent, approval and conformation are sought by the participant. The robot joins the explanation as further explains, reacts emotionally, enthusiastically and says about its different appearance. The hologram and the robot are continually trying to make the participant react and say something. If he/she does not answer they begin to tease, laugh and even argue but in some way to provoke the participant to react.

This first meeting and the elementary conversations aim to allow the participant to accept the collaboration and more precisely him/her. He/she has to get used to his/her other self. The participant must relax and build emotional bond and trust with the hologram and robot, accept the game and participate in it.

Behind the wall, meaning the participant does not see them, psychotherapist must be present and preferable a parent. They monitor the collaboration and reactions of the participant and provide additional assistance if needed.

C. Preparation of the participant for beginning activities and therapies

The preparation includes presentation and introduction of the object of activity or therapy - what it is, what it serves, how it is used, what it does, its specific characteristics and properties. If the object is large or more difficult for understanding, it is divided into parts. Each part is explained separately than the whole object is put together and explained. It is introduced as something safe, something entertaining, that is to be liked by the participant and he/she want to make or use it in activities or attending therapies. The participant is encouraged to accept the object.

It begins with the hologram and the robot welcoming the participant followed by a dialog between the hologram and the robot, presented in questions, answers and explanations of the object. The consent of the participant is sought after each explanation. When the object is generally explained, dialogs in the configuration hologram, robot and participant are started. The aim is the object to be fully understood with the active cooperation of the participant.

The activity begins after the dialog. The hologram and the robot state what activity is started with the object. They perform it together. They explain how it is performed and how easy it is. They invite the participant to join them and to complete it with them. A performance of the activity several times is followed by turning it to a game that ends with enthusiasm from the complete activity and praise of the participant.

Details of the activities of the collaboration and the participant are shown in fig. l, fig. 2, fig. 3, fig. 4, fig. 5, fig. 6, fig. 7, fig. 8, fig. 9, fig. 10, fig. 11 and fig. 12.

The hologram and the robot further explain to the participant that the given activity or therapy is made in a group, that is, several participants like him to be together. It explains what a group is and why they work in a group. It explains how fun, cheerful, and interesting, and the participant must participate. A dialogue between the collaboration and the participant affirms the understanding of the meaning of a group and his/her readiness to see and participate in a group.

Another very important moment in the preparation of the participant is the acquaintance with his personal assistant. He is only responsible for him. It will be necessary for the next stage of action. The robot officially presents the personal assistant to the hologram and the participant. It bows, welcomes and says his name. The hologram welcomes him and, together with the robot, begins a dialogue with him, specifying his status and obligations. After the brief explanations given, a dialogue between the collaboration, the participant and the personal assistant follows in order to further clarify and accept it. The personal assistant personally goes to welcomes the participant. This is the first person to be accepted by the participant. A very important task that has been prepared and planned to the smallest detail. The ultimate goal of this preparation is the participant to accept the object, the personal assistant and to participate in the group. An extremely important stage, whose successful implementation guarantees the ultimate success.

The theoretical foundations of socialization are introduced and acquired.

D. Group activities and therapies for the participant- beginning phase

Once the participant is well acquainted with the object of work or therapy, with his / her personal assistant and with participation in a group, the participant becomes acquainted with the other participants. The personal assistant is very discreet at a distance and only watches without taking part. Its function is only in a critical situation to intervene and calm the participant.

The participants, their holograms and the robot are presented in the introduction. The robot is given the leading role. It starts with individual introduction of each participant and his hologram. It says the name of the participant, where he/she is from, how old he/she is and something nice about his/her appearance. Applause from all other holograms follows. The robot also invites the participant to greed the other participants. His hologram begins to greet first by showing what needs to be done and invites the participant along with her to greet others. This is the first introduction in society and provokes and retains a positive emotion in the participant. He/she is the center of attention, important, desired/welcomed and accepted by others. The other participants are introduces the same way. Robot explains, and the holograms agree that they all are already a group. Each hologram personally addresses to its participant and asks him/her whether he/she agrees to be in this group. After agreeing, there are applauses. Once a group is recognized, the robot teaches them that they have to have common greetings and movements that they all do together with the holograms.

Then there is an introduction of the instructor of the activity or the therapy. He is officially introduced by the robot - what his name is and what the participants will be engaged in. Applause from the holograms and perhaps from the participants follows. Each hologram introduces itself and asks its participant to do the same. The instructor greets each participant personally. After the introduction each hologram separately asks questions as introduces it again and asks further explanation of the activity. The instructor responds to each one separately. The robot explains what the activity will be and then asks everyone, including the holograms, to repeat it together.

The next stage is practical action in activity or therapy. The instructor explains to the participants and the robot and the holograms demonstrate together.

The activities of the participants are all day and include combination of several different therapies conducted for a certain period. The participants are divided into groups. These groups are from more than seven participants, each of whom has a personal assistant who intervenes only when necessary. Performing each of the therapies together, the participants concentrate not only on themselves but observe the rest of the group. In the group therapies the emphasis is on socialization. The sharing of common action leads to a sense of community, collectivism and awakens the interest on others.

An exception to this number of participants is made in hyperbaric oxygen therapy. Fig. 13, with capacity for participants - 32 people. Due to the specifics of this therapy, namely the length of staying one hour in closed space, to distract the participants is applied and used HD or 3D cinema. This combination between hyperbaric chamber and cinema gives the participants the opportunity to go through this therapy unnoticeably. The term "BARO CINEMA" is introduced. Only in this therapy the attendance of personal assistants or parents is mandatory and the use of robots and holograms is allowed for soothing and mood of the participants.

3. Advantages and results of the collaboration, namely:

• Beneficial influence of the special emotional relationship hologram-robot-participant on the participant. It is created and developed as unconditional and unburdened, and it is assumed that he/she communicates with another living being - him/herself; • Connecting l ink between different therapies and helps for easier acceptance as it starts with something already familiar.

• Factor of time to accept and something acquire new. Through the collaboration hologram-robot time is drastically shortened as the participant is already seeing himself/herself to execute a command or action.

• Achieving confidence by increasing the volume of speech abilities and actions.

• Acquiring self-esteem, based on encouragement and praise for skills to do more activities.

• Participation in new and unknown activities.

• Communication with new people in the activities and in the therapies.

• Socialization through participation in new activities with other participants and therapies in group with other participants.

• Stable result achieved through the accumulation of knowledge and knowledge sufficiently explained and demonstrated. Many spheres of behaviors and actions are covered, and a broader worldview is created.

4. Application of the collaboration in activities and therapies

Collaboration between a hologram and a robot is applied in different activities and therapies, as the most commonly used are:

4.1. Application of the collaboration in therapies with animals

The collaboration between a hologram and a robot aims acceptance of the given animal at the first stage. Overcoming fear is most important to accept the animals. The people with special needs see that the robot and the hologram communicate and have physical contact with the animals. This helps the participants to see the animals as an object that will not hurt nor harm them. There is an emerging interest and attraction. The collaboration between the robot and the hologram here develops a sense of sympathy, affection and takes notice of the contact with the animals by petting and receiving their sincerity and love. It creates a sense of responsibility through feeding and grooming. All this is done clearly through fun and game - FIG.1, FIG. 3 and FIG.

4.2. Application of the collaboration in art therapy and sand therapy

Painting is the key to the world of the participant and it says a lot about his emotional state. The theme of the painting, the size, the colors, the shapes and even power of the pressure of the brush or pencil are important. Drawing shows much more than hundreds words according to most of the experts. In the first stage through the collaboration between the hologram and the robot a desire and creativity impulse of the participant for drawing is provoked, creating opportunity to express the inner world, to realize its feelings and desires. It offers him a way of communication and expression without words - FIG 4.

4.3. Application of the collaboration in hyperbaric chamber

Due to the specific of this therapy, namely length of staying in closed space for one hour the collaboration between the hologram and the robot is applied jointly with HD or 3D cinema. Their use is intended to attract the attention, comfort and entertainment during the whole period of staying in the hyperbaric chamber - FIG. 13.

4.4. Application of the collaboration in water therapy and ergo therapy

Due to the specifics of these two therapies and the inability of the robot to illustrate the tasks, here the hologram alone performs the commands given by the robot. Through the collaboration between the hologram and the robot is achieved recreational activity and the attention of the participants is attracted. Subsequently the hologram uses additional tools (ball, surfing board, rope and others) to attract the participants to join it and to perform the given tasks together for the purpose of strengthen the physical body, improve mental condition, calm and fun - FIG.10 and FIG. 11.

4.5. Application of the collaboration in music therapy and therapy with drums The creation of music and rhythm is incredibly powerful remedy. The rhythm brings people back to the primary. A preparation for the rhythm therapy is performed through the collaboration between the hologram and the robot. Participants are introduced to a drum. In the form of entertainment and game they begin to beat the drum together with the hologram and the robot. Gradually the pace, membrane and dynamics are changed. A rhythm cocktail is made. The main purpose is preparation for the actual rhythm therapy and transformation of mental snapshot of the participants. Through the collaboration is achieved changing in emotional attitude, reducing stress, fatigue, aggression, depression and negative emotions and condition become positive - FIG. 2.

4.6. Application of the collaboration in laughter therapy

Each participant is unique. Psychologists produce individual collaboration between the hologram and the robot depending the condition of the person. It has extremely important role in the first stage of the training - preparation for laughter. Conditions, in which the participant relaxes and begins to laugh, are created. . Laughter is found and the enjoyment from it. At this stage the blockages that stop laughter are taken out. The laughter therapy is practiced at the second stage in a group, combined with exercises and relaxation exercises. Leading values in the life of the participant are affirmed - laughter, positivity and love - FIG. 6.

4.7. Application of the collaboration in floriculture, fruit-growing, gardening, herb-growing

In floriculture, fruit-growing, gardening, herb-growing, vegetable-growing promote physical activity that is beneficial for the health of the participants. With the collaboration between the hologram and the robot the participants are helped to learn more about the environment and the responsibility for it in the form of game. The collaboration teaches them to love the nature, flowers and plants and to identify food that is good for them. In the first stage of the therapy, it teaches the participants physical contact and acceptance of fruits, vegetables, small trees and garden accessories. It creates a sense of confidence and belief in their own abilities. The actual acts are carried out in the second stage in group therapies - FIG. 7 and FIG.9.

4.8. Application of the collaboration in bread making, cookery and confectionery

In the first stage of these therapies the collaboration between the hologram and the robot introduces the participants to cookery and confectionery. It explains where they are performed and what tools are used. It gives the participants an opportunity to hold, examine and exchange the tools. It shows them how to develop safely handling of the equipment in the form of game. The preparation for cookery and confectionery is started and the collaboration stimulates the use of elementary skills of counting and following a specific sequence. The actual acts are carried out in the second stage in group therapies - FIG. 8.

4.9. Application of the collaboration in therapy with pottery and ceramics

The use the collaboration between the hologram and the robot in the first stage of the therapy with pottery and ceramics aims to overcome the fear of new unknown skills through contact with clay. The creation of something completely unique with unpredicted appearance is seen. The participants are encouraged to participate because this therapy is important and includes senses - touch, sight, hearing, smell. It teaches patience because the result in not visible immediately, creativity - all have different understanding about proportion and shape and joy and satisfaction of receiving something real, that can be hold . It aims to build life skills and encourage self-expression without words FIG. 12.

5. Industrial application of the collaboration

The collaboration between hologram and robot is applicable in the fields of medicine, dentistry and healthcare. It is designed for young children and primary school children. In the general applications of collaboration, it is specific that the hologram is no longer an individual image of a participant, but a type image - for example, a favorite character of a movie, toy or subject. An exception may be made for people with special needs. A catalog of popular photos is prepared and the participant chooses who wants to see and play with.

5.1. Medicine

5.2. Dentistry

A. General application - preparation for medical examination and manipulations in medicine and in dentistry

The main purpose of collaborating in these areas is the participant to overcome the fear of the new, the unknown and the pain. The hologram and the robot greet the participant and get acquainted him. They start playing with each other gradually, paying attention to the situation - why the participant is there, the type of procedure that is forthcoming, how long does it last, what tools are used, who participates, what the participant will feel and compare it with something familiar. After the explanation, the hologram and the robot show what needs to be done. They invite the participant to repeat the action. The robot invites him to go inside and to play again what they learned.

B. Specific application - in the use of highly qualified medical equipment - in medicine and in dentistry

A hologram of the equipment is made to allow the hologram to show how it is used. The collaboration explains that the equipment is safe, what the procedure will be and what the participant should do. Then the robot enters with the participant in the hall and continues to explain and entertain him.

5.3. Education

Collaboration between a hologram and a robot used with in young children is designed to attract their attention, to predispose them and to teach them basic concepts and actions. In the form of a game, a dialogue takes place between the collaboration and all participants. The learning experience of this beloved character is memorable and pleasure. The teacher does not take part in this occupation and stands aside.

SHORT DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot and a horse and a hologram and a horse

FIG. 2 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot with a drum and a hologram with a drum

FIG. 3 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot and a dog and a hologram and a dog

FIG. 4 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot with a palette, brush and a painting tripod and a hologram with a palette, brush and painting tripod

FIG. 5 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot and cats and a hologram and cats

FIG. 6 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot and a mirror and a hologram and a mirror

FIG. 7 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot watering flowers and a hologram watering flowers

FIG. 8 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot cooking and a hologram cooking

FIG. 9 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot planting a tree and a hologram planting a tree

FIG. 10 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot showing how the hologram swims

FIG. 11 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot showing how the hologram exercises

FIG. 12 shows a person with a computer behind a wall, who cannot be seen, a participant who observes a robot making pottery and a hologram making pottery

FIG. 13 shows hyperbaric chamber, robot and participants with glasses BRIEF DESCRIPTION OF THE DRAWINGS

The essence and the advantages of the present invention may be realized by detailed reference to the drawings. All the attached drawings illustrate the first stage of the work with the participants when they are alone with the robot and the hologram with the exception of the last.

In FIG.l, FIG. 3 and FIG. 5 the collaboration between a robot and a hologram aims acceptance of the given animal at the first stage. The participants may have never seen life horse or may have never had a dog or a cat. Overcoming fear is most important to accept the animals. The people with special needs see that the robot and the hologram communicate and have physical contact with the animals. This helps the participants to see the animals as an object that will not hurt nor harm them. There is an emerging interest and attraction. The collaboration between the robot and the hologram here develops a sense of sympathy, affection and takes notice of the contact with the animals by petting and receiving their sincerity and love. It creates a sense of responsibility through feeding and grooming. All this is done clearly through fun and game.

FIG. 2 - rhythm therapy (therapy with drums). The creation of music and rhythm is incredibly powerful remedy. The rhythm brings people back to the primary. A preparation for the rhythm therapy is performed through the collaboration between the robot and the hologram. Participants are introduced to a drum. In the form of entertainment and game they begin to beat the drum together with the robot and the hologram. Gradually the pace, membrane and dynamics are changed. A rhythm cocktail is made. The main purpose is preparation for the actual rhythm therapy and transformation of mental snapshot of the participants. Through the collaboration is achieved changing in emotional attitude, reducing stress, fatigue, aggression, depression and negative emotions and condition become positive.

FIG. 4 - art therapy. Painting is the key to the world of the participant and it says a lot about his emotional state. The theme of the painting, the size, the colors, the shapes and even power of the pressure of the brush or pencil are important. Drawing shows much more than hundreds words according to most of the experts. In the first stage through the collaboration between the robot and the hologram a desire and creativity impulse of the participant for drawing is provoked, creating opportunity to express the inner world, to realize its feelings and desires. It offers him a way of communication and expression without words.

FIG. 6 - laughter therapy. Each participant is unique. Psychologists produce individual collaboration between the robot and the hologram depending the condition of the person. It has extremely important role in the first stage of the training - preparation for laughter. Conditions, in which the participant relaxes and begins to laugh, are created. . Laughter is found and the enjoyment from it. At this stage the blockages that stop laughter are taken out. The laughter therapy is practiced at the second stage in a group, combined with exercises and relaxation exercises. Leading values in the life of the participant are affirmed - laughter, positivity and love.

In FIG. 7 - floriculture, FIG. 9 - fruit-growing, gardening, herb-growing, vegetable-growing promote physical activity that is beneficial for the health of the participants. With the collaboration between the robot and the hologram the participants are helped to learn more about the environment and the responsibility for it in the form of game. The collaboration teaches them to love the nature, flowers and plants and to identify food that is good for them. In the first stage of the therapy, it teaches the participants physical contact and acceptance of fruits, vegetables, small trees and garden accessories. It creates a sense of confidence and belief in their own abilities. The actual acts are carried out in the second stage in group therapies.

FIG. 8 - cookery and confectionery. In the first stage of these therapies the collaboration between the robot and the hologram introduces the participants to cookery and confectionery. It explains where they are performed and what tools are used. It gives the participants an opportunity to hold, examine and exchange the tools. It shows them how to develop safely handling of the equipment in the form of game. The preparation for cookery and confectionery is started and the collaboration stimulates the use of elementary skills of counting and following a specific sequence. The actual acts are carried out in the second stage in group therapies.

FIG.10 and FIG. 11 - water therapy and ergotherapy. Due to the specifics of these two therapies and the inability of the robot to illustrate the tasks, here the hologram alone performs the commands given by the robot. Through the collaboration between the robot and the hologram is achieved recreational activity and the attention of the participants is attracted. Subsequently the hologram uses additional tools (ball, surfing board, rope and others) to attract the participants to join it and to perform the given tasks together for the purpose of strengthen the physical body, improve mental condition, calm and fun.

FIG. 12 - therapy with pottery and ceramics. The use the collaboration between the robot and the hologram in the first stage of the therapy with pottery and ceramics aims to overcome the fear of new unknown skills through contact with clay. The creation of something completely unique with unpredicted appearance is seen. The participants are encouraged to participate because this therapy is important and includes senses - touch, sight, hearing, smell. It teaches patience because the result in not visible immediately, creativity - all have different understanding about proportion and shape and joy and satisfaction of receiving something real, that can be hold . It aims to build life skills and encourage self-expression without words.

FIG. 13 - hyperbaric chamber. Due to the specific of this therapy, namely length of staying in closed space for one hour the collaboration between the robot and the hologram is applied jointly with HD or 3D cinema. Their use is intended to attract the attention, comfort and entertainment during the whole period of staying in the hyperbaric chamber.