TECHNICAL FIELD

The invention relates to a smart car assistant with artificial intelligence designed for use in automobiles, VIP vehicles, commercial vehicles and smart home systems, which recognizes the user's face, detects the user's emotional state, offers suggestions according to the detected emotion, and has a three- dimensional holographic face to create an emotional bond between the user and the vehicle, has the ability to read news, give weather information, send e-mails, create notes and record alarms, and allows voice control of the equipment in the vehicle, can translate in different languages, can tell the vehicle malfunctions, can transmit range information, connects to the phone and allows you to use the features of the phone, makes it possible to perceive the commands given by speaking in a daily and natural speaking language, in Turkish or in the desired language, and to answer the questions asked.

PRIOR ART

People establish emotional bonds with other people or living creatures and thus continue their lives. It's nice to bond with someone, to feel that someone understands, cares, and protects you. However, these feelings only occur between humans and other living creatures.

Automobiles, VIP vehicles and similar vehicles purchased with large budgets do not have the quality to allow the user to create emotional bonds and cannot go beyond being a pile of metal. Emotional bonds cannot be established with the vehicles used today, communication cannot be ensured with natural speaking language, these vehicles do not recognize their owners, cannot detect and learn the behaviors and emotions of their owners, cannot answer the questions asked, and most importantly, these vehicles do not have a face. There are voice assistant systems in the vehicles produced by some vehicle manufacturers, and these systems can only perform a limited number of operations such as turning on and off and controlling equipment such as multimedia and air conditioning. In addition, these systems only work with the specified commands, and when something different is said other than these commands, these words are not perceived by the system.

Apart from the voice assistant systems mentioned above, there are also applications provided by some mobile devices and these applications only allow the use of features of the mobile device such as navigation and multimedia on the vehicle screen.

There is a need for an smart vehicle assistant that will provide establishing an emotional bond with the vehicle used, recognize and detect the face and emotions of the user, make suggestions, speak in a natural speaking language, in Turkish or in the desired language and answer questions.

Thus, the need to eliminate such shortcomings and disadvantages of the embodiments and practices employed in the prior art entails an improvement in the respective tehnical field.

AIM OF THE INVENTION

The present disclosure relates to a smart car assistant with artificial intelligence developed for eliminating the aforementioned disadvantages and providing new advantages to the respective technical field.

The aim of the invention is to provide an smart vehicle assistant with a face.

Another aim of the invention is to provide creating an smart vehicle assistant that recognizes the user's face, detects the emotional state and offers suggestions according to the detected emotion. Another aim of the invention is to provide an smart vehicle assistant that enables the user to create an emotional bond with his/her vehicle.

Another aim of the invention is to provide the creation of an smart vehicle assistant with features such as reading news, giving weather information, sending e-mails, creating notes and recording alarms.

Another aim of the invention is to provide a smart vehicle assistant, which allows voice control of the equipment in the vehicle by detecting what is said in daily and natural speaking language, in Turkish or in the desired language, and also has the ability to answer the questions asked.

Another aim of the invention is to provide the translation of what is spoken in the vehicle to the desired language, thanks to its ability to translate in different languages.

Another aim of the invention is to enable the user to be told audibly how far can be traveled with the remaining fuel or battery amount, as well as the malfunctions that may occur in the vehicle.

Another aim of the invention is to provide the use of the features of the phone by establishing a connection with the phone. Thus, the desired video will be played, navigation information will be transferred and other features on the phone will be used.

The structural and characteristic features of the present disclosure, including all of its advantages, will be more clearly understood when the detailed description given below is read, and thus, the present disclosure should be evaluated by taking this detailed description into consideration.

DETAILED DESCRIPTION OF THE INVENTION The preferred embodiments of the smart car assistant with artificial intelligence according to the present disclosure, which are mentioned in this detailed description, are only intended for providing a better understanding of the subject- matter, and should not be construed in any restrictive sense.

The invention relates to a smart car assistant with artificial intelligence designed for use in automobiles, VIP vehicles, commercial vehicles and smart home systems, which recognizes the user's face, detects the user's emotional state, offers suggestions according to the detected emotion, and has a three- dimensional holographic face to create an emotional bond between the user and the vehicle, has the ability to read news, give weather information, send e-mails, create notes and record alarms, and allows voice control of the equipment in the vehicle, makes it possible to perceive the commands given by speaking in a daily and natural speaking language and to answer the questions asked.

The system of the invention generally includes at least one camera to recognize the user's face and detect the happiness, sadness, anger and similar feelings of the user, at least one microphone to detect user-directed voice commands and questions, at least one electronic motherboard to run the artificial intelligence software, where all the visual and audio data received are processed and the necessary actions are created, at least one electronic card containing motor drivers to control the equipment inside the vehicle, at least one three-dimensional hologram display or a two-dimensional display inside the vehicle to give the assistant a three-dimensional face.

Electronic motherboard and electronic board containing motor drivers communicate via Ethernet connection and CANBUS protocol. The electronic card, which receives data from the electronic motherboard with the CANBUS protocol, uses this data and the CANBUS protocol to allow the operation of the seats, coffee machine, curtains, lights and similar equipment in the vehicle. Although the protocols used vary according to the vehicle, the vehicles usually have CANBUS protocol. The system of the invention can be arranged according to the existing protocol in the vehicle.

When the owner of the vehicle gets into the vehicle, the image is processed by the camera inside, and the face of the person is recognized by the system, and the emotional state of the person is also detected. According to the detected emotion, the system make suggestions to the person. For example, when the owner of the vehicle gets into the vehicle, the person is recognized and suggestions such as “Welcome... Sir/Madam, you look unhappy today, would you like me to make you coffee?” can be offered. In addition, daily news and weather information can be transmitted to the person by the system. The user uses “Hey Dizzy” or a similar wake-up word before speaking with the system. Thus, other conversations in the vehicle and assistant conversations do not interfere with each other. In addition, the commands given to the system by the user are carried out provided that the system sees the user's face. If the user's face is not visible to the camera, the system gives a warning as "I need to see you in order to fulfill your request."

The assistant system of the invention can answer the questions asked, with artificial intelligence. This is done with the “question and answer” model. When a question is asked, this question is searched by the software in the search engine and Wikipedia, the information in the form of a paragraph is simplified using the “levenshtein” model, then sent to the “Google BERT” model with new layers added, so that a logical answer is found within the paragraph, and the answer is read by the assistant, thereby the answer is given to the question. The BERT model used in the invention is being updated and it is planned to use the “GPT-3” or “Megatron” model as well.

The assistant of the invention has a three-dimensional holographic face image. Here, the desired face type can be selected, as well as the real three-dimensional face of a person known as the assistant's face or a character can be determined. By choosing the face of a loved one or the face of a deceased relative, the feeling of speaking with that person can be created. When the assistant speaks, his/her lips can move according to the word he/she speaks, thus making it feel like a real person is speaking. Instead of the three-dimensional hologram screen in the system of the invention, two-dimensional screens available in vehicles can also be used, and thus a more cost-effective structure can be obtained.