CROSS-REFERENCE TO RELATED APPLICATION

[0001] The present non-provisional patent application claims the benefit of priority from U.S. Provisional Patent Application No. 62/043,099, filed August 28, 2014, and U.S Patent Application 14/830,1 15, filed August 19, 2015 the entire contents of both applications being incorporated herein by reference.

BACKGROUND

Field of the Disclosure

[0002] The present invention relates to the field of interactive smart dolls and to smartphones with applications and remote controllers that interact therewith.

Related Art

[0003] Children have been playing with dolls for a very long time. Interactive toys, remote controlled dolls and the like are well known. A toy or other plaything may stimulate a child's imagination and an interactive toy can enhance the child's experience. A doll that interacts with a child and can initiate interaction, and can be controlled through a smartphone or other remote control device would provide a more engaging experience for the child or user.

SUMMARY OF THE INVENTION

[0004] The present disclosure describes an interactive smart doll that can interact with a child or adult via a wireless device such as a smartphone or remote control device and that includes an on-board microprocessor controller that receives wireless commands that enable the doll to interact with the child and/or adult. The interactive doll may be shaped and have the appearance of a toy or stuffed animal that includes a control module with an integrated chip that can communicate via Bluetooth, including BLE (Bluetooth Low Energy), Wi-Fi or the like, and can interact with children or adults using speakers and sensors that are on board or that are communicatively linked so as to be attractive to children and adults.

[0005] The doll includes sensors and controls for determining its position/orientation and temperature and peripheral interactive devices such as audio transducers and servo/motor devices to enable interaction with the child/adult.

[0006] Disclosed are an interactive doll, a non-transitory computer or processor- readable medium that controls the doll, a system that may include the doll and a wireless remote control device, a method and means for performing the method that provide the features described herein. Such an interactive child's doll may include:

[0007] a body;

[0008] an electronic circuit housed in the body, the electronic circuit comprising: [0009] a microcontroller;

[0010] a motion/position/orientation determining module coupled to the

microcontroller;

[0011] a wireless receiving and transmitting module coupled to the microcontroller for providing data and instructions to the microcontroller received from a remote wireless device and for transmitting data and instructions to the remote wireless device;

[0012] a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located;

[0013] a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child; [0014] a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device; and

[0015] a power supply for providing power to the electronic circuit.

[0016] A wireless remote control device is also contemplated in combination with the interactive doll. Such a wireless remote control device may be a mobile device that includes a memory incorporating instructions for commanding the interactive doll.

[0017] Also contemplated is a system that includes the interactive doll and a mobile device that receives wirelessly instructions for commanding the interactive doll.

[0018] In such an interactive doll, the sensor module may include a temperature sensor for sensing the temperature of the doll's environment.

[0019] In such an interactive doll, the sound generating module may include one or more speakers positioned in or at the body of the doll.

[0020] Such an interactive doll may also include motor controls and servos for moving parts of the doll body.

BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The invention will be described in greater detail in the following detailed description with reference to the drawings, in which:

[0022] Fig. 1 shows an example of an on-board controller in the doll;

[0023] Fig. 2 shows an example of an operating environment;

[0024] Fig. 3 shows an example of an on-board microcontroller circuit;

[0025] Fig. 4 shows an example of a wireless component, specifically a Bluetooth controller; [0026] Fig. 5 shows an example of a memory card and connection, specifically an SD card:

[0027] Fig. 6 shows an example of a power supply circuit for the on-board controller;

[0028] Fig. 7 shows an example of a motion processing unit circuit;

[0029] Fig. 8 shows an example of a temperature sensing circuit; and

[0030] Fig. 9 shows an example of an audio circuit.

[0031] Other features and advantages of the present invention will become apparent from the following description of the invention that refers to the accompanying drawings.

DETAILED DESCRIPTION OF THE EMBODIMENTS

[0032] As illustrated in Figure 2, doll 21 can interact with a child if the child uses a wireless mobile device 23, which may be a smartphone, mobile or cordless phone or other handheld device, a tablet, a desktop, laptop computer or via other types of processor-based device or other types of electronic communication device or system. Instead or in addition, a user can use a dedicated wireless remote control device 24 (which may also be a universal remote control device). An application (App) for controlling interactive doll 21 may be downloaded by user to mobile device 23.

[0033] For example, the proximity of the child holding the mobile device 23 or remote control device 24 may be detected and when the mobile device 23 or remote controller 24 is. within range of Bluetooth communication of doll 21, or is within a pre-specified distance of interactive doll 21, the doll can greet the child. The greeting may specify the child's name, using previously provided programming identifying the user of mobile device 23 or remote controller 24, and can include a greeting suitable for the time of day, such as "good morning," "good evening" or the like or for the time of year, such as "Merry Christmas" or the like, since the application in mobile device 23 or

microcontroller inside interactive doll 21 can know the time of day and the dates on the calendar. A Bluetooth low energy module can be in mobile device 23 and in the doll to allow wireless sharing of information. A controller card inside interactive doll 21 can generate signals to produce sound waves provided ,to a speaker. One or more speakers can be provided inside interactive doll 21 , and/or one or more speakers can be used inside of mobile device 23. As an alternative, speakers in the vicinity around the house may also be controlled, or some combination of speakers as described in the foregoing may be controlled and provided with signals to generate the desired speech, music, alarm or other sounds..

[0034] When a certain time of the day is reached, interactive doll 21 can announce to the child that it is time to go to sleep. For example, the child can be told "Let's go to sleep" and this and similar messages can be repeated until a sensor detects that interactive doll 21 is in, or substantially in, a horizontal position. Similarly, interactive doll 21 can prod the child to get up with pleasant pre-recorded messages, music, chime, or the like, and such messages can be repeated until the sensor detects that doll 21 is in the vertical position or in a position close to the vertical position.

[0035] Mobile device 23 can also communicate with interactive doll 21 via wireless router 26 connected via modem 27 and the cloud to and on premises or off premises server 31. Also, mobile device 23 can communicate with doll 21 using a cellular telephone link via cell tower 35 connected via cell network internet gateway 36 to the cloud and to server 31.

[0036] Optionally, server 31 may store information about each user, and each interactive doll, such as last known position of doll, last known orientation of doll, user preferences for greetings, names of child and parents, parental controls for emergency alarms, user programming and settings for the doll, payment and subscription information for app downloads and for doll use, last time user communicated with doll, last time app was downloaded, and so forth.

[0037] As discussed, remote control 24 may communicate directly with interactive doll 21 via Bluetooth or other radiofrequencies or via an infrared link. A microcontroller may be included in doll 21 and may be connected to a speaker either on board doll 21 or wirelessly in the surrounding environment. Sound data can be processed from files written on SD cards positioned in interactive doll 21 or in mobile device 23. As a child or the person holding remote control 24 or holding mobile device 23 configured with the application approaches the doll, the doll can greet with "Good Morning" or some other greeting, and can customize the greeting to the child's name if the doll is programmed. For example, the BLE module in mobile device 23 and inside interactive doll 21 can allow passing of information about who is coming near interactive doll 21, and how far the person is from interactive doll 21.

[0038] At a certain time of the day, the doll can remind the child of a task to be performed, such as brushing teeth or going to sleep with an appropriate greeting, that may include the child's name. For example, a motion processing unit module 9DOF-IMU 34 available from InvenSense, Inc. that includes a 3 axis gyroscope, 3 axis accelerometer, 3 axis magnetometer and digital motion processor may be used. As shown in Fig. 1, the accelerometer can detect motion and directional orientation of the doll, and thus can know whether the doll is standing up or sitting down. Via the magnetometer, the doll can recognize spatial orientation, such as north, south, east or west, as well as latitude and longitude. A GPS device may also be included in interactive doll 21 or in mobile device 23 or in a device in communication with the foregoing. This may provide a tracking feature for interactive doll 21 and/or mobile device 23 and/or remote control 24 to enhance safety and to support other features.

[0039] Interactive doll 21 may include a temperature sensor. A temperature sensor may be included in interactive doll 21, or such information may be received by interactive doll 21 or by mobile device 23 with suitable application. When it is hot or cold, the doll may be able to announce a warning to the child, including the temperature information, and advice about putting on or taking off clothing. For example, a temperature sensor inside doll 21 or inside mobile device 23 may transmit using BLE such temperature information, and the doll can receive data by the current temperature and what text to say at the various temperatures. Alternatively, such information may be transmitted via WIFI 26 and modem 27 through cloud to server 31. Server 31 may store user preferences for various temperatures, e.g. prompt child to put on long sleeve shirt when temperature dips below 68 degrees Fahrenheit, and prompt child to put on sweater when temperature reaches below 60 degrees Fahrenheit, such settings being default or being set by parents in advance via mobile device 23.

[0040] Using mobile device 23, parents can send a text message if they want the child to be advised of something, such as "You did a great job today" or "Peter, you were awesome today." An application on mobile device 23 canJhave_an_areaJbr text to be transmitted. The text can be typed by the parent into mobile device 23 and sent as an audio file with for example extension ".wav." This file can be created by text-to-speech program, such as IVONA, and then can be sent via BLE (or any other radio-link) to the SD card in interactive doll 21. When the transmission is received, interactive doll 21 can retrieve the sound file. Alternatively, the text can be sent as text to interactive doll 21 for decoding into sound files by interactive doll 21. The latter may be a faster transmission but require more processing by microcontroller in interactive doll 21.

[0041] ' At certain times of the day, interactive doll 21 can generate reminders about activities or can announce a previously provided text. For example, on child's birthday, the, interactive doll 21 can say "Happy Birthday, Liliana!" or before bedtime can inquire of the child whether the child brushed her teeth. With a real-time clock module, interactive doll 21 may replace certain sounds stored as sound files in interactive doll 21. Actual time may be synchronized with mobile device 23. For example, messages can be programmed using mobile device 23, and sent as a sound file or in some other way to interactive doll 21, where they can be stored for later use. Many of the settings of interactive doll 21 can be programmed using the application provided on mobile device 23.

[0042] Instead of or in addition to mobile device 23, remote control 24, necklace or band worn on a body may include a BLE module or other microcontroller. For example, a child may wear as an accessory such a band to allow interactive doll 21 to recognize when the child is nearby, for example, within a previously set distance, or within range of Bluetooth. In such an arrangement, mobile device 23 used by the parents or other people in the household can be used to program interactive doll 21 , and to provide texts to be announced by interactive doll 21. In such a scenario, the child may not know where the text is coming from, i.e., the parents, family members, teachers, friends, etc.

Accordingly, birthday wishes, other information, prompts or directions can be sent by caregivers to interactive doll 21 for the child. A remote controller or band can have its own power source, such as a small battery.

[0043] Limbs, eyes, ears and mouth and the like of interactive doll 21 may also be controlled to move, extend, open, close and the like using servo-motor controls. Such motions can simulate or augment emotional responses as appropriate for various things interactive doll 21 is heard to "say" or as dictated by other circumstances, such as birthdays and the like.

[0044] By way of illustrative example, particular implementations will be described with respect to electronic devices inside interactive doll 21. However, it will be understood that many other implementations are also contemplated, and some of the features recited may be provided in mobile device 23 or in other devices with which mobile device 23 and/or interactive doll 21 is in communication.

[0045] Fig. 1 shows a microcontroller that may be provided inside interactive doll 21. Fig. 3 illustrates an example of a microcontroller, which may be an STM32F405XX or STM32F407XX type controller with an ARM 32 bit cortex, a memory, an LCD parallel interface, a clock, 140 ports, fifty or more communication interfaces and other components, available from ST Microelectronics.

[0046] Fig. 4 illustrates a Bluetooth low-energy (BLE) circuit, which, for example, may be a BLE 1 12 product available from Bluegiga, and may use Bluetooth version 4.0 or other versions. Ultra low current consumption may be implemented to prolong battery life, and a programmable 8051 processor may be used.

[0047] Fig. 5 illustrates a Micro SD card interface. [0048] Fig. 6 illustrates an example of a power supply circuit for the on board circuit. The power supply is illustratively four AA cells. An on-off switch SW2A is provided. The on-off switch controls the channels of two FETs T3 and T6. When on, FET T6 provides battery power to line VBAT. Two regulators are illustratively shown, one (U4) providing 3.3V DC and one (U4) providing 5V for the various on board circuits. A control line + 5 V ON is provided to turn on the +5V regulator via transistors T7 and T8. Transistor T5 and zener diode Dl provide over voltage protection. Illustratively, if VBAT exceeds 6.8V, transistor T6 is turned off via transistor T5. The regulators U2 and U4 may be type API 1 1 7 E50/AP1 1 17 E33, 5 V and 3.3V respectively.

[0049] Fig. 7 illustrates a motion sensor, which may be an MPU-9150-type product, available from InvenSense, Inc., which can include a gyroscope, an accelerometer, a magnetometer, motion processing, a clock and additional features.

[0050] Fig. 8 illustrates an example of a temperature sensor employing two digital thermometers that may be used. The digital thermometer may be type DS 18B20 available from Maxim Integrated. One or more temperature sensors may be used, for example, at' different parts of the body of interactive doll 21 for more accurate readings. For example, one side of interactive doll 21 may be exposed to direct sunlight and thus give an inaccurate reading. Such readings can be discounted or ignored.

[0051] Fig. 9 illustrates an audio circuit using a type TPA301 D audio amplifier IC available from Texas Instruments. It will be understood that other combinations and other implementations are also contemplated.

[0052] Disclosed is a device, a non-transitory computer or processor readable medium that stores instructions that provide the functionality described, a system and method that provide such functionality, and means for implementing such functionality. The present methods for controlling the interactive doll and its functions may be implemented using hardware, software, firmware or a combination of the foregoing, and may be implemented by one or more microcontroller and chips. The functions for the interactive doll eould be performed entirely automatically through automated operations, but need not be entirely performed by machines.

[0053] A computing device or chip as described herein for the interactive doll, the mobile device, and/or the remote control may include one or more processors located in one _; or more units for performing the system according to the present disclosure. One or more of these processors may be located away from the interactive doll and the mobile device, or may be off premises and communicate with the interactive doll and /or the mobile device via a radio or other wireless connection. Similarly, information stored, such as greeting information, name of the child, and the like, may be stored in a cloud or may be stored locally or remotely.

[0054] The application downloaded to the mobile device for controlling or for interacting with the interactive doll may include a GUI (Graphical User Interface), or may include graphics, text and other types of information. The interactive doll may also receive software and software updates for adding or improving functions, for example, from the mobile device or from a wireless router or the like. The mobile device and the interactive doll may include a memory, preferably a random access memory, and may include a secondary memory, and may be implemented using any appropriate storage medium. Examples of a memory or a computer-readable storage medium product include a removable memory chip, such as an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), removable storage unit or the like.

[0055] The communication interface may include a wired or wireless interface communieating over TCP/IP paradigm or other types of protocols, and may communicate via a wire, cable, fiber optics, a telephone line, a cellular link, an infrared link, a radio frequency link, such as WI-FI or Bluetooth, a LAN, a WAN, VPNy-the world wide web or other such communication channels and networks, or via a combination of the foregoing.

[0056] While the preferred embodiments of the invention have been illustrated and described, modifications and adaptations, and other combinations or arrangements of the structures and steps described come within the spirit and scope of the application and the claim scope.