Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SMART WATCH -BASED CONTROL OF USER INTERFACE (UI) OF OTHER DEVICE(S)
Document Type and Number:
WIPO Patent Application WO/2022/226429
Kind Code:
A1
Abstract:
Novel tools and techniques are provided for implementing wrist-wearable device (e.g., smart watch) -based control of UI of other device(s). In various embodiments, a computing system may analyze sensor data to detect motion of a wrist-wearable device with respect to at least one axis of rotation among three axes of rotation, the sensor data being received from one or more sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user. Based on a determination that the detected motion of the wrist-wearable device corresponds to a gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, the computing system may generate instructions based on the gesture-based command and may send the generated instructions to the user device, the instructions serving as input for controlling the UI of the user device.

Inventors:
LI XIANG (US)
Application Number:
PCT/US2022/027395
Publication Date:
October 27, 2022
Filing Date:
May 03, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
INNOPEAK TECH INC (US)
International Classes:
G06F3/01; A63F13/20; A63F13/21; A63F13/211
Foreign References:
US20200241649A12020-07-30
US20200310539A12020-10-01
US20190033974A12019-01-31
US20180120948A12018-05-03
US20220011855A12022-01-13
Attorney, Agent or Firm:
BRATSCHUN, Thomas D. et al. (US)
Download PDF:
Claims:
WHAT IS CLAIMED IS:

1. A method, comprising: analyzing, using a computing system, first sensor data to detect motion of a wrist- wearable device with respect to at least one axis of rotation among three axes of rotation, the first sensor data being received from one or more first sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generating, using the computing system, first instructions based on the first gesture-based command and sending, using the computing system, the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

2. The method of claim 1, wherein the computing system comprises at least one of one or more processors on the wrist-wearable device, one or more processors on a mobile device that is communicatively coupled with the wrist-wearable device, a machine learning system, an artificial intelligence ("AI") system, a deep learning system, a neural network, a convolutional neural network ("CNN"), or a fully convolutional network ("FCN").

3. The method of claim 1 or 2, wherein the wrist-wearable device comprises one of a smart watch, a wristwatch-based wearable control device, a wristband-based wearable control device, or other wrist- wearable user device.

4. The method of any of claims 1-3, wherein the at least one first sensor comprises at least one of an inertial measurement unit ("IMU") sensor or a gyroscope-based sensor.

5. The method of any of claims 1-4, wherein the user device that is separate from the wrist-wearable device comprises at least one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR- enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR- enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen.

6. The method of any of claims 1-5, wherein moving of the user's wrist on which the wrist-wearable device is worn in an upward or a downward direction corresponds to motion with respect to a first axis of rotation ("X-axis"), wherein moving of the user's wrist on which the wrist- wearable device is worn in a rightward or a leftward direction corresponds to motion with respect to a second axis of rotation ("Z-axis"), wherein the first gesture-based command comprises at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis, wherein the first instructions comprise at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command.

7. The method of claim 6, wherein a longitudinal extension of the user's arm on which wrist the wrist- wearable device is worn defines an axis corresponding to a third axis of rotation ("Y-axis"), wherein the first gesture-based command further comprises pointing of the user's arm on which wrist the wrist-wearable device is worn toward a display screen displaying content from the user device, wherein the first instructions comprise navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

8. The method of any of claims 1-7, wherein motion of the user's wrist on which the wrist-wearable device is worn with respect to an axis that is defined by a longitudinal extension of the user's arm corresponds to motion with respect to a third axis of rotation ("Y- axis"), wherein the first gesture-based command comprises at least one of a thumbs-up gesture command, a thumbs-down gesture command, or a thumbs-flat gesture command, when fingers of the user are in a relaxed and unclenched state, based on motion with respect to the Y-axis, wherein the first instructions comprise one of a select command, a confirm command, a return command, or a cancel command.

9. The method of any of claims 1-8, further comprising: analyzing, using the computing system, second sensor data to identify a second gesture corresponding to movement of one or more fingers of the user, the second sensor data being received from one or more second sensors disposed on the wrist- wearable device when the wrist-wearable device is being worn by the user, the one or more second sensors being configured to detect gestures of the one or more fingers of the user without any fingers of the user touching the wrist- wearable control device; and based on a determination that the second gesture corresponds to a second gesture- based command for controlling the UI of the user device that is separate from the wrist-wearable device, generating, using the computing system, second instructions based on the second gesture-based command and sending, using the computing system, the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device.

10. The method of claim 9, wherein the one or more second sensors each comprises at least one biosensor, the at least one biosensor comprising at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist-wearable device is being worn, wherein the soft tissue comprises at least one of one or more muscles, one or more tendons, or one or more blood vessels in or near the wrist of the user.

11. The method of claim 9, wherein the one or more PPG sensors are configured to optically detect blood volume changes in the one or more blood vessels below skin tissue at or near the wrist of the user corresponding to movement of the one or more fingers of the user, wherein the one or more EMG sensors are configured to detect electrical activity of the one or more muscles at or near the wrist of the user corresponding to movement of the one or more fingers of the user, wherein the one or more sound transducers are configured to detect sounds within a body of the user corresponding to movement of the one or more fingers of the user, wherein the one or more motion transducers are configured to detect motion of the one or more muscles, the one or more tendons, and the one or more blood vessels corresponding to movement of the one or more fingers of the user.

12. The method of claim 9, wherein the second gesture-based command comprises at least one of a tap command, a double tap command, a pinch-based command, or a clench- based command, wherein the second instructions comprise at least one of a select command, a confirm command, a return command, or a cancel command.

13. A wrist- wearable device, comprising: one or more first sensors that are configured to detect motion of the wrist- wearable control device with respect to at least one axis of rotation among three axes of rotation; at least one processor; and a non-transitory computer readable medium communicatively coupled to the at least one processor, the non-transitory computer readable medium having stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the wrist-wearable device to: analyze first sensor data to detect motion of the wrist-wearable device with respect to the at least one axis of rotation among the three axes of rotation, the first sensor data being received from the one or more first sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generate first instructions based on the first gesture-based command and send the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

14. The wrist- wearable device of claim 13, wherein the wrist- wearable device comprises one of a smart watch, a wristwatch-based wearable control device, a wristband- based wearable control device, or other wrist-wearable user device.

15. The wrist- wearable device of claim 13 or 14, wherein the at least one first sensor comprises at least one of an inertial measurement unit ("IMU") sensor or a gyroscope- based sensor.

16. The wrist-wearable device of any of claims 13-15, wherein the user device that is separate from the wrist- wearable device comprises at least one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR-enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR-enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen.

17. The wrist-wearable device of any of claims 13-16, wherein moving of the user's wrist on which the wrist-wearable device is worn in an upward or a downward direction corresponds to motion with respect to a first axis of rotation ("X-axis"), wherein moving of the user's wrist on which the wrist-wearable device is worn in a rightward or a leftward direction corresponds to motion with respect to a second axis of rotation ("Z-axis"), wherein the first gesture-based command comprises at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis, wherein the first instructions comprise at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command.

18. The wrist-wearable device of any of claims 13-17, further comprising one or more second sensors that are configured to detect gestures of one or more fingers of the user without any fingers of the user touching the wrist-wearable control device, wherein the set of instructions, when executed by the at least one processor, further causes the wrist-wearable device to: analyze second sensor data to identify a second gesture corresponding to movement of the one or more fingers of the user, the second sensor data being received from the one or more second sensors disposed on the wrist- wearable device when the wrist- wearable device is being worn by the user; and based on a determination that the second gesture corresponds to a second gesture- based command for controlling the UI of the user device that is separate from the wrist-wearable device, generate second instructions based on the second gesture- based command and send the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device.

19. The wrist- wearable device of claim 18, wherein the one or more second sensors each comprises at least one biosensor, the at least one biosensor comprising at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist-wearable device is being worn, wherein the soft tissue comprises at least one of one or more muscles, one or more tendons, or one or more blood vessels in or near the wrist of the user.

20. The wrist- wearable device of claim 18, wherein the second gesture-based command comprises at least one of a tap command, a double tap command, a pinch-based command, or a clench-based command, wherein the second instructions comprise at least one of a select command, a confirm command, a return command, or a cancel command.

Description:
SMART WATCH -BASED CONTROL OF USER INTERFACE (UI) OF OTHER DEVICE(S)

COPYRIGHT STATEMENT

[0001] A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

FIELD

[0002] The present disclosure relates, in general, to methods, systems, and apparatuses for implementing user interface ("UI") controls, and, more particularly, to methods, systems, and apparatuses for implementing wrist-wearable device (e.g., smart watch) -based control of UI of other device(s).

BACKGROUND

[0003] Hand gesture recognition on wrist-wom devices is becoming a popular type of perceptual computing UI that allows wrist- worn devices to capture and interpret human hand gestures as commands. There are two approaches for UI input of conventional devices. One is use of another physical controller. The other is use of hand tracking. For the first approach, there is a specific or dedicated controller that is required to control the conventional devices (e.g., a head-mounted device ("HMD") or smart TV, or the like). Such controllers could have a touch pad (like an Apple TV ® remote, or the like) or could be equipped with an inertial measurement unit ("IMU") module (like a virtual reality ("VR") controller, or the like), where the user can rotate the controller to move the cursor on the UI. There are also physical buttons for the user to press to trigger some specific control functions. For the second approach, there are one or more cameras mounted on the HMD or other devise, like fisheye cameras on HMD or HD cameras on smart TV, which can track the user's three-degrees-of-freedom ("3DOF") or six-degrees-of-freedom ("6DOF") pose, and recognize certain hand gestures as commands. [0004] However, the first approach requires a separate controller device, which increases the cost, and the user needs to physically touch the controller device, which means the user's hand needs to be close to the controller device to operate it. To use 3DOF tracking, the user needs to hold the controller device for the interaction. The second approach requires the hand to be in the view of the one or more cameras. Hand tracking not only requires the user to have the hand facing the camera, but also requires ideal light conditions. Although the visual solution does not require the user to hold any other devices, it does need to see the user's hand in the pictures or videos clearly. In such cases, typical visual challenges, like motion blur and visual occlusion, still exist in hand tracking.

[0005] Hence, there is a need for more robust and scalable solutions for implementing UI controls.

SUMMARY

[0006] The techniques of this disclosure generally relate to tools and techniques for implementing user interface ("UI") controls, and, more particularly, to methods, systems, and apparatuses for implementing wrist- wearable device (e.g., smart watch) -based control of UI of other device(s).

[0007] In an aspect, a method may comprise analyzing, using a computing system, first sensor data to detect motion of a wrist- wearable device with respect to at least one axis of rotation among three axes of rotation, the first sensor data being received from one or more first sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generating, using the computing system, first instructions based on the first gesture -based command and sending, using the computing system, the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

[0008] In another aspect, a wrist-wearable device may comprise one or more first sensors that are configured to detect motion of the wrist- wearable control device with respect to at least one axis of rotation among three axes of rotation; at least one processor; and a non- transitory computer readable medium communicatively coupled to the at least one processor. The non-transitory computer readable medium may have stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the wrist-wearable device to: analyze first sensor data to detect motion of the wrist-wearable device with respect to the at least one axis of rotation among the three axes of rotation, the first sensor data being received from the one or more first sensors disposed on the wrist- wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generate first instructions based on the first gesture- based command and send the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

[0009] Various modifications and additions can be made to the embodiments discussed without departing from the scope of the invention. For example, while the embodiments described above refer to particular features, the scope of this invention also includes embodiments having different combination of features and embodiments that do not include all of the above-described features.

[0010] The details of one or more aspects of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the techniques described in this disclosure will be apparent from the description and drawings, and from the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

[0011] A further understanding of the nature and advantages of particular embodiments may be realized by reference to the remaining portions of the specification and the drawings, in which like reference numerals are used to refer to similar components. In some instances, a sub-label is associated with a reference numeral to denote one of multiple similar components. When reference is made to a reference numeral without specification to an existing sub-label, it is intended to refer to all such multiple similar components.

[0012] Fig. 1 is a schematic diagram illustrating a system for implementing wrist- wearable device (e.g., smart watch) -based control of UI of other device(s), in accordance with various embodiments.

[0013] Figs. 2A-2X are schematic diagrams illustrating various non-limiting examples of a wrist-wearable control device for controlling a UI of other device(s), in accordance with various embodiments. [0014] Figs. 3A and 3B are schematic diagrams illustrating various non-limiting examples of the use of a wrist-wearable control device for controlling a UI of other user device(s), in accordance with various embodiments.

[0015] Fig. 4 is a flow diagram illustrating a method for implementing wrist-wearable device (e.g., smart watch) -based control of UI of other device(s), in accordance with various embodiments.

[0016] Fig. 5 is a block diagram illustrating an example of computer or system hardware architecture, in accordance with various embodiments.

DETAILED DESCRIPTION

[0017] Overview

[0018] Various embodiments provide tools and techniques for implementing user interface ("UI") controls, and, more particularly, to methods, systems, and apparatuses for implementing wrist- wearable device (e.g., smart watch) -based control of UI of other device(s).

[0019] In various embodiments, a computing system may analyze first sensor data to detect motion of a wrist- wearable device with respect to at least one axis of rotation among three axes of rotation, the first sensor data being received from one or more first sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user. Based on a determination that the detected motion of the wrist- wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, the computing system may generate first instructions based on the first gesture-based command and may send the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

[0020] In some embodiments, the computing system may comprise at least one of one or more processors on the wrist-wearable device, one or more processors on a mobile device that is communicatively coupled with the wrist-wearable device, a machine learning system, an artificial intelligence ("AI") system, a deep learning system, a neural network, a convolutional neural network ("CNN"), or a fully convolutional network ("FCN"), and/or the like. In some instances, the wrist-wearable device may comprise one of a smart watch, a wristwatch-based wearable control device, a wristband-based wearable control device, or other wrist-wearable user device, and/or the like. In some cases, the at least one first sensor may comprise at least one of an inertial measurement unit ("IMU") sensor or a gyroscope- based sensor, and/or the like. In some instances, the user device that is separate from the wrist-wearable device may comprise at least one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR- enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR- enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen, and/or the like.

[0021] According to some embodiments, moving of the user's wrist on which the wrist- wearable device is worn in an upward or a downward direction may correspond to motion with respect to a first axis of rotation ("X-axis"), wherein moving of the user's wrist on which the wrist-wearable device is worn in a rightward or a leftward direction may correspond to motion with respect to a second axis of rotation ("Z-axis"), wherein the first gesture-based command may comprise at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis, wherein the first instructions may comprise at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command, and/or the like. In some instances, a longitudinal extension of the user's arm on which wrist the wrist-wearable device is worn may define an axis corresponding to a third axis of rotation ("Y-axis"), wherein the first gesture-based command may further comprise pointing of the user's arm on which wrist the wrist- wearable device is worn toward a display screen displaying content from the user device, wherein the first instructions may comprise navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

[0022] In some embodiments, motion of the user's wrist on which the wrist-wearable device is worn with respect to an axis that is defined by a longitudinal extension of the user's arm may correspond to motion with respect to a third axis of rotation ("Y-axis"), wherein the first gesture-based command may comprise at least one of a thumbs-up gesture command, a thumbs-down gesture command, or a thumbs-flat gesture command, or the like, when fingers of the user are in a relaxed and unclenched state, based on motion with respect to the Y-axis, wherein the first instructions may comprise one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0023] According to some embodiments, the computing system may analyze second sensor data to identify a second gesture corresponding to movement of one or more fingers of the user, the second sensor data being received from one or more second sensors disposed on the wrist-wearable device when the wrist- wearable device is being worn by the user, the one or more second sensors being configured to detect gestures of the one or more fingers of the user without any fingers of the user touching the wrist-wearable control device. Based on a determination that the second gesture corresponds to a second gesture-based command for controlling the UI of the user device that is separate from the wrist-wearable device, the computing system may generate second instructions based on the second gesture-based command and may send the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device.

[0024] In some instances, the one or more second sensors may each comprise at least one biosensor, the at least one biosensor comprising at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, and/or the like, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist-wearable device is being worn, wherein the soft tissue may comprise at least one of one or more muscles, one or more tendons, or one or more blood vessels in or near the wrist of the user, and/or the like. In some cases, the one or more PPG sensors may be configured to optically detect blood volume changes in the one or more blood vessels below skin tissue at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more EMG sensors may be configured to detect electrical activity of the one or more muscles at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some cases, the one or more sound transducers may be configured to detect sounds within a body of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more motion transducers may be configured to detect motion of the one or more muscles, the one or more tendons, and the one or more blood vessels corresponding to movement of the one or more fingers of the user. In some cases, the second gesture-based command may comprise at least one of a tap command, a double tap command, a pinch- based command, or a clench-based command, wherein the second instructions comprise at least one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0025] In another aspect, a wrist-wearable device may comprise one or more first sensors that are configured to detect motion of the wrist- wearable control device with respect to at least one axis of rotation among three axes of rotation; at least one processor; and a non- transitory computer readable medium communicatively coupled to the at least one processor. The non-transitory computer readable medium may have stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the wrist-wearable device to: analyze first sensor data to detect motion of the wrist-wearable device with respect to the at least one axis of rotation among the three axes of rotation, the first sensor data being received from the one or more first sensors disposed on the wrist- wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generate first instructions based on the first gesture- based command and send the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

[0026] In some embodiments, the wrist-wearable device comprises one of a smart watch, a wristwatch-based wearable control device, a wristband-based wearable control device, or other wrist-wearable user device. In some cases, the at least one first sensor may comprise at least one of an inertial measurement unit ("IMU") sensor or a gyroscope -based sensor, and/or the like. In some instances, the user device that is separate from the wrist- wearable device may comprise at least one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR-enabled eyewear, a pair of AR- enabled eyewear, a pair of MR-enabled eyewear, a VR-enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen, and/or the like.

[0027] According to some embodiments, moving of the user's wrist on which the wrist- wearable device is worn in an upward or a downward direction may correspond to motion with respect to a first axis of rotation ("X-axis"), wherein moving of the user's wrist on which the wrist-wearable device is worn in a rightward or a leftward direction may correspond to motion with respect to a second axis of rotation ("Z-axis"), wherein the first gesture-based command may comprise at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis, wherein the first instructions may comprise at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command, and/or the like. In some instances, a longitudinal extension of the user's arm on which wrist the wrist-wearable device is worn may define an axis corresponding to a third axis of rotation ("Y-axis"), wherein the first gesture-based command may further comprise pointing of the user's arm on which wrist the wrist- wearable device is worn toward a display screen displaying content from the user device, wherein the first instructions may comprise navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

[0028] In some embodiments, the wrist-wearable device may further comprise one or more second sensors that are configured to detect gestures of one or more fingers of the user without any fingers of the user touching the wrist-wearable control device, wherein the set of instructions, when executed by the at least one processor, may further cause the wrist- wearable device to: analyze second sensor data to identify a second gesture corresponding to movement of the one or more fingers of the user, the second sensor data being received from the one or more second sensors disposed on the wrist-wearable device when the wrist- wearable device is being worn by the user; and based on a determination that the second gesture corresponds to a second gesture-based command for controlling the UI of the user device that is separate from the wrist-wearable device, generate second instructions based on the second gesture-based command and send the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device.

[0029] In some instances, the one or more second sensors may each comprise at least one biosensor, the at least one biosensor comprising at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, and/or the like, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist-wearable device is being worn, wherein the soft tissue may comprise at least one of one or more muscles, one or more tendons, or one or more blood vessels in or near the wrist of the user, and/or the like. In some cases, the second gesture-based command may comprise at least one of a tap command, a double tap command, a pinch-based command, or a clench-based command, wherein the second instructions comprise at least one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0030] In the various aspects described herein, a wrist- wearable control device is provided for controlling a UI of other device(s). This enables three-degrees-of-freedom ("3DOF") control of the UI of user device by using motion detection-based UI control (using the at least one first sensor(s) or IMU sensor(s)), in some cases, in combination with micro gesture-based UI control (using the one or more second sensors or biosensors), or the like. [0031] These and other aspects of the system and method for implementing wrist- wearable device (e.g., smart watch) -based control of UI of other device(s) are described in greater detail with respect to the figures.

[0032] The following detailed description illustrates a few embodiments in further detail to enable one of skill in the art to practice such embodiments. The described examples are provided for illustrative purposes and are not intended to limit the scope of the invention. [0033] In the following description, for the purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the described embodiments. It will be apparent to one skilled in the art, however, that other embodiments of the present invention may be practiced without some of these details. In other instances, some structures and devices are shown in block diagram form. Several embodiments are described herein, and while various features are ascribed to different embodiments, it should be appreciated that the features described with respect to one embodiment may be incorporated with other embodiments as well. By the same token, however, no single feature or features of any described embodiment should be considered essential to every embodiment of the invention, as other embodiments of the invention may omit such features.

[0034] Unless otherwise indicated, all numbers used herein to express quantities, dimensions, and so forth used should be understood as being modified in all instances by the term "about." In this application, the use of the singular includes the plural unless specifically stated otherwise, and use of the terms "and" and "or" means "and/or" unless otherwise indicated. Moreover, the use of the term "including," as well as other forms, such as "includes" and "included," should be considered non-exclusive. Also, terms such as "element" or "component" encompass both elements and components comprising one unit and elements and components that comprise more than one unit, unless specifically stated otherwise.

[0035] Various embodiments as described herein - while embodying (in some cases) software products, computer-performed methods, and/or computer systems - represent tangible, concrete improvements to existing technological areas, including, without limitation, wrist-wearable device technology, gesture control technology, gesture control technology for wrist-wearable devices, biosensor technology for gesture control, motion tracking technology for gesture control, user interface ("UI") control technology, UI control technology for wrist-wearable devices, 3DOF control technology of UI, and/or the like. In other aspects, some embodiments can improve the functioning of user equipment or systems themselves (e.g., wrist-wearable devices, gesture control systems, gesture control systems for wrist-wearable devices, biosensor systems for gesture control, motion tracking systems for gesture control, UI control systems, UI control systems for wrist-wearable devices, 3DOF control systems of UI, etc.), for example, by analyzing, using a computing system, first sensor data to detect motion of a wrist- wearable device with respect to at least one axis of rotation among three axes of rotation, the first sensor data being received from one or more first sensors disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user; and based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device, generating, using the computing system, first instructions based on the first gesture -based command and sending, using the computing system, the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device; and/or the like.

[0036] In particular, to the extent any abstract concepts are present in the various embodiments, those concepts can be implemented as described herein by devices, software, systems, and methods that involve novel functionality (e.g., steps or operations), such as, using 3DOF tracking of a wrist-wearable device (based on detected motion of the wrist- wearable device using IMU sensor(s) or the like) to generate and move a cursor or other objects (e.g., selection fields, highlighting fields, etc.) on a UI of another user device; using hand gesture tracking (and 3DOF tracking) to enable the user to interact with objects within the UI (e.g., using biosensors, cameras, etc., to recognize gesture-based commands, like pinch, clench, etc., that represent control commands); and/or the like, to name a few examples, that extend beyond mere conventional computer processing operations. These functionalities can produce tangible results outside of the implementing computer system, including, merely by way of example, an optimized wrist-wearable control device that allows for 3DOF UI control of another user device, by using motion detection (using IMU sensors), in some cases, in combination with micro-gestures of the fingers on the arm on which the wrist-wearable control device is worn that are detected and identified using biosensors to monitor, track, and identify gesture-based commands and to generate UI commands for controlling the UI of the other user device, at least some of which may be observed or measured by users, wrist-wearable device manufacturers, user device manufacturers, and/or universal remote controller manufacturers.

[0037] Some Embodiments

[0038] We now turn to the embodiments as illustrated by the drawings. Figs. 1-5 illustrate some of the features of the method, system, and apparatus for implementing user interface ("UI") controls, and, more particularly, to methods, systems, and apparatuses for implementing wrist- wearable device (e.g., smart watch) -based control of UI of other device(s), as referred to above. The methods, systems, and apparatuses illustrated by Figs. 1-5 refer to examples of different embodiments that include various components and steps, which can be considered alternatives or which can be used in conjunction with one another in the various embodiments. The description of the illustrated methods, systems, and apparatuses shown in Figs. 1-5 is provided for purposes of illustration and should not be considered to limit the scope of the different embodiments.

[0039] With reference to the figures, Fig. 1 is a schematic diagram illustrating a system 100 for implementing wrist-wearable device (e.g., smart watch) -based control of UI of other device(s), in accordance with various embodiments.

[0040] In the non-limiting embodiment of Fig. 1, system 100 may comprise a wrist- wearable device 105 that is configured to be worn on a wrist of a user 110. In some cases, the wrist-wearable device 105 may include, but is not limited to, one of a smart watch, a wrist-wearable display device, a wrist-wearable control device, or other wrist-wearable user device, and/or the like. According to some embodiments, the wrist- wearable control device may include, without limitation, one of a wristwatch-based wearable control device or a wristband-based wearable control device, and/or the like, each including one or more band portions that may be linked to adjacent band portions by connectors in a manner configured to removably wrap the wrist- wearable control device around a wrist of the user 110 (as shown, e.g., in Figs. 2A-2X, 3A, and 3B, or the like). Wrist-wearable device 105 may include, without limitation, computing system(s) 115, one or more second sensors 120, one or more first sensors 125, display screen 130 (optional), communications system 135, and one or more outward-facing lights 140a-140n (optional; collectively, "outward-facing lights 140" or "lights 140" or the like), and/or the like. According to some embodiments, outward-facing lights 140 may include, but are not limited to, at least one of a plurality of infrared ("IR") light emitting diodes ("LEDs") or a plurality of colored LEDs (e.g., LEDs emitting light in the visual spectrum that may each be single-color or changeable among multiple colors), and/or the like.

[0041] In some embodiments, computing system 115 may include, without limitation, at least one of one or more processors on the wrist-wearable device (e.g., processor(s) 115a, or the like), one or more processors on a mobile device that is communicatively coupled with the wrist-wearable device (e.g., processor (not shown) on mobile device 145 that is communicatively coupled with wrist- wearable device 105 via communications system 135 (as denoted in Fig. 1 by the lightning bolt symbol between mobile device 145 and communications system 135), or the like), a signal processing system (e.g., signal processing system 115b, or the like), an artificial intelligence ("AI") system (e.g., AI system 115c, or the like), or other computing system(s) 115d, and/or the like. In some cases, the AI system 115c and/or the other computing system(s) 115d may include, but is not limited to, a machine learning system, a deep learning system, a neural network, a convolutional neural network ("CNN"), or a fully convolutional network ("FCN"), and/or the like. In some instances, the mobile device 145 may include, without limitation, one of a smart phone, a tablet computer, a laptop computer, or a portable gaming device, and/or the like.

[0042] Merely by way of example, in some cases, display device 130 may include, but is not limited to, at least one of a touchscreen display device, a non-touchscreen display device, a projection-based display device, a holographic display device, and/or the like. In some instances, the communications system 135 may include wireless communications devices capable of communicating using protocols including, but not limited to, at least one of Bluetooth™ communications protocol, WiFi communications protocol, or other 802.11 suite of communications protocols, ZigBee communications protocol, Z-wave communications protocol, or other 802.15.4 suite of communications protocols, cellular communications protocol (e.g., 3G, 4G, 4G LTE, 5G, etc.), or other suitable communications protocols, and/or the like.

[0043] In some embodiments, system 100 may further comprise a user device 150, which may include, but is not limited to, at least one of one or more processors 150a, a transceiver 150b, one or more cameras 150c (optional), or a display device 150d, and/or the like. In some instances, the transceiver 150b and/or the one or more cameras 150c may each be either integrated within the user device 150, external yet communicatively coupled to user device 150, or partially integrated with and partially external yet communicatively coupled to user device 150, and/or the like. In some cases, the camera(s) 150c may have a field of view ("FOV") 155 that, when directed toward wrist-wearable device 105, may be used to monitor or track position and/or orientation of the wrist-wearable device 105 (in some cases, based at least in part on the outward facing lights 140 disposed on the wrist-wearable device 105, if any). In some instances, a UI 160 may be displayed or presented on display device 150d. In some cases, the wrist-wearable device 105 may communicatively couple with user device 150 via communications system 135 (as denoted in Fig. 1 by the lightning bolt symbol between transceiver 150b of user device 150 and communications system 135 of wrist- wearable device 105), or the like). In some instances, user device 150 may include, without limitation, a head-mounted device ("HMD") or other user device, and/or the like. In some cases, the HMD may include, but is not limited to, one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR-enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR- enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, and/or the like. In some instances, the other user device may include, without limitation, one of a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen, and/or the like.

[0044] According to some embodiments, the one or more second sensors 120 may each include at least one biosensor. In some instances, the at least one biosensor may include, without limitation, at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, and/or the like, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist-wearable device is being worn. In some cases, the soft tissue may include, but is not limited to, at least one of one or more muscles, one or more tendons, or one or more blood vessels, and/or the like, in or near the wrist of the user. In some cases, the one or more PPG sensors may be configured to optically detect blood volume changes in the one or more blood vessels below skin tissue at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more EMG sensors may be configured to detect electrical activity of the one or more muscles at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some cases, the one or more sound transducers (in some cases, including, but not limited to, a microphone, or the like) may be configured to detect sounds within a body of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more motion transducers (in some cases, including, but not limited to, a microphone, or the like) may be configured to detect motion of the one or more muscles, the one or more tendons, and the one or more blood vessels corresponding to movement of the one or more fingers of the user. [0045] Merely by way of example, in some cases, the one or more first sensors 125 may each include, but is not limited to, at least one of an inertial measurement unit ("IMU") sensor(s) or a gyroscope-based sensor(s), or similar sensor(s) and/or the like. In some instances, at least one first sensor 125 among the one or more first sensors 125 may be disposed within only one band portion or within each of the one or more band portions, without any second sensors 120 being disposed in any band portions. Alternatively, at least one second sensor 120 among the one or more second sensors 120 and at least one first sensor 125 among the one or more first sensors 125 may be disposed within each of the one or more band portions. Alternatively, the one or more second sensors 120 and the one or more first sensors 125 may each be disposed within only one band portion among the one or more band portions, wherein the band portion containing the one or more second sensors 120 may be one of the same band portion containing the one or more first sensors 125 or a separate band portion from the band portion containing the one or more first sensors 125. Alternatively, at least one second sensor 120 among the one or more second sensors 120 may be disposed within each of the one or more band portions while the one or more first sensors 125 may be disposed within only one band portion among the one or more band portions. [0046] In some instances, the outward-facing lights 140 may be disposed on the one or more band portions, and, in some cases, may be arranged in a predetermined pattern on the one or more band portions and may serve as tracking points for one or more cameras 150c of the user device 150 (as captured within the FOV 155) to track translation movement of the wrist-wearable device 105 along three axes relative to the user device 150. In some cases, the tracking of translation movement of the wrist-wearable device along the three axes may serve as additional input for controlling the UI 160 of the user device 150. [0047] In operation, computing system(s) 115, processor(s) 115a, signal processing system 115b, AI system 115c, other computing system(s) 115d, and/or mobile device 145, or the like (collectively, "computing system" or the like) may analyze first sensor data to detect motion of a wrist-wearable device (e.g., rotation and/or linear motion of wrist-wearable device 105, or the like) with respect to at least one axis of rotation among three axes of rotation, the first sensor data being received from one or more first sensors (e.g., first sensor(s) or IMU sensor(s) 125, or the like) disposed on the wrist-wearable device, when the wrist-wearable device is being worn by a user (e.g., user 110, or the like). Based on a determination that the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") (e.g., UI 160, or the like) of a user device (e.g., user device 150, or the like) that is separate from the wrist-wearable device, the computing system may generate first instructions based on the first gesture-based command and may send the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device.

[0048] According to some embodiments, moving of the user's wrist on which the wrist- wearable device is worn in an upward or a downward direction may correspond to motion with respect to a first axis of rotation ("X-axis") (e.g., rotation R x with respect to the X-axis (also referred to as pitch), as shown in Fig. 3, or the like). Moving of the user's wrist on which the wrist- wearable device is worn in a rightward or a leftward direction may correspond to motion with respect to a second axis of rotation ("Z-axis") (e.g., rotation R z with respect to the Z-axis (also referred to as yaw), as shown in Fig. 3, or the like). In such cases, the first gesture-based command may include, without limitation, at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis. In some instances, the first instructions may include, but are not limited to, at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command, and/or the like. In some instances, a longitudinal extension of the user's arm on which wrist the wrist-wearable device is worn may define an axis corresponding to a third axis of rotation ("Y-axis"). In such cases, the first gesture-based command may further include pointing of the user's arm on which wrist the wrist- wearable device is worn toward a display screen (e.g., display device 150d, or the like) displaying content from the user device (e.g., user device 150, or the like). In some instances, the first instructions may include, but are not limited to, navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

[0049] In some embodiments, motion of the user's wrist on which the wrist-wearable device is worn with respect to an axis that is defined by a longitudinal extension of the user's arm may correspond to motion with respect to the third axis of rotation ("Y-axis") (e.g., rotation R y with respect to the Y-axis (also referred to as roll), as shown in Fig. 3, or the like). In such cases, the first gesture-based command may include, without limitation, at least one of a thumbs-up gesture command, a thumbs-down gesture command, or a thumbs-flat gesture command, or the like, when fingers of the user are in a relaxed and unclenched state, based on motion with respect to the Y-axis. In some instances, the first instructions may include, but are not limited to, one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0050] Alternative, or additional, to the thumbs-up, a thumbs-down, and a thumbs-flat gesture commands, the first gesture-based command may be based on degree of supination or pronation of a forearm connected to a wrist of the user on which the wrist- wearable device is being worn, as detected by the first sensor(s) or IMU sensor(s) (e.g., first sensor(s) or IMU sensor(s) 125, or the like) that tracks motion of the wrist-wearable device. Herein, supination of the forearm may refer to rotation of the forearm such that the ventral side of the forearm (or palm) is facing forward and/or upward relative to a sitting or standing position of the body of the user when the user's arm is hanging by the users side or when the forearm is lifted from the arm hanging position (regardless of whether the fingers are spread in an open hand or are closed in a fist), while pronation of the forearm may refer to rotation of the forearm such that the ventral side of the forearm (or palm) is facing backward and/or downward relative to a sitting or standing position of the body of the user when the user's arm is hanging by the users side or when the forearm is lifted from the arm hanging position (regardless of whether the fingers are spread in an open hand or are closed in a fist), and a neutral position of the forearm may refer to rotation of the forearm such that the ventral side of the forearm (or palm) is facing toward the sagittal or median plane, which divides the body into the right and left parts along the midline of the body, and is partway or halfway between the supinated and pronated positions.

[0051] According to some embodiments, the computing system may analyze second sensor data to identify a second gesture corresponding to movement of one or more fingers of the user, the second sensor data being received from one or more second sensors disposed on the wrist-wearable device when the wrist- wearable device is being worn by the user, the one or more second sensors being configured to detect gestures of the one or more fingers of the user without any fingers of the user touching the wrist-wearable control device. Based on a determination that the second gesture corresponds to a second gesture-based command for controlling the UI of the user device that is separate from the wrist-wearable device, the computing system may generate second instructions based on the second gesture-based command and may send the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device.

[0052] In some cases, the second gesture-based command may include, without limitation, at least one of a tap command, a double tap command, a pinch-based command, or a clench-based command. In some instances, the second instructions may include, but are not limited to, at least one of a select command, a confirm command, a return command, or a cancel command, and/or the like. Alternatively, or additionally, the second gesture-based command may further include, without limitation, at least one of a swipe-based command, a drag -based command, or a point command, and/or the like. In some instances, the second instructions may further include, but are not limited to, at least one of a scroll command, a move command, or a highlight command, and/or the like.

[0053] According to some embodiments, for the swipe-based command gesture (or finger-swipe) command (not shown), the user may start from a relaxed pose of fingers (also referred to herein as "initial pose"; e.g., as shown in Figs. 3A and 3B, or the like), which may be defined by the hand of the user with the fingers (e.g., five fingers) naturally spread out and released or relaxed (i.e., without muscle tension to straighten the fingers nor to curl them (e.g., as in a fist, or the like), and the like). For a swipe-up command, a finger (such as, but not limited to, the index finger, or the like) may be lifted, e.g., at a moderate speed (herein moderate speed may refer to a speed that is greater than a slow, deliberate shift in positioning of the finger, or the like), from the initial or relaxed pose or from a lowered position (as described below), relative to the other fingers, which remain in the initial or relaxed pose. In some cases, finger lifting may be performed at a fast speed (e.g., as defined by visual blurring of the fingers due to speed of movement, or the like). For a swipe-down command, the finger may be lowered, e.g., at a moderate speed, from either the initial or relaxed pose or the lifted position (as described above), relative to the other fingers, which remain in the initial or relaxed pose. In some cases, finger lowering may be performed at a fast speed.

[0054] In some embodiments, from the initial pose, if the user lifts the index finger, the computing system may identify such micro-gesture as a swipe up command. Conversely, from the initial pose, if the user pulls down the index finger, the computing system may identify such micro-gesture as a swipe down command. Taking page navigation functionality as an example, the user could use an activation gesture, like a pinch command, to open the page. Herein, the pinch command or pinch-based gesture command may include the thumb and forefinger touching or pressing together with minimal or no movement in the other fingers of the hand (not shown). Then, the user can pull down the index finger to trigger the swipe down function to navigate down the page. If the user lifts the index finger above the initial pose, such gesture will trigger the swipe up function.

[0055] According to some embodiments, for the drag-based gesture (or finger-drag) command (not shown), the user may start from the initial or relaxed pose of fingers, similar to that for the swipe-based command gesture (or finger-swipe) command, as described above. For a drag-up command, a finger (such as, but not limited to, the index finger, or the like) may be lifted, e.g., at a slow speed (herein slow speed may refer to a speed that is slower than the moderate speed described above, or the like), from the initial or relaxed pose or from a lowered position (as described below), relative to the other fingers, which remain in the initial or relaxed pose. For a drag-down command, the finger may be lowered, e.g., at a slow speed, from either the initial or relaxed pose or the lifted position (as described above), relative to the other fingers, which remain in the initial or relaxed pose.

[0056] In the case that the UI (e.g., UI 160, or the like) provides only one-dimension along which a user may scroll or drag within the UI (regardless of whether or not the wrist- wearable device includes the first sensor(s) or IMU sensor(s) (e.g., first sensor(s) or IMU sensor(s) 125, or the like)), then the lifting and the lowering of the finger (as described above with respect to swipe-based commands and drag-based commands) may be identified as micro-gestures that result in the computing system (e.g., computing system(s) 115, or the like) causing the UI to perform one of scrolling or dragging along a first direction (in response to the finger lifting) or to scroll or drag along a second direction (in response to the finger lowering). For example, if the UI only provides vertical movement, then the first direction may result in the computing system causing the UI to perform one of a scroll-up function or a drag-up function, while the second direction may result in the computing system causing the UI to perform one of a scroll-down function or a drag-down function, or the like. Similarly, if the UI only provides horizontal movement, then the first direction may result in the computing system causing the UI to perform one of a scroll-left function or a drag-left function (if using the left hand; or a scroll-right function or a drag-right function if using the right hand), while the second direction may result in the computing system causing the UI to perform one of a scroll-right function or a drag-right function (if using the left hand; or a scroll-left function or a drag-left function if using the right hand), or the like.

[0057] In the case that the UI (e.g., UI 160, or the like) provides two-dimensions along which a user may scroll or drag within the UI, and in the case that the wrist-wearable device includes the first sensor(s) or IMU sensor(s) (e.g., first sensor(s) or IMU sensor(s) 125, or the like), then the lifting and the lowering of the finger (as described above with respect to swipe- based commands and drag-based commands) in conjunction with motion of the user's wrist (as detected by the first sensor(s) or IMU sensor(s) 125, or the like) may be identified as micro-gestures that result in the computing system (e.g., computing system(s) 115, or the like) causing the UI to perform one of scrolling or dragging along a direction based on the degree of supination or pronation of a forearm connected to a wrist of the user on which the wrist-wearable device is being worn, as detected by the first sensor(s) or IMU sensor(s) that tracks motion of the wrist-wearable device.

[0058] In a non-limiting example, if the forearm is pronated (or fully pronated), then the lifting and the lowering of the finger may be identified as micro-gestures that result in the computing system causing the UI to perform one of scrolling or dragging along the vertical direction (i.e., in the up or down direction, similar to the one dimensional vertical movement embodiment described above), regardless of whether the user's elbow is straight, bent with forearm beside the torso, or bent with forearm in front of the torso. Similarly, if the forearm is in the neutral position such that the ventral side of the forearm (or palm) is facing toward the sagittal or median plane, then the lifting and the lowering of the finger may be identified as micro-gestures that result in the computing system causing the UI to perform one of scrolling or dragging along the horizontal direction (i.e., in the left or right direction, similar to the one dimensional horizontal movement embodiment described above), regardless of whether the user's elbow is straight, bent with forearm beside the torso, or bent with forearm in front of the torso. If the forearm is between the supinated and pronated positions (but not at either the pronated or neutral positions), then the lifting and the lowering of the finger may be identified as micro-gestures that result in the computing system causing the UI to perform one of scrolling or dragging along a diagonal direction based on the degree of rotation between the supinated and pronated positions, regardless of whether the user's elbow is straight, bent with forearm beside the torso, or bent with forearm in front of the torso.

[0059] In some embodiments, a machine learning system (e.g., AI system 115c or other computing system(s) 115d, or the like) may be used to further enhance operation of the wrist- wearable device by learning and fine-tuning the detection of the micro-gestures, the motion- based gesture detection, the translation-based gesture detection, and/or instances of intended gesture control by the user compared with regular movement not intended to be gesture control movements, and/or the like, that adapt to use by the user over time, or the like.

[0060] These and other functions of the system 100 (and its components) are described in greater detail below with respect to Figs. 2-4.

[0061] Figs. 2A-2X (collectively, "Fig. 2") are schematic diagrams illustrating various non- limiting examples 200 and 200' of a wrist-wearable control device for controlling a UI of other device(s), in accordance with various embodiments. Figs. 2A-2L depict various non limiting examples 200 of a wristband-based wearable control device 205a-2051, respectively. Figs. 2M-2X depicts various non- limiting examples 200' of a wristwatch-based wearable control device 205m-205x.

[0062] In Fig. 2, the wristband-based wearable control devices 205a- 2051 or the wristwatch-based wearable control devices 205m-205x (both sets of devices collectively, "wrist- wearable control devices 205 " or the like) may each include, without limitation, a plurality of band portions 210 and a plurality of connectors 215. Each band portion 210 may include, but is not limited to, at least one of one or more second sensors or biosensors 220 (similar to the second sensor(s) or biosensor(s) 120 of Fig. 1, or the like), at least one first sensor(s) or IMU sensor(s) 225 (similar to the first sensor(s) or IMU sensor(s) 125 of Fig. 1, or the like), one or more outward facing lights 230 (similar to the one or more outward facing lights 140a-140n of Fig. 1, or the like), and/or the like, or may include a band portion without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230, or the like.

[0063] For instance, the wristband-based wearable control devices 205 a- 2051 may include, but are not limited to: (a) a wristband-based wearable control device 205a having a plurality of band portions 210a each including one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2A); (b) a wristband- based wearable control device 205b having a plurality of band portions 210b each including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2B); (c) a wristband-based wearable control device 205c having a plurality of band portions 210c each including one or more second sensors or biosensors 220, and a single band portion 210a including both one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2C); (d) a wristband-based wearable control device 205d having a plurality of band portions 210d each including one or more second sensors or biosensors 220 and one or more outward facing lights 230, and a single band portion 210b including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2D); (e) a wristband-based wearable control device 205e having a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230, and a single band portion 210a including both one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2E); (f) a wristband- based wearable control device 205f having a plurality of band portions 210f each including one or more outward facing lights 230, and a single band portion 210b including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2F); (g) a wristband-based wearable control device 205g having a single band portion 210g including at least one first sensor(s) or IMU sensor(s) 225, a (separate) single band portion 210c including one or more second sensors or biosensors 220, and a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230 (as shown in Fig. 2G); and (h) a wristband-based wearable control device 205h having a single band portion 210h including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230, a (separate) single band portion 210d including one or more second sensors or biosensors 220 and one or more outward facing lights 230, and a plurality of band portions 210f each including one or more outward facing lights 230 (as shown in Fig. 2H); (i) a wristband-based wearable control device 205i having a plurality of band portions 210g including at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 21); (j) a wristband-based wearable control device 205j having a plurality of band portions 21 Oh including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230 (as shown in Fig. 2J); (k) a wristband-based wearable control device 205k having a single band portion 210g including at least one first sensor(s) or IMU sensor(s) 225, and a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230 (as shown in Fig. 2K); (1) a wristband-based wearable control device 2051 having a single band portion 210h including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230, and a plurality of band portions 210f each including one or more outward facing lights 230 (as shown in Fig. 2L); and/or the like.

[0064] Each band portion 210 may be connected to an adjacent band portion(s) 210 via connector(s) 215 in a manner configured to removably wrap the wrist- wearable control device 205 around a wrist of a user (e.g., user 110, or the like) when the wrist- wearable control device 205 is worn by the user. In some instances, the connectors 215 may include elastic material-based connectors that allow the band portions to be pulled away from each other to slip over and onto (or over and off) the hand and wrist of the user. Alternatively, the connectors 215 may include a plurality of links and a clasp (e.g., made of metal, plastic, or other solid materials), or the like. Although not shown in Figs. 2A-2L, at least one band portion 210 may also include, without limitation, at least one of a computing system (similar to computing system 115 of Fig. 1, or the like) or a communications system (similar to communications system 135 of Fig. 1, or the like).

[0065] Similarly, the wristwatch-based wearable control devices 205m- 205x may include, but are not limited to: (m) a wristwatch-based wearable control device 205m having a watch portion 235, a plurality of band portions 210a each including one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2M); (n) a wristwatch-based wearable control device 205n having a watch portion 235, a plurality of band portions 210b each including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2N); (o) a wristwatch-based wearable control device 205o having a watch portion 235, a plurality of band portions 210c each including one or more second sensors or biosensors 220, and a single band portion 210a including both one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 20);

(p) a wristwatch-based wearable control device 205p having a watch portion 235, a plurality of band portions 210d each including one or more second sensors or biosensors 220 and one or more outward facing lights 230, and a single band portion 210b including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2P); (q) a wristwatch-based wearable control device 205q having a watch portion 235, a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230, and a single band portion 210a including both one or more second sensors or biosensors 220 and at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2Q); (r) a wristwatch-based wearable control device 205r having a watch portion 235, a plurality of band portions 210f each including one or more outward facing lights 230, and a single band portion 210b including one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Fig. 2R); (s) a wristwatch-based wearable control device 205 s having a watch portion 235, a single band portion 210g including at least one first sensor(s) or IMU sensor(s) 225, a (separate) single band portion 210c including one or more second sensors or biosensors 220, and a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230 (as shown in Fig. 2S); and (t) a wristwatch-based wearable control device 205t having a watch portion 235, a single band portion 210h including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230, a (separate) single band portion 210d including one or more second sensors or biosensors 220 and one or more outward facing lights 230, and a plurality of band portions 210f each including one or more outward facing lights 230 (as shown in Fig. 2T); (u) a wristwatch-based wearable control device 205u having a watch portion 235, and a plurality of band portions 210g including at least one first sensor(s) or IMU sensor(s) 225 (as shown in Fig. 2U); (v) a wristwatch-based wearable control device 205v having a watch portion 235, and a plurality of band portions 21 Oh including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230 (as shown in Fig. 2V); (W) a wristwatch-based wearable control device 205w having a watch portion 235, a single band portion 210g including at least one first sensor(s) or IMU sensor(s) 225, and a plurality of band portions 210e without any of the second sensor(s) or biosensor(s) 220, the first sensor(s) or IMU sensor(s) 225, or the outward facing lights 230 (as shown in Fig. 2W); (x) a wristwatch-based wearable control device 205x having a watch portion 235, a single band portion 210h including at least one first sensor(s) or IMU sensor(s) 225 and one or more outward facing lights 230, and a plurality of band portions 21 Of each including one or more outward facing lights 230 (as shown in Fig. 2X); and/or the like.

[0066] Each band portion 210 (as well as watch portion 235) may be connected to an adjacent band portion(s) 210 via connector(s) 215 in a manner configured to removably wrap the wrist- wearable control device 205 around a wrist of a user (e.g., user 110, or the like) when the wrist- wearable control device 205 is worn by the user. In some instances, the connectors 215 may include elastic material -based connectors that allow the band portions to be pulled away from each other to slip over and onto (or over and off) the hand and wrist of the user. Alternatively, the connectors 215 may include a plurality of links and a clasp (e.g., made of metal, plastic, or other solid materials), or the like. Although not shown in Figs. 2M-2X, at least one band portion 210 may also include, without limitation, at least one of a computing system (similar to computing system 115 of Fig. 1, or the like) or a communications system (similar to communications system 135 of Fig. 1, or the like). [0067] Although not shown in Figs. 2M-2X, watch portion 235 (aside from including watch components or smartwatch components) may include, but is not limited, at least one of a computing system (similar to computing system 115 of Fig. 1, or the like), a communications system (similar to communications system 135 of Fig. 1, or the like), one or more second sensors or biosensors 220, at least one first sensor(s) or IMU sensor(s) 225, or one or more outward facing lights 230, and/or the like.

[0068] These and other functions of the example(s) examples 200 and 200' (and their components) are described in greater detail herein with respect to Figs. 1, 3, and 4.

[0069] Figs. 3 A and 3B (collectively, "Fig. 3") are schematic diagrams illustrating various non-limiting examples 300 and 300' of the use of a wrist-wearable control device for controlling a UI of other user device(s), in accordance with various embodiments.

[0070] In Fig. 3, wrist- wearable device 205 (similar to wrist- wearable devices 105 and 205 of Figs. 1 and 2, or the like) is shown being worn on a wrist 305a of a user (similar to user 110 of Fig. 1, or the like). The wrist- wearable device 205 may each include, without limitation, a plurality of band portions 210 and a plurality of connectors 215. In the case that wrist-wearable device 205 comprises a wristwatch-based wearable control device (similar to wristwatch-based wearable control device 205m-205x of Figs. 2M-2X, or the like), the wrist- wearable device 205 may further include watch portion 235 (not shown in Fig. 3; similar to watch portion 235 of Figs. 2M-2X, or the like). Each band portion 210 (and, in some cases, each watch portion 235, as well) may include, but is not limited to, at least one first sensor(s) or IMU sensor(s) 225 (not shown in Fig. 3; similar to the first sensor(s) or IMU sensor(s) 125 and 225 of Figs. 1 and 2, or the like), or at least one of one or more second sensors or biosensors 220 (not shown in Fig. 3; similar to the second sensor(s) or biosensor(s) 120 and 220 of Figs. 1 and 2, or the like), and/or the like.

[0071] With reference to the non-limiting embodiment 300 of Fig. 3A, HMD 310a (similar to user device 150 of Fig. 1, or the like) may include, without limitation, at least one processor (not shown; similar to the one or more processors 150a of Fig. 1, or the like), at least one transceiver (not shown; similar to transceiver 150b of Fig. 1, or the like), one or more cameras (not shown; similar to the one or more cameras 150c of Fig. 1, or the like), display device 315a (similar to display device 150d of Fig. 1, or the like), and UI 320a (similar to UI 160 of Fig. 1, or the like), or the like. In some instances, HMD 310a may include, but is not limited to, one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR-enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR-enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, or a MR-enabled smartphone mounted in a headset, and/or the like.

[0072] Similarly, in the non-limiting embodiment 300' of Fig. 3B, user device 310b (similar to user device 150 of Fig. 1, or the like) may include, without limitation, at least one processor (not shown; similar to the one or more processors 150a of Fig. 1, or the like), at least one transceiver (not shown; similar to transceiver 150b of Fig. 1, or the like), display screen or device 315b (similar to display device 150d of Fig. 1, or the like), and UI 320b (similar to UI 160 of Fig. 1, or the like), or the like. In some instances, the user device 310b may include, without limitation, one of a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen, and/or the like. In some cases, the monitor or projector may also be communicatively coupled with one of a smart phone, a tablet computer, a laptop computer, a desktop computer, or a portable gaming device, and/or the like, that presents content for display on the monitor or projector.

[0073] In Figs. 3A and 3B, UI 320a or 320b (collectively, "UI 320" or the like), which is presented within display device 315a or 315b (collectively, "display device 315" or the like), may display or present content (in this case, a menu screen with a plurality of system icons 325 (in this case, icons of connected VR headset and mobile device, or the like) and/or a plurality of icons 330 associated with corresponding plurality of software applications ("apps"), or the like, although not limited to such). In some cases (although not shown), the content that may be displayed or presented may include icons, text, graphics, objects, thumb nails, or picture-in-picture ("PIP") -type mini-windows of media content including, but not limited to, video content, image content, representations of audio content (e.g., album cover art, artist photograph or poster, etc.), game content, presentation content, etc.).

[0074] According to some embodiments, the at least one first sensor(s) or IMU sensor(s) 225 (including, but not limited to, at least one of an inertial measurement unit ("IMU") sensor or a gyroscope-based sensor, and/or the like) may detect motion of the wrist- wearable device 205 with respect to at least one axis of rotation among three axes of rotation (e.g., rotation R x , R y , and/or R z , (also referred to as pitch, roll, and/or yaw, respectively) with respect to the X- axis, Y-axis, and/or Z-axis, respectively, as shown in Fig. 3, or the like). In some instances, the Y-axis may be parallel to at least one of a longitudinal extension of the user's arm or a main axis of the wrist-wearable device 205, and/or the like, while the X-axis may lay within a plane that is parallel to a plane defined by one of a dorsal side of the forearm or a ventral side of the forearm, and the Z-axis may be parallel to a line that is perpendicular to the plane defined by the one of the dorsal side of the forearm or the ventral side of the forearm. With reference to Figs. 1 and 3, supination or pronation may refer to rotation R y with respect to the Y-axis, with direction of rotation being dependent on which arm the wrist- wearable device is worn. In some instances, the wrist wearable device 205 may generate instructions based on the detect motion of the wrist- wearable device 205 with respect to at least one axis of rotation among three axes of rotation, the instructions including, but not limited to, at least one of a move cursor command or a navigate command, and/or the like.

[0075] In some embodiments, moving of the user's wrist on which the wrist-wearable device is worn in an upward or a downward direction may correspond to motion with respect to a first axis of rotation ("X-axis") (e.g., rotation R x with respect to the X-axis (also referred to as pitch), as shown in Fig. 3, or the like). Moving of the user's wrist on which the wrist- wearable device is worn in a rightward or a leftward direction may correspond to motion with respect to a second axis of rotation ("Z-axis") (e.g., rotation R z with respect to the Z-axis (also referred to as yaw), as shown in Fig. 3, or the like). In such cases, first gesture-based commands may include, without limitation, at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis. In some instances, first instructions, which may be generated based on the first gesture-based commands, may include, but are not limited to, at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command, and/or the like. In some instances, a longitudinal extension of the user's arm on which wrist the wrist-wearable device is worn may define an axis corresponding to a third axis of rotation ("Y-axis"). In such cases, the first gesture-based command may further include pointing of the user's arm on which wrist the wrist-wearable device is worn toward a display screen (e.g., display device 150d, or the like) displaying content from the user device (e.g., user device 150, or the like). In some instances, the first instructions may include, but are not limited to, navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

[0076] In some embodiments, motion of the user's wrist on which the wrist-wearable device is worn with respect to an axis that is defined by a longitudinal extension of the user's arm may correspond to motion with respect to the third axis of rotation ("Y-axis") (e.g., rotation R y with respect to the Y-axis (also referred to as roll), as shown in Fig. 3, or the like). In such cases, the first gesture-based command may include, without limitation, at least one of a thumbs-up gesture command, a thumbs-down gesture command, or a thumbs-flat gesture command, or the like, when fingers of the user are in a relaxed and unclenched state, based on motion with respect to the Y-axis. In some instances, the first instructions may include, but are not limited to, one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0077] Alternative, or additional, to the thumbs-up, a thumbs-down, and a thumbs-flat gesture commands, the first gesture-based command may be based on degree of supination or pronation of a forearm connected to a wrist of the user on which the wrist- wearable device is being worn, as detected by the first sensor(s) or IMU sensor(s) (e.g., first sensor(s) or IMU sensor(s) 125, or the like) that tracks motion of the wrist-wearable device.

[0078] In some embodiments, the one or more second sensors or biosensors 220 (including, but not limited to, at least one of PPG sensor(s), EMG sensor(s), sound transducer(s), or motion transducer(s), and/or the like) may detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist- wearable device is being worn, as described in detail above with respect to Fig. 1. In some cases, the one or more second sensors or biosensors 220 may be used to track, monitor, and/or identify gesture-based commands, including, without limitation, at least one of a swipe-based command (e.g., with finger 305c lifting away from or lowering toward thumb 305d, at moderate speed, with other fingers of hand 305b remaining in the initial or relaxed pose, as described above with respect to Fig. 1, or the like), a drag-based command (e.g., with finger 305c lifting away from or lowering toward thumb 305d, at slow speed, with other fingers of hand 305b remaining in the initial or relaxed pose, as described above with respect to Fig. 1, or the like), a tap command (e.g., with finger 305c lowering toward thumb 305d, at fast speed, or with finger 305c crooked or curved, with other fingers of hand 305b remaining in the initial or relaxed pose, or the like), a double tap command (e.g., similar to the tap command, but with a pair of such gestures in quick succession, or the like), a point command (e.g., with finger 305c straightening, with other fingers of hand 305b remaining in the initial or relaxed pose, or the like), a pinch-based command (e.g., with finger 305c moving toward and touching or pressing against thumb 305d, with other fingers of hand 305b remaining in the initial or relaxed pose, as described above with respect to Fig. 1, or the like), or a clench- based command (e.g., with finger 305c other fingers of hand 305b moving toward thumb 305d in a squeezing motion, without the fingers touching thumb 305d, or the like), and/or the like. In some instances, the wrist wearable device 205 may generate instructions based on the tracked, monitored, and/or identified gesture-based commands, the instructions including, but not limited to, at least one of a scroll command, a move command, a select command, a confirm command, a highlight command, a return command, or a cancel command, and/or the like.

[0079] The at least one first sensor(s) or IMU sensor(s) 225 (in some cases, in conjunction with the one or more second sensors or biosensors 220, or the like) enable highly accurate three-degrees-of-freedom ("3DOF") control of the UI 320 displayed within display device 315 of user device 310. In some embodiments, the wrist- wearable device 205 may cause the UI 315 of user device 310 to generate a cursor using the initial 3DOF pose (based, e.g., on position and orientation of the wrist-wearable device 205 as detected by the at least one first sensor(s) or IMU sensor(s) 225, or the like). In some instances, generating the cursor may comprise generating the cursor by projecting a laser ray into the UI 315. With 3DOF tracking, the user is enabled to move the cursor by rotating the wrist-wearable device 205 (e.g., as detected by the at least one first sensor(s) or IMU sensor(s) 225, or the like).

The wrist- wearable device 205 may also recognize hand and finger gestures using the one or more second sensors or biosensors to generate instructions (including, but not limited to, at least one of a scroll command, a move command, a select command, a confirm command, a highlight command, a return command, or a cancel command, and/or the like) based on detected gesture-based commands (including, but not limited to, at least one of a swipe-based command, a drag-based command, a tap command, a double tap command, a point command, a pinch-based command, or a clench-based command, and/or the like).

[0080] As shown in the non-limiting embodiments 300 and 300' of Figs. 3 A and 3B, respectively, for example, 3DOF control may be used to navigate within the UI 320. According to some embodiments, navigating and interacting within the UI 320 may include selecting or highlighting icons, text, graphics, objects, thumb-nails, or picture-in-picture ("PIP") -type mini-windows of media content, and/or the like (collectively, "UI objects 330" or the like) (as depicted, e.g., by bounding box 335 being superimposed over app icons in Fig. 3, or the like), moving the selection or highlighting field (e.g., bounding box 335, or the like) from one UI object to another, and/or the like, based at least in part on the 3DOF UI control. Alternatively, or additionally, with or without selection or highlighting fields, navigating and interacting within the UI 320 may include scrolling or paging through menus, pages, windows, and/or other UI display regions, or the like, as well as responding to prompts (with micro gesture-based acceptance or dismissal input commands, or with micro gesture- based "yes" or "no" input commands, or with micro gesture-based "OK" or "cancel" input commands, etc., in response to the prompts), or the like.

[0081] In some instances, the combination of the one or more second sensors or biosensors 220, the at least one first sensor(s) or IMU sensor(s) 225, and one or more outward facing lights 230 (as shown in Figs. 2B, 2D, 2F, 2H, 2J, 2L, 2N, 2P, 2R, 2T, 2V, and 2X, or the like) may enable highly accurate six-degrees-of-freedom ("6DOF") control of the UI 320 displayed within display device 315 of user device 310, by combining micro gesture-based UI control (using the one or more first sensors or biosensors 220), motion detection-based UI control (using the at least one second sensor(s) or IMU sensor(s) 225), and translation detection-based UI control (using the one or more outward facing lights 230 as tracking points for camera(s) 340 of the user device 310 to serve as addition UI control input). In some cases, there is some overlap between two or more of the micro gesture-based UI control, the motion detection-based UI control, and the translation detection-based UI control. For instance, as shown in the non-limiting embodiments 300 and 300' of Figs. 3A and 3B, respectively, 6DOF control may be used to navigate within the UI 320.

[0082] In some cases, multiple wrist- wearable devices 205 may be used (one on each arm of the user), to provide additional 3DOF or 6DOF control of the UI 320, and may be useful for immersive experiences (e.g., game play or AR/VR/MR experiences, or the like), in which one wrist-wearable device may be used for navigating within an environment displayed or presented in the UI 320, while the other wrist-wearable device may be used for navigating and interacting with UI objects or sub-UIs within said environment within the UI 320, or the like. In some instances, for wrist-wearable devices 205 that have touchscreen inputs or physical button inputs, at least one of a select command, a confirm command, a return command, or a cancel command, and/or the like, may be generated in response to user interactions with the touchscreen inputs or the physical button inputs, instead of or in additional to gesture-based commands (as described above).

[0083] In some embodiments, a machine learning system (e.g., AI system 115c or other computing system(s) 115d or Fig. 1, or the like) may be used to further enhance operation of the wrist- wearable device 205 by learning and fine-tuning the detection of the micro-gestures, the motion-based gesture detection, the translation-based gesture detection, and/or instances of intended gesture control by the user compared with regular movement not intended to be gesture control movements, and/or the like, that adapt to use by the user over time, or the like. [0084] These and other functions of the example(s) examples 300 and 300' (and their components) are described in greater detail herein with respect to Figs. 1, 2, and 4.

[0085] Fig. 4 is a flow diagram illustrating a method for implementing wrist-wearable device (e.g., smart watch) -based control of UI of other device(s), in accordance with various embodiments.

[0086] While the techniques and procedures are depicted and/or described in a certain order for purposes of illustration, it should be appreciated that certain procedures may be reordered and/or omitted within the scope of various embodiments. Moreover, while the method 400 illustrated by Fig. 4 can be implemented by or with (and, in some cases, are described below with respect to) the systems, examples, or embodiments 100, 200, 200', 300, and 300' of Figs. 1, 2A-2L, 2M-2X, 3 A, and 3B, respectively (or components thereof), such methods may also be implemented using any suitable hardware (or software) implementation. Similarly, while each of the systems, examples, or embodiments 100, 200, 200', 300, and 300' of Figs. 1, 2A-2L, 2M-2X, 3A, and 3B, respectively (or components thereof), can operate according to the method 400 illustrated by Fig. 4 (e.g., by executing instructions embodied on a computer readable medium), the systems, examples, or embodiments 100, 200, 200', 300, and 300' of Figs. 1, 2A-2L, 2M-2X, 3 A, and 3B can each also operate according to other modes of operation and/or perform other suitable procedures.

[0087] In the non-limiting embodiment of Fig. 4A, method 400, at block 405, may comprise receiving, using a computing system, first sensor data from one or more first sensors disposed on a wrist-wearable device when the wrist- wearable device is being worn by a user. The one or more second sensors may be configured to detect motion of the wrist- wearable control device with respect to at least one axis of rotation among three axes of rotation. At block 410, method 400 may comprise analyzing, using the computing system, the first sensor data to detect motion of the wrist- wearable control device with respect to the at least one axis of rotation among the three axes of rotation.

[0088] In some embodiments, the computing system may include, without limitation, at least one of one or more processors on the wrist- wearable control device, one or more processors on a mobile device that is communicatively coupled with the wrist-wearable control device, a machine learning system, an artificial intelligence ("AI") system, a deep learning system, a neural network, a convolutional neural network ("CNN"), or a fully convolutional network ("FCN"), and/or the like. In some instances, the wrist-wearable device may include, but is not limited to, one of a smart watch, a wristwatch-based wearable control device, a wristband-based wearable control device, or other wrist- wearable user device, and/or the like. In some cases, the at least one first sensor may include, without limitation, at least one of an inertial measurement unit ("IMU") sensor or a gyroscope-based sensor, and/or the like.

[0089] Method 400 may further comprise, at block 415, determining, using the computing system, whether the detected motion of the wrist-wearable device corresponds to a first gesture-based command for controlling a user interface ("UI") of a user device that is separate from the wrist-wearable device. If so, method 400 may further comprise generating, using the computing system, first instructions based on the first gesture-based command (block 420); and sending, using the computing system, the generated first instructions to the user device, the first instructions serving as input for controlling the UI of the user device (block 425).

[0090] In some instances, the user device that is separate from the wrist-wearable device may include, but is not limited to, at least one of a set of virtual reality ("VR") goggles, augmented reality ("AR") goggles, a set of mixed reality ("MR") goggles, a pair of VR- enabled eyewear, a pair of AR-enabled eyewear, a pair of MR-enabled eyewear, a VR- enabled smartphone mounted in a headset, an AR-enabled smartphone mounted in a headset, a MR-enabled smartphone mounted in a headset, a smart television ("TV"), a gaming console communicatively coupled to a display device, a monitor communicatively coupled to a display device, a projector communicatively coupled to a display device, a display device, a tablet computer, a laptop computer, a desktop computer, or a smart home appliance with a display screen, and/or the like.

[0091] According to some embodiments, moving of the user's wrist on which the wrist- wearable device is worn in an upward or a downward direction may correspond to motion with respect to a first axis of rotation ("X-axis"), while moving of the user's wrist on which the wrist-wearable device is worn in a rightward or a leftward direction may correspond to motion with respect to a second axis of rotation ("Z-axis"), and the first gesture-based command may include, without limitation, at least one of an up or down gesture command based on motion with respect to the X-axis or a right or left gesture command based on motion with respect to the Z-axis. In such cases, the first instructions may include, but are not limited to, at least one of a scroll command, a move command, a highlight command, a move cursor command, or a navigate command, and/or the like.

[0092] In some instances, a longitudinal extension of the user's arm on which wrist the wrist-wearable device is worn may define an axis corresponding to a third axis of rotation ("Y-axis"). In such cases, the first gesture-based command may further include pointing of the user's arm on which wrist the wrist-wearable device is worn toward a display screen displaying content from the user device, and the first instructions may include, but are not limited to, navigation of one of a cursor, a selection field, or a highlighting field on the UI as displayed on the display screen based on the at least one of the up or down gesture command that is based on motion with respect to the X-axis or the right or left gesture command that is based on motion with respect to the Z-axis, relative to a location on the display screen at which the user's arm is pointing.

[0093] In some embodiments, motion of the user's wrist on which the wrist-wearable device is worn with respect to an axis that is defined by a longitudinal extension of the user's arm may correspond to motion with respect to the third axis of rotation ("Y-axis"). In such cases, the first gesture-based command may include, without limitation, at least one of a thumbs-up gesture command, a thumbs-down gesture command, or a thumbs-flat gesture command, or the like, when fingers of the user are in a relaxed and unclenched state, based on motion with respect to the Y-axis, and the first instructions may include, but are not limited to, one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0094] According to some embodiments, method 400 may further comprise, at block 430, receiving, using the computing system, second sensor data from one or more second sensors disposed on the wrist-wearable control device when the wrist-wearable control device is being worn by the user. The one or more second sensors may be configured to detect gestures of one or more fingers of the user, when the wrist-wearable control device is being worn by the user, without any fingers of the user touching the wrist-wearable control device. At block 435, method 400 may comprise analyzing, using the computing system, the second sensor data to identify a second gesture corresponding to movement of the one or more fingers of the user.

[0095] In some embodiments, the one or more second sensors may each include at least one biosensor, the at least one biosensor may include, without limitation, at least one of one or more photoplethysmography ("PPG") sensors, one or more electromyography ("EMG") sensors, one or more sound transducers, or one or more motion transducers, and/or the like, each configured to detect biological characteristics that correspond to motion of soft tissue in or near a wrist of the user on which the wrist- wearable control device is being worn. In some cases, the soft tissue may include, but is not limited to, at least one of one or more muscles, one or more tendons, or one or more blood vessels, and/or the like, in or near the wrist of the user. In some cases, the one or more PPG sensors may be configured to optically detect blood volume changes in the one or more blood vessels below skin tissue at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more EMG sensors may be configured to detect electrical activity of the one or more muscles at or near the wrist of the user corresponding to movement of the one or more fingers of the user. In some cases, the one or more sound transducers may be configured to detect sounds within a body of the user corresponding to movement of the one or more fingers of the user. In some instances, the one or more motion transducers may be configured to detect motion of the one or more muscles, the one or more tendons, and the one or more blood vessels corresponding to movement of the one or more fingers of the user. [0096] Method 400, at block 440, may comprise determining whether the second gesture corresponds to a second gesture-based command for controlling the UI of the user device that is separate from the wrist-wearable device. If so, method 400 may further comprise generating, using the computing system, second instructions based on the second gesture- based command (block 445); and sending, using the computing system, the generated second instructions to the user device, the second instructions serving as additional input for controlling the UI of the user device (block 450).

[0097] In some cases, the second gesture-based command may comprise at least one of a tap command, a double tap command, a pinch-based command, or a clench-based command, wherein the second instructions comprise at least one of a select command, a confirm command, a return command, or a cancel command, and/or the like.

[0098] Examples of System and Hardware Implementation

[0099] Fig. 5 is a block diagram illustrating an example of computer or system hardware architecture, in accordance with various embodiments. Fig. 5 provides a schematic illustration of one embodiment of a computer system 500 of the service provider system hardware that can perform the methods provided by various other embodiments, as described herein, and/or can perform the functions of computer or hardware system (i.e., wrist-wearable devices 105, 205a-205x, and 205, computing system 115, display screen 130, and user devices 150, 310a, and 310b, etc.), as described above. It should be noted that Fig. 5 is meant only to provide a generalized illustration of various components, of which one or more (or none) of each may be utilized as appropriate. Fig. 5, therefore, broadly illustrates how individual system elements may be implemented in a relatively separated or relatively more integrated manner.

[0100] The computer or hardware system 500 - which might represent an embodiment of the computer or hardware system (i.e., wrist-wearable devices 105, 205a-205x, and 205, computing system 115, display screen 130, and user devices 150, 310a, and 310b, etc.), described above with respect to Figs. 1-4 - is shown comprising hardware elements that can be electrically coupled via a bus 505 (or may otherwise be in communication, as appropriate). The hardware elements may include one or more processors 510, including, without limitation, one or more general-purpose processors and/or one or more special-purpose processors (such as microprocessors, digital signal processing chips, graphics acceleration processors, and/or the like); one or more input devices 515, which can include, without limitation, a mouse, a keyboard, and/or the like; and one or more output devices 520, which can include, without limitation, a display device, a printer, and/or the like.

[0101] The computer or hardware system 500 may further include (and/or be in communication with) one or more storage devices 525, which can comprise, without limitation, local and/or network accessible storage, and/or can include, without limitation, a disk drive, a drive array, an optical storage device, solid-state storage device such as a random access memory ("RAM") and/or a read-only memory ("ROM"), which can be programmable, flash-updateable, and/or the like. Such storage devices may be configured to implement any appropriate data stores, including, without limitation, various file systems, database structures, and/or the like.

[0102] The computer or hardware system 500 might also include a communications subsystem 530, which can include, without limitation, a modem, a network card (wireless or wired), an infra-red communication device, a wireless communication device and/or chipset (such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMax device, a WWAN device, cellular communication facilities, etc.), and/or the like. The communications subsystem 530 may permit data to be exchanged with a network (such as the network described below, to name one example), with other computer or hardware systems, and/or with any other devices described herein. In many embodiments, the computer or hardware system 500 will further comprise a working memory 535, which can include a RAM or ROM device, as described above.

[0103] The computer or hardware system 500 also may comprise software elements, shown as being currently located within the working memory 535, including an operating system 540, device drivers, executable libraries, and/or other code, such as one or more application programs 545, which may comprise computer programs provided by various embodiments (including, without limitation, hypervisors, VMs, and the like), and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein. Merely by way of example, one or more procedures described with respect to the method(s) discussed above might be implemented as code and/or instructions executable by a computer (and/or a processor within a computer); in an aspect, then, such code and/or instructions can be used to configure and/or adapt a general purpose computer (or other device) to perform one or more operations in accordance with the described methods. [0104] A set of these instructions and/or code might be encoded and/or stored on a non- transitory computer readable storage medium, such as the storage device(s) 525 described above. In some cases, the storage medium might be incorporated within a computer system, such as the system 500. In other embodiments, the storage medium might be separate from a computer system (i.e., a removable medium, such as a compact disc, etc.), and/or provided in an installation package, such that the storage medium can be used to program, configure, and/or adapt a general purpose computer with the instructions/code stored thereon. These instructions might take the form of executable code, which is executable by the computer or hardware system 500 and/or might take the form of source and/or installable code, which, upon compilation and/or installation on the computer or hardware system 500 (e.g., using any of a variety of generally available compilers, installation programs, compression/decompression utilities, etc.) then takes the form of executable code.

[0105] It will be apparent to those skilled in the art that substantial variations may be made in accordance with particular requirements. For example, customized hardware (such as programmable logic controllers, field-programmable gate arrays, application-specific integrated circuits, and/or the like) might also be used, and/or particular elements might be implemented in hardware, software (including portable software, such as applets, etc.), or both. Further, connection to other computing devices such as network input/output devices may be employed.

[0106] As mentioned above, in one aspect, some embodiments may employ a computer or hardware system (such as the computer or hardware system 500) to perform methods in accordance with various embodiments of the invention. According to a set of embodiments, some or all of the procedures of such methods are performed by the computer or hardware system 500 in response to processor 510 executing one or more sequences of one or more instructions (which might be incorporated into the operating system 540 and/or other code, such as an application program 545) contained in the working memory 535. Such instructions may be read into the working memory 535 from another computer readable medium, such as one or more of the storage device(s) 525. Merely by way of example, execution of the sequences of instructions contained in the working memory 535 might cause the processor(s) 510 to perform one or more procedures of the methods described herein. [0107] The terms "machine readable medium" and "computer readable medium," as used herein, refer to any medium that participates in providing data that causes a machine to operate in some fashion. In an embodiment implemented using the computer or hardware system 500, various computer readable media might be involved in providing instructions/code to processor(s) 510 for execution and/or might be used to store and/or carry such instructions/code (e.g., as signals). In many implementations, a computer readable medium is a non-transitory, physical, and/or tangible storage medium. In some embodiments, a computer readable medium may take many forms, including, but not limited to, non-volatile media, volatile media, or the like. Non-volatile media includes, for example, optical and/or magnetic disks, such as the storage device(s) 525. Volatile media includes, without limitation, dynamic memory, such as the working memory 535. In some alternative embodiments, a computer readable medium may take the form of transmission media, which includes, without limitation, coaxial cables, copper wire, and fiber optics, including the wires that comprise the bus 505, as well as the various components of the communication subsystem 530 (and/or the media by which the communications subsystem 530 provides communication with other devices). In an alternative set of embodiments, transmission media can also take the form of waves (including without limitation radio, acoustic, and/or light waves, such as those generated during radio-wave and infra-red data communications). [0108] Common forms of physical and/or tangible computer readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read instructions and/or code.

[0109] Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to the processor(s) 510 for execution. Merely by way of example, the instructions may initially be carried on a magnetic disk and/or optical disc of a remote computer. A remote computer might load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and/or executed by the computer or hardware system 500. These signals, which might be in the form of electromagnetic signals, acoustic signals, optical signals, and/or the like, are all examples of carrier waves on which instructions can be encoded, in accordance with various embodiments of the invention.

[0110] The communications subsystem 530 (and/or components thereof) generally will receive the signals, and the bus 505 then might carry the signals (and/or the data, instructions, etc. carried by the signals) to the working memory 535, from which the processor(s) 505 retrieves and executes the instructions. The instructions received by the working memory 535 may optionally be stored on a storage device 525 either before or after execution by the processor(s) 510.

[0111] While particular features and aspects have been described with respect to some embodiments, one skilled in the art will recognize that numerous modifications are possible. For example, the methods and processes described herein may be implemented using hardware components, software components, and/or any combination thereof. Further, while various methods and processes described herein may be described with respect to particular structural and/or functional components for ease of description, methods provided by various embodiments are not limited to any particular structural and/or functional architecture but instead can be implemented on any suitable hardware, firmware and/or software configuration. Similarly, while particular functionality is ascribed to particular system components, unless the context dictates otherwise, this functionality need not be limited to such and can be distributed among various other system components in accordance with the several embodiments.

[0112] Moreover, while the procedures of the methods and processes described herein are described in a particular order for ease of description, unless the context dictates otherwise, various procedures may be reordered, added, and/or omitted in accordance with various embodiments. Moreover, the procedures described with respect to one method or process may be incorporated within other described methods or processes; likewise, system components described according to a particular structural architecture and/or with respect to one system may be organized in alternative structural architectures and/or incorporated within other described systems. Hence, while various embodiments are described with — or without — particular features for ease of description and to illustrate some aspects of those embodiments, the various components and/or features described herein with respect to a particular embodiment can be substituted, added and/or subtracted from among other described embodiments, unless the context dictates otherwise. Consequently, although several embodiments are described above, it will be appreciated that the invention is intended to cover all modifications and equivalents within the scope of the following claims.