Wearable device system and method for detection of unintended movement

Field

The present invention relates to the field of firearm accessories during live fire training. In particular the invention relates to a wearable device system and method for detection of unintended movement while shooting a firearm or the like. Background

When firing guns, accuracy can be affected by what is termed as "flinch". A flinch is a subconscious reaction, or a reflex movement, to the firing of the gun, usually just before the gun is fired which causes movement in the gun and decreases the firer's accuracy. A flinch is normally so close in timing to the event of the gun firing that the occurrence of the flinch can be completely masked from the firer by the movement of the gun during the firing event. Thus a firer will often only be aware that a flinch has occurred after having paused firing to examine the target. Traditionally the only way to train for flinching was by the use of inert rounds, known as "snap caps" or "dummy rounds". An inert round would be placed in the guns magazine amongst live rounds in a place usually unknown to the firer, so that when the trigger was pulled with the inert round in the breach of the gun, the result of the round not going off allowed the firer to see if he had flinched. By bringing the action of this subconscious movement in to the conscious awareness of the firer, it improves his concentration on this aspect of firing of the gun.

There are many disadvantages with traditional methods, such as needing to stop firing to be check your target for a flinched shot or needing to stop firing to eject an inert round. Thus, it is not very suitable for firing practices which are time constrained. Recently more sophisticated electronic based training systems have been developed, as disclosed in US patent number US8,668,496. This US patent discloses a training system may have a handheld computing device configured to receive a data input from an input device. The input device may be a sensor capable of measuring a condition relating to the training. An analysis module in electronic communication with the handheld computing device is configured to interpret the data input from the input device and configured provide a feedback output related to the execution of the goals of the training system. Based on this feedback, a trainee or trainer may adjust the training program to enhance the trained skills. However this training system does not provide real time feedback and does not effectively address the problem of flinch or movement of a user before firing. Moreover the training device requires it to be mechanically coupled to the fire arm which changes the weight of the firearm which leads to an unrealistic training environment.

It is therefore an object to provide an improved system and method for detection of unintended movement for training of firearm use.

Summary

According to the invention there is provided, as set out in the appended claims, a wearable device for user firearm training comprising:

at least one sensor for detecting movement in the users hand or arm; a module for detecting a firing event;

a module for processing data from the at least one sensor such that movement by the user can be analysed; and

a module for producing feedback to the user based on said analysis wherein the feedback can be at least one of a audio or tactile feedback to the user in real-time to indicate a movement of the users hand or arm has occurred before the detected firing event.

Accordingly several advantages of one or more aspects of the invention are as follows:

Immediate feedback of having fired incorrectly is provided to the user or firer without having to stop to check the target or a display device such as a phone, PDA or computer.

When specifically training for flinch, such as with inert rounds, firers do not have to eject inert rounds from the chamber before continuing to practice.

When specifically training for flinch, as opposed to using inert rounds, feedback is provided on every round fired. When specifically training for flinch, as opposed to using inert rounds, firing practices are continuous and the firer is not required to halt the practice to remove the inert round from the chamber of the weapon.

There is no modification to the gun, which may affect the balance of the gun, or may not be allowed if the gun is the property of an employer, as is often the case with security forces, or if the gun is used for competition shooting.

There is no modification to the gun, allowing the firer to train for un-holstering a gun at the beginning of a shooting practice.

When firing in rapid succession during a firing practice with this device, the firer can distinguish if a round was fired incorrectly due to the aim being off at the time of firing or if it was due to a flinch. The device is completely separate from the gun of the firer, and allows the firer to use an unmodified gun, or guns, with unmodified ammunition which allows training to be more realistic.

The device also allows for the firer to use it with multiple guns, which is a feature of some competitions.

Making the unconscious action of flinching known to the firer allows the firer to take remedial action to counteract the flinch effect. In one embodiment the at least one sensor comprises an IMU sensor, said sensor having at least one accelerometer and/or at least one gyroscope. In one embodiment the at least one sensor comprises an EMG sensor, said sensor capable of detecting movement forward of the wrist.

In one embodiment the module to detect a firing event comprises a microphone. In one embodiment the module to detect a firing event comprises a signature measurement of an accelerometer and/or gyroscope.

In one embodiment the tactile feedback is provided by a vibrating sensor/motor device.

In one embodiment the audio feedback is provided to the user via a speaker or headphone.

In one embodiment the feedback module comprises a visual feedback indicator.

In one embodiment the visual feedback indicator comprises a light source, such as a LED light.

In one embodiment the wearable device can be configured to auto-calibrate based on the at least one sensor XYZ axis and a measurement that represents the firearm is being held steady for aiming.

In one embodiment the wearable device may be configured to recognise an accelerometer and/or gyroscope signature that represents the un-holstering of the firearm from a holster.

In one embodiment the device is configured to adjust threshold levels of the at least one sensor for different firing environments or acceptable threshold levels of firer movement. In one embodiment the wearable device comprises a glove.

In one embodiment the wearable device comprises a ring shaped device configured to be worn on a finger, or hand or arm of the user.

In another aspect of the invention there is provided a method for user firearm training using a wearable device comprising the steps of:

detecting movement in the users hand or arm using at least one sensor; detecting a firing event from a firearm ;

processing data from the at least one sensor such that movement by the user can be analysed; and

producing a feedback to the user based on said analysis wherein the feedback can be an audio or tactile feedback to the user in real-time to indicate a movement of the users hand or arm has occurred before the detected firing event.

According to another aspect of the invention there is provided a wearable device on a user comprising:

means for detecting movement in the users hand or arm ;

means for detecting a firing event;

means for processing data from sensors so movement by the firer can be analyzed; and

means for producing feedback to the firer based on analysis of said sensors.

There is also provided a computer program comprising program instructions for causing a computer program to carry out the above method which may be embodied on a record medium, carrier signal or read-only memory. Brief Description of the Drawings

The invention will be more clearly understood from the following description of an embodiment thereof, given by way of example only, with reference to the accompanying drawings, in which :- Figure 1 shows a diagram of a first embodiment or a wearable device based around a glove or the like such as a strap according to a first aspect;

Figure 2 shows a diagram of a second embodiment based around a ring, worn on a finger of a user, according to a second aspect of the invention; Figure 3 shows a diagram of a third embodiment according to a third aspect of the invention, worn on the arm of a user or firer configured to detect movement forward of the wrist by means of EMG signals which signal hand movement; and

Figure 4 illustrates a flow chart illustrating an example operation of the wearable device of the invention in use.

Detailed Description of the Drawings

Embodiments of the present invention provide a system to detect incorrect movement while a person is firing and give the person real-time feedback. The wearable device can be worn forward of the person's wrist to detect movements of the hand(s), wrist(s), arm(s) and shoulder(s). Sensors in the wearable device for the purpose of detecting flinch such as accelerometers, gyroscopes, or EMG, or a combination of such, constantly measure the movement of the firers hands, wrists, arms and shoulders, the operation of which is discussed in more detail below.

The wearable device is shown in the several views of the drawings. The embodiments shown are not limited in its application to the details of construction and to the arrangements of the components set forth in the following description or illustrated in the drawings. Other embodiments and aspects can be practiced and carried out in various ways. Also the phraseology and terminology employed are for the purpose of descriptions and should not be regarded as limiting their scope. Figure 1 shows a diagram of a first embodiment based around a glove or the like such as a strap, which could be worn on either the gripping hand or the supporting hand of the firer. The glove may be made out of materials that can house electronic components. The glove can incorporate one or more of the following components: a micro USB port 101 . a re-chargeable battery 102, a wireless adapter 103 such as a Bluetooth wireless connection, a vibration motor 104, Microphone 105, a processor 106, an Inertial Measurement Unit (IMU) 107, and a RGB LED 108. The glove can be worn by a user that is firing a gun or firearm.

The electronic components of the glove can detect movement of the firer's hands or arms such as an IMU or EMG sensor 107, which may consist of at least one accelerometer and/or at least one gyroscope. A means to detect a gunshot can be provided by a microphone or by the signature of the accelerometer or gyroscope or EMG or a combination of such 105. A means to process the data from the sensors such as a processer 106 that can be embodied as a microchip or ASIC chip. A means is provided to enable feedback to the firer, such as using a wireless adapter 103, that can operate on the Bluetooth standard or other wireless communication format. The vibration motor 104 or the LED 108 can provide a tactile or visible indicator to the user or firer to indicate that a flinch has occurred during use of a firearm. The wearable device can have a micro USB port 101 is adapted to recharge a battery housed in the glove. The micro USB port 101 can be used to connect to a computer which could be used to adjust threshold levels of the sensors for different firing environments or acceptable threshold levels of firer movement.

Figure 2 shows a diagram of a second embodiment according to a second aspect of the invention. This embodiment is based around an elasticated band of material or a plastic material which is of size to be worn on a finger, or hand or arm of the firer. This alternative embodiment has the same electronic components as the first embodiment. The ring device can incorporate one or more of the following components: Wireless charging inductance coil 201 , Rechargeable battery 202, Bluetooth wireless adapter 203, Memory 204, Microphone 205, Processor 206, or IMU 207.

This embodiment can be placed either above the wrist or below the wrist to determine if the flinch movement originates from the shoulder region or from the wrist or finger. The embodiment shown in Figure 2 is based around a ring, which could be worn on either the gripping hand or the supporting hand of the firer. The ring may be made out of materials that can house electronic components. The electronic components of the ring comprises a means to detect movement of the firers hands or arms such as using an IMU sensor or EMG sensor 207.A means to detect a gunshot such as a microphone 205 or by the signature of the accelerometer or gyroscope or a combination of such is provided. A means to process the data from the sensors such as a processing chip 206. A means to provide feedback to the firer such as a vibration motor 204, means to communicate with an external processor such as a Bluetooth wireless adapter, or a LED device to provide a visual feedback in the form of a light flashing light or different light colors. It may have a wireless charging unit which can recharge a battery housed in the ring. The Bluetooth wireless adapter port can be used to connect to a computer which can be used to adjust threshold levels of the sensors for different firing environments or acceptable threshold levels of firer movement.

The wearable device can be configured to constantly sense for the detection of a firing event, such as a sound above a certain amplitude threshold, an acceleration velocity or a rotation velocity that can indicate a gunshot or a combination of such.

When the wearable device has detected what is deemed to be a firing event, it analyzes the movement data of the firer within a specific period of time prior to the firing event. If the movement data of that fixed period indicates movement of the firers hand or arms to be above a certain threshold of acceleration, angle change or muscle response, then the firer is deemed to have flinched. A module for producing feedback to the user in real time based on the analysis can be factored into the device. The feedback can be at least one of an audio or tactile or visual feedback to the user in real-time to indicate a movement of the users hand or arm has occurred before the detected firing event. By 'real-time' it is meant that the feedback can be provided to the user within a few seconds of a firing event without the need for the user to move their line of sight away from the gun or otherwise disturb their shooting practice. In other words feedback on detected flinch movement can be provided to the user/firer of the firearm between shots in real time. Calculation of the flinch movement can be determined within milliseconds depending on the processor used.

The wearable device can then provide feedback to the firer to make the firer aware of the flinch, in some instances by means of audible tone which may be sent via a computing device such as a smartphone or the vibrating motor 204 in the wearable device, or directly to a set of wireless earphones (using a Bluetooth communication or other wireless protocol), and/or it can record this movement for later analysis.

The wearable device is completely separate from the gun of the firer, and allows the firer to use an unmodified gun, or guns, with unmodified ammunition. It also allows for the firer to use it with multiple guns, which is a feature of some competitions.

The wearable device can be configured to be in wireless electronic communication with a computing device such as a smartphone, a tablet or a laptop. The wearable device can send biometric data collected from the wearable devices sensors and this data can be manipulated and displayed by the computing device and displayed to the firer. Figure 3 shows an alternative embodiment of the invention and similar to Figures 1 and 2. This embodiment is based around an elasticated band of material or plastic material which is of size to be worn on the arm of the firer. The elasticated band wearable device can incorporate one or more of the following components: a micro USB 301 , a rechargeable battery 302, wireless adapter 303, a vibration motor 304, Processor 305, and at least one EMG sensor 306. This embodiment has at least one EMG sensor spaced around the band of material so as to determine movement in the firer's hand or arm. This replaces the IMU described in the first two embodiments with respect to Figures 1 and 2. The remaining components are similar to the first embodiment. EXAMPLE OPERATION

In operation the wearable device worn by the firer will perform a number of functions as described by the flow diagram in Figure 4. The device is worn by the firer during a firing practice in step 400. The device's movement sensors constantly track the rate of movement of the firers hand(s) and/or arm(s). The device sensors will constantly monitor for a firing event, in various embodiments using a microphone, accelerometer or gyroscope, as described above, to detect a distinctive amplitude threshold representing a firing event. The data from the sensors is processed by the processing chip, which monitors for a firing event. When a firing event is detected in step 401 , the processing chip analyzes the movement data for a specific time period prior to the firing event 402. If the movement data prior to the firing event is above a specific threshold of acceleration, angle change or muscle response, the processing chip produces an output such as a vibration or a signal to an external processor 403a. In some embodiments, this output signals for a vibration motor in the device that the user or firer can physically feel or an audible tone to be produced through an external computer. In another embodiment a visible indicate maybe provided in the form of a flashing light to indicate to the user that a flinch is detected, as shown in Figure 1 . In step 403b if the signal is below a signal threshold then the device continues to monitor for future firing events. It will be appreciated that the wearable device is configured to work with a computing device such as a standalone personal computer or smart phone device. The invention can be embodied using a combination of hardware and software. A hardware algorithm can detect gunshot through a signature using Kalman filter combination of accelerometer and gyroscope data above a threshold value. This can be combined with other factors such as was the firearm steady and level prior to gunshot event, indicating gun being aimed. If so, hardware passes samples for x time period prior to gunshot event to external computer for further analysis. An external computer or device analyses for movement above flinch threshold, provides feedback if flinch deemed to have occurred. In one illustrative embodiment a software module can run a routine on the device or on a remote system to recognise a gunshot signature implementing the steps shown in Figure 4. The wearable device can be configured to auto-calibrate itself on the IMUs XYZ axis based on the sensors signature that represents the gun is being held steady for aiming. The wearable device may be configured to recognise an accelerometer and/or gyroscope signature that represents the un-holstering of the gun from a holster. This may be used to recognise the beginning of a live firing practice.

In the context of the present invention the wearable device hereinbefore described can be applied to firearm and weapon training, and can be used in connection with any weapon or weapon system that requires flinch analysis and includes crossbow, bow and arrow weapons and the like.

The embodiments in the invention described with reference to the drawings comprise a computer apparatus and/or processes performed in a computer apparatus. However, the invention also extends to computer programs, particularly computer programs stored on or in a carrier adapted to bring the invention into practice. The program may be in the form of source code, object code, or a code intermediate source and object code, such as in partially compiled form or in any other form suitable for use in the implementation of the method according to the invention. The carrier may comprise a storage medium such as ROM, e.g. CD ROM, or magnetic recording medium, e.g. a memory stick or hard disk. The carrier may be an electrical or optical signal which may be transmitted via an electrical or an optical cable or by radio or other means.

In the specification the terms "comprise, comprises, comprised and comprising" or any variation thereof and the terms include, includes, included and including" or any variation thereof are considered to be totally interchangeable and they should all be afforded the widest possible interpretation and vice versa.

The invention is not limited to the embodiments hereinbefore described but may be varied in both construction and detail.