Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
ENERGY HARVESTING FOR SENSOR SYSTEMS
Document Type and Number:
WIPO Patent Application WO/2017/156579
Kind Code:
A1
Abstract:
Described herein is an energy harvesting system comprising a transducer and a processor. The transducer generates an electric signal from ambient energy. The processor is configured to process the electric signal to perform pattern recognition of the electric signal so as to determine and output a characteristic of a source of the ambient energy. The pattern recognition comprises statistical analysis and frequency domain analysis.

Inventors:
HASSAN MAHBUB (AU)
KHALIFA SARA (AU)
SENEVIRATNE ARUNA (AU)
Application Number:
PCT/AU2017/050227
Publication Date:
September 21, 2017
Filing Date:
March 14, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
NAT ICT AUSTRALIA LTD (AU)
International Classes:
H01L41/113; G01P15/09; G06F19/00; H02N2/18
Other References:
S. KHALIFA ET AL.: "Pervasive Self-Powered Human Activity Recognition without the Accelerometer", PROC. INT'L CONF. PERVASIVE COMPUTING AND COMM., 2015, pages 79 - 86, XP033167740
KHALIFA, S. ET AL.: "Energy-Harvesting Wearables for Activity-Aware Services", IEEE INTERNET COMPUTING, vol. 19, no. 5, 2015, pages 8 - 16, XP011668072
Attorney, Agent or Firm:
FB RICE (AU)
Download PDF:
Claims:
CLAIMS:

1. An energy harvesting system comprising:

a transducer that generates an electric signal from ambient energy; and

a processor configured to process the electric signal to perform pattern recognition of the electric signal so as to determine and output a characteristic of a source of the ambient energy, wherein the pattern recognition comprises statistical analysis and frequency domain analysis.

2. The system of claim 1, wherein the characteristic is determined as being one of several characteristics.

3. The system of claim 1 or 2, wherein the system further comprises an energy store that stores energy from the electrical signal.

4. The system of claim 3, wherein the energy store provides power to the system.

5. The system of any one of the preceding claims, wherein the transducer is a piezoelectric transducer with a cantilevered beam configuration.

6. The system of claim 5 wherein the kinetic energy harvester is adapted for operation in a frequency range associated with the activity.

7. The system of claim 6 wherein the kinetic energy harvester is adapted for operation in a 1-lOHz range.

8. The system of any one of claims 5 to 7, wherein the kinetic energy harvester comprises two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity.

9. The system of any one of the preceding claims wherein the processor performs the statistical analysis by extracting statistical features from the electric signal, wherein the extracted statistical features comprise at least one of the following: the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

10. The system of any one of the preceding claims, wherein the processor performs the frequency domain analysis by extracting frequency domain features from the electrical signal, wherein the extracted frequency features comprise at least one of: dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

11. The system of claim 13 or claim 14, wherein the processor determines the characteristic by using a classification method comprising at least one of:

Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naive Bayes (NB).

12. The system of any one of the preceding claims, wherein the characteristic comprises an indicator of human activity selected from a group consisting of: walking, running, standing, ascending stairs, descending stairs, vacuuming, ascending on an escalator, descending on an escalator, moving up a ramp and moving down a ramp.

13 The system of claim 12, wherein the characteristic comprises an indicator of a number of steps.

14. The system of any one of claims 12 or 13, wherein the characteristic comprises a calorie expenditure estimation.

15. A method for energy harvesting comprising:

receiving and transforming ambient energy into an electrical signal;

processing the electrical signal to extract at least one distinguishing feature, wherein the processing comprises using pattern recognition comprising statistical analysis and frequency domain analysis;

classifying a source of the ambient energy based on the at least one distinguishing feature; and

outputting the classification.

16. The method of claim 15 further comprising:

storing the electrical signal for use as a power source;

using the power source to power one or more of the receiving, transforming, processing, classifying and outputting.

17. The method of claim 15 or 16, wherein the statistical analysis comprises extracting at least one of the following distinguishing features:

the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

18. The method of any one of claims 15 to 17, wherein the frequency domain analysis comprises extracting at least one of:

dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

19. The method of any one of claims 15 to 18, wherein the classifying is performed using at least one of:

Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naive Bayes (NB).

20. The method of any one of claims 15 to 19, wherein the source is classified as being one of several classifications.

Description:
"Energy Harvesting for Sensor Systems"

Technical Field

[0001] This disclosure relates to providing power to a sensor system. In one form the power is provided with the use of kinetic energy harvesting. In one form the sensor system is in wearable technology, and is used for human activity recognition.

Background

[0002] One of the challenges in sensor systems is meeting the power requirements where the systems are wireless or rely on batteries. One possible solution for sensor systems deployed within a suitable context that lends itself to energy harvesting, is to harvest energy from the system environment and to use this harvested energy to contribute to the power used for the sensor system. Energy can be harvested from a number of different sources, such as solar power, thermal energy (or temperature gradients), wind energy, electromagnetic energy, salinity gradients and kinetic energy from movement or vibration.

[0003] One example of this is in wearable technology, such as activity-aware services that make use of human activity recognition (HAR) in various domains like healthcare and indoor positioning. Battery life is a problem with wearable HAR technology so that wearables therefore either need large batteries or the batteries must be charged regularly in order to achieve sustained operation.

[0004] Using energy harvesting has been considered for providing power for wearable HAR technology, however the amount of energy that can be harvested is generally small in comparison to the power requirements of the HAR application.

[0005] Any discussion of documents, acts, materials, devices, articles or the like which has been included in the present specification is not to be taken as an admission that any or all of these matters form part of the prior art base or were common general knowledge in the field relevant to the present disclosure as it existed before the priority date of each claim of this application.

Summary

[0006] Conventional sensor systems typically have (1) a sensing component that provides sensed data, (2) a processor for extracting data from the sensed data, and (3) a component for distributing the sensed and/or processed data (e.g. memory or a transmitter). A power source that provides power for all three of these components of the system is required. If the power source relies (either wholly or in part) on harvested energy for the power supply then it would be beneficial to reduce the power requirements of one or more of the three components.

[0007] One way of doing this is to remove the sensing component by incorporating the sensing functionality into a transducer used for energy harvesting.

[0008] Described herein is an energy harvesting system that comprises:

a transducer that generates an electric signal from ambient energy; and

a processor configured to process the electric signal to perform pattern recognition of the electric signal so as to determine and output an identifier or characteristic of a source of the ambient energy, wherein the pattern recognition comprises statistical analysis and frequency domain analysis. The characteristic may be determined as being one of several characteristics.

[0009] The ambient energy may be kinetic energy generated by an activity. The identifier may be output to a transmitter, to a memory, or to a processor. The system may comprise a transmitter for transmitting the identifier of the activity. The system may include a memory for storing the identifier.

[0010] The system may comprise an energy store that stores the electrical signal. The energy store may provide power to the system. The energy store may provide power to the transmitter, the memory and/or the processor. [0011] The transducer may be a kinetic energy harvester such as a piezoelectric transducer. The piezoelectric transducer may have a cantilevered beam configuration. The kinetic energy harvester may be adapted for a frequency range associated with the activity, for example a 1-lOHz range for human movement such as walking, running and climbing stairs.

[0012] The kinetic energy harvester may comprise two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity.

[0013] The processor may determine the identifier of the activity by extracting features from the electric signal.

[0014] The processor may perform the statistical analysis by extracting statistical features from the electric signal. The extracted statistical features may comprise at least one of the following: the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

[0015] The processor may perform the frequency domain analysis by extracting frequency domain features from the electrical signal, wherein the extracted frequency features comprise at least one of the following: dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

[0016] The processor may determine the identifier by using a classification method comprising at least one of the following: Decision Tree (DT), K- Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naive Bayes (NB). [0017] The identifier (also referred to as a characteristic of the source of ambient energy) may indicate human gait. The identifier may indicate any one or more of the following human activities: walking, running, standing, ascending stairs, descending stairs, vacuuming, ascending on an escalator, descending on an escalator,

walking/running up a ramp, walking/running down a ramp, etc. The identifier may indicate a number of steps. The identifier may indicate a calorie expenditure estimation.

[0018] The system may be adapted to be worn on or close to a specific part of the body, for example a wrist, waist or a knee.

[0019] Also described is a method for energy harvesting comprising:

receiving and transforming ambient energy into an electrical signal;

processing the electrical signal to extract at least one distinguishing feature, wherein the processing comprises using pattern recognition comprising statistical analysis and frequency domain analysis;

classifying a source of the ambient energy based on the at least one distinguishing feature; and

outputting the classification.

[0020] The source may be classified as being one of several classifications.

[0021] The method may also comprise storing the electrical signal for use as a power source. The power source may be used to power one or more of the method steps.

[0022] The receiving and transforming may be done with a kinetic energy harvester, and the kinetic energy harvester may be a piezoelectric transducer. The ambient energy may be kinetic energy.

[0023] The statistical analysis may comprise extracting at least one of the following distinguishing features: the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

[0024] The frequency domain analysis may comprise extracting at least one of the following distinguishing features: dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

[0025] The classifying may be performed using at least one of the following:

Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naive Bayes (NB).

[0026] The outputting may be to a transmitter, a memory or a processor.

[0027] As used herein, except where the context requires otherwise, the term

"comprise" and variations of the term, such as "comprising", "comprises" and

"comprised", are not intended to exclude further additives, components, integers or steps.

Brief Description of Drawings

[0028] Figure 1 is a schematic representation of a system for identifying the source of ambient energy.

[0029] Figure 2 is a flow diagram of a method for identifying the source of ambient energy.

[0030] Figure 3 is the voltage output from a piezoelectric energy harvester (PEH) where the voltage peaks accord with the step count.

Description of Embodiments

[0031] Conventional systems used for determining characteristics of movement, e.g. to provide activity-aware services such as in wearable HAR systems, typically make use of accelerometers to obtain data about the activities. However, the power requirement of accelerometers is significant, and has been shown to range between 0.35 and 5 times the harvested kinetic energy when detecting common human activities (e.g. walking and running). Some activities generate only a few μ\¥, not enough to power both an accelerometer and radio communication required to transmit the sensed data.

[0032] Figure 1 is a schematic representation of a system 100 for identifying an activity that uses kinetic energy harvesting and does not use an accelerometer. Instead of using an accelerometer to obtain data about the activity, a transducer 102 harvests ambient energy and the power generated from the harvested energy provides information about the activity.

[0033] In this embodiment the transducer 102 is a piezoelectric transducer with a cantilevered beam configuration. When the piezoelectric material is subjected to a mechanical stress due to any source of environmental vibrations, it expands on one side and contracts on the other. Positive charges accumulate on the expanded side and negative charges on the contracted side, generating an AC voltage as the beam oscillates around the neutral position. The amount of voltage is proportional to the applied stress, which means that different vibration patterns would generate different AC voltage patterns. An example of a piezoelectric KEH transducer is the MIDE Volture transducer.

[0034] The AC output of the transducer is rectified and regulated by a power conditioning circuit 104 so that it can be stored in the energy storage 106 (a battery or capacitor) as DC voltage used to power the processor 108 and transmitter 110. Power regulation may include analogue to digital conversion. The stored energy may be used to fully or partially power the processor 108, memory 112, and/or transmitter 110.

[0035] The regulated power may not be suitable for detecting features in the electric signal produced by the transducer because regulation removes potential patterns from the signal. In the system shown in Figure 1, the AC voltage produced by the transducer is used by the processor 108 to determine the source of the ambient energy. In this example, determining the source of the ambient energy means recognising the activity performed by a user resulting in the kinetic energy that is harvested.

[0036] The activity performed is identified as one amongst several possible activities, i.e. walking, standing, running, ascending or descending stairs, vacuuming, going up/down an escalator, walking/running up a ramp, walking/running down a ramp, etc. An activity identifier describes the identified activity performed, and may be stored in memory 112 and/or transmitted to another system or processor via the transmitter 110.

[0037] The process 200 used to determine the activity identifier may be understood with reference to Fig. 2.

[0038] The transducer 102 receives and transforms ambient energy 202, in this example kinetic energy. The resulting power is stored 204 over a period of time in the energy storage 104 (e.g. a capacitor or battery), and this step may include rectifying and regulating the electric signal output by the transducer.

[0039] The unprocessed electric signal output from the transducer is then processed 206 by the processor 108. This includes first extracting features 208 from the electric signal. These may be any combination of distinguishing features that describe the data, for example the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, dominant frequency, dominant frequency ratio, energy, frequency domain entropy, mean absolute deviation, auto-correlation, power spectrum mean.

[0040] Some of these are described in Table 1 below. As can be seen, the features used for pattern recognition in the harvested signal combine both statistical analysis as well as frequency domain analysis.

Table 1: An example feature set used to analyse the source of harvested ambient energy

[0041] More particularly, it has been found that features that are particularly useful when harvesting kinetic energy with a piezoelectric KEH are the ones shown in the feature set in Table 2 below.

Table 2: A "Vibration Feature Set" (VFS) used to extract features from KEH data

[0042] The kinetic energy harvester may comprise two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity. In such embodiments, the feature set used may include features particular to multi-axial data, as shown in Table 3.

Table 3: Multi-axial feature set [0043] Following the pattern recognition and feature extraction 208, the data is classified 210 according to one of several possible identifiers (at least three or more), e.g. kinetic energy may have been harvested from one of walking, running, standing, ascending or descending stairs, etc. Classification 210 is performed using a suitable known method, such as Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), or Naive Bayes (NB).

[0044] The outcome of the identification process 206 is then output 212 according to the particular application. For example, where a wearable is used for continuous HAR then the output may be stored in memory on the wearable for later retrieval (e.g. in wired communication with a computer), the output may be displayed on the wearable device, or the output may be transmitted with wireless communication to another processor or computer.

[0045] It has been found that, with an appropriate feature set (e.g. as shown in Table 2), and an appropriate classifier (e.g. KNN), accuracy of up to 83% can be obtained in HAR. This can be improved even further depending on the placement of the transducer, e.g. handheld, on a wrist, on the waist, hip or at the knee. For example, moving the transducer from a handheld position to a waist position resulted in an average improvement of accuracy from 83% to 87%. By eliminating the accelerometer that is typically used in HAR systems, a power saving of 70-80% in comparison to

conventional systems may be achieved.

[0046] The processing 206 may include determining other information from the electric signal, as described below with reference to the examples presented.

[0047] Example 1 - Step count

[0048] Characteristics of harvested energy can be used to detect steps in human motion and provide a step count as an output. One method for doing this uses a peak detection algorithm. Because of the irregularity of human movements and also hardware noise, not all detected peaks are valid steps. Peaks that are unlikely to be associated with steps and that are to be avoided in determining step count can be avoided by the use of two thresholds: T 1 is the minimum peak height, and T 2 is the minimum distance between every two consecutive peaks. Using these thresholds, the peaks that represent valid steps are only those peaks higher than T 1 and separated by at least T 2 . Using peak detection, step count using this method has been shown to have an accuracy of up to 96%.

[0049] The peak height threshold T 1 and the step distance threshold T 2 may be determined from the data collected using machine learning, or may be selected based on a predetermined value. For example, referring to Figure 3, T 1 =0,2V and T 2 =0,4ms for the example voltage output 300 that is output from the transducer.

[0050] In addition to this peak detection algorithm, step count can also be determined using a zero crossing detection algorithm or a moving variance detection algorithm.

[0051] Example 2 - Calorie expenditure

[0052] Calorie expenditure may be estimated by incorporating anthropometric features (e.g. height, age, weight) together with the electric signal in a regression model to estimate calorie expenditure. The anthropometric features are input by the user and the linear regression model is trained, e.g. using indirect calorimeters to provide a calorie expenditure estimate (CEE). A suitable regression model may be represented as follows:

where indicates the estimated calorie expenditure at the kt minute. X denotes

the vector of input signals, including the anthropometric features of the subjects, and the output voltage signals from the energy harvester. The β and ε are the vectors of coefficients and residual error, respectively. It has been shown that the average (over one second or longer) CEE achieved using harvested energy compares well with conventional methods using accelerometers. [0053] The description above has focused on human activity recognition with examples relating to characteristics of human activity (i.e. step count and calorie expenditure). In that respect the relevant sensing pertains to human activities, and the type of energy used for energy harvesting for these examples is kinetic energy.

Advantageously, a large number of activities can be identified because the pattern recognition performed for the electric signal generated by the transducer may use both statistical analysis as well as frequency domain analysis. This sophisticated combination technique allows several different distinguishing characteristics to be identified within the harvested signals.

[0054] The system and methods described herein can be extended to other types of sensed phenomena where energy may be harvested from the relevant environment in a different form. For example, a temperature sensor arrangement may be powered by harvested heat energy. In a comparable way the characteristics of the harvested heat energy may be used to indicate characteristics of the heat source such as the temperature.

[0055] It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the above-described embodiments, without departing from the broad general scope of the present disclosure. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.