Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
A VISUAL FATIGUE DETERMINING MODULE
Document Type and Number:
WIPO Patent Application WO/2017/001319
Kind Code:
A1
Abstract:
A visual fatigue determining module (10) configured to determine visual fatigue level of a user, the module comprising at least: - a communication component (12) configured to receive from a visual fatigue determining device (20), visual behavior data indicative of the at least one visual behavior parameter of the user, - a memory (14) configured to store computer executable instructions; and - a processor (16) for executing the computer executable instructions, wherein the computer executable instructions comprises instructions for: - processing the visual behavior data to generate visual fatigue information indicative of the visual fatigue level of the user, wherein the communication component is further configured to receive activity data indicative of the activity of the user and wherein both the visual behavior data and activity data are processed to generate visual fatigue information.

Inventors:
BARANTON KONOGAN (FR)
SINGH NISHA (SG)
Application Number:
PCT/EP2016/064805
Publication Date:
January 05, 2017
Filing Date:
June 27, 2016
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
ESSILOR INT (COMPAGNIE GÉNÉRALE D'OPTIQUE) (FR)
International Classes:
G08B21/06
Foreign References:
DE102008007149A12008-10-02
US8610585B12013-12-17
US20060214807A12006-09-28
US20140152444A12014-06-05
DE10152852A12003-05-22
DE102014204980A12015-01-08
Other References:
None
Attorney, Agent or Firm:
CABINET NOVITECH et al. (FR)
Download PDF:
Claims:
CLAIMS

1. A visual fatigue determining module configured to determine visual fatigue level of a user, the module comprising at least:

- a communication component configured to receive from a visual fatigue determining device, visual behavior data indicative of the at least one visual behavior parameter of the user,

- a memory configured to store computer executable instructions; and

- a processor for executing the computer executable instructions, wherein the computer executable instructions comprises instructions for:

- processing the visual behavior data to generate visual fatigue information indicative of the visual fatigue level of the user wherein the communication component is further configured to receive activity data indicative of the activity of the user and wherein both the visual behavior data and activity data are processed to generate visual fatigue information.

2. The visual fatigue determining module according to claim 1, wherein the processing of said visual behavior data is done by comparing said visual behavior data with a predetermined threshold value.

3. The visual fatigue determining module according to claims 1 and 2, wherein the predetermined threshold value is adapting based on the activity data.

4. The visual fatigue determining module according to claims 2 or 3, wherein the visual fatigue information is an alert information.

5. The visual fatigue determining module according to any of the preceding claims, wherein the instructions for processing the visual behavior data are arranged to generate visual fatigue information indicative of an anticipated visual fatigue level of the user.

6. The visual fatigue determining module according to any of the preceding claims, wherein the eye data comprise data relating to the pupil and/or vergence micro fluctuation of the user and/or the near point of convergence of the user, and/or microfluctuations of eyemovements and/or accomodation micro fluctuations.

7. A visual fatigue determining device comprising at least one sensor configured to sense at least one visual behavior parameter indicative of the visual behavior of the user when wearing the visual fatigue determining device and a communication unit configured to communicate visual behavior data indicative of the sense visual behavior parameter to a visual fatigue determining module according to any of claims 1 to 6, wherein the visual fatigue determining device further comprises at least one activity input unit configured to collect activity information indicative of the activity of the user and the communication unit is further configured to communicate the activity information indicative to the visual fatigue determining module..

8. The visual fatigue determining device according to claim 7, wherein the communication unit is further configured to receive from the visual fatigue determining module information indicative of the visual fatigue level of the user.

9. The visual fatigue determining device according to the preceding claim, further comprising an output unit arranged to output a signal to the user based on the information indicative of the visual fatigue level of the user received from the visual fatigue determining module.

10. The visual fatigue determining device according to any of claims 7 to 9, wherein the visual fatigue determining device is one of the devices comprised in the list consisting of a head mounted device, a smartphone and a touch pad. 11. Method of determining the visual fatigue level of a user, comprising:

- a visual behavior data receiving step during which visual behavior data indicative of the visual behavior of the user are received, - an activity data providing step, during which activity data indicative of the activity of the user are provided, and

- a processing step during which the visual behavior data are processed to generate visual fatigue information indicative of the visual fatigue level of the user, the visual fatigue information being generated based on the visual behavior data and the activity data.

12. Method for improving a visual fatigue determining module according to any of claims 1 to 6, wherein the method comprises:

- a subjective fatigue level data providing step during which subjective fatigue level data indicative of a subjective fatigue level are provided, for example by the user of the visual fatigue determining module,

- a subjective visual behavior data receiving step during which subjective visual behavior data indicative of at least one visual behavior parameter of the user in the subjective fatigue level are provided,

- an adapting step during which the computer executable instructions for processing the visual behavior data are adapted based on the subjective fatigue level data and the subjective visual behavior data.

Description:
A visual fatigue determining module

FIELD OF THE INVENTION The invention relates to a vision fatigue monitoring module, a visual monitoring device comprising a vision fatigue monitoring module of the invention and a method for monitoring the visual fatigue of a user.

BACKGROUND OF THE INVENTION

Visual fatigue is a phenomenon difficult to measure. In particular it is difficult to have an easy-to-measure device to assess visual fatigue.

The problem is that up to now it is difficult to make an easy measurement of the visual fatigue, which could be used in all day life without requiring complex device and controlled environment, and which can give an accurate measurement of visual fatigue level that is dependent on the individual.

Furthermore, visual fatigue may help predict general fatigue of an individual and determining the level of fatigue of an individual may be useful in many situations.

For example, some activities require a great degree of concentration. It is useful to be able to provide to the user or a third party carrying out such activity an indication of the level of fatigue of the user. Indeed, it has been observed that a change in behavior upon carrying out an activity may lead to very different results in terms of achievement of the activity.

Typically, when a person is driving it can be very useful to analyze the fatigue level of the person so as to provide an alert when the determined fatigue level is greater than a threshold value and driving represents a risk.

Therefore, there is a need for a vision fatigue monitoring module for monitoring the visual fatigue of a user.

One object of the present invention is to provide such a module and method for monitoring the visual fatigue. SUMMARY OF THE INVENTION

To this end, the invention proposes a vision fatigue monitoring module configured to monitor eye fatigue of a user, the module comprising at least:

- a communication unit configured to receive eye data indicative of the at least one parameter relating to the current visual behavior of the user,

- a memory configured to store computer executable instructions; and

- a processor for executing the computer executable instructions, wherein the computer executable instructions comprise instructions for:

processing the visual behavior data to generate visual fatigue information indicative of the visual fatigue level of the user,

wherein the communication component is further configured to receive activity data indicative of the activity of the user and wherein both the visual behavior data and activity data are processed to generate visual fatigue information.

Advantageously, the vision fatigue monitoring module can be mounted on an existing optical equipment or head mounted device or communicate with a sensing device to monitor the visual fatigue of the user. According to further embodiments which can be considered alone or in combination:

- the processing of said visual behavior data is done by comparing said visual behavior data with a predetermined threshold value; and/or - the predetermined threshold value is adapting based on the activity data; and/or

the visual fatigue information is an alert information; and/or

the communication component is further configured to receive subjective fatigue level data indicative of a subjective fatigue level provided by the user, and

the computer executable instructions further comprise instructions for:

o receiving the subjective fatigue level data, o receiving subjective visual behavior data indicative of the at least one visual behavior parameter the user in the subjective fatigue level,

o adapting the processing of the visual behavior data based on the subjective fatigue level data and the subjective visual behavior data; and/or

the instructions for processing the visual behavior data are arranged to generate visual fatigue information indicative of an anticipated visual fatigue level of the user; and/or

- the eye data comprise data relating to the pupil and/or vergence micro- fluctuation of the user and/or the near point of convergence of the user, and/or microfluctuations of eyemovements and/or accomodation micro- fluctuation; and/or The invention further relates to a visual fatigue determining device, for example intended to be worn by a user, comprising at least one sensor configured to sense at least one visual behavior parameter indicative of the visual behavior of the user when wearing the visual fatigue determining device and a communication unit configured to communicate visual behavior data indicative of the sense visual behavior parameter to a visual fatigue determining module according to the invention, wherein the visual fatigue determining device further comprises an output unit arranged to output a signal to the user based on the information indicative of the visual fatigue level of the user received from the visual fatigue determining module.

According to further embodiments which can be considered alone or in combination

the communication unit is further configured to receive from the visual fatigue determining module information indicative of the visual fatigue level of the user; and/or

the visual fatigue determining device further comprises at least one activity input unit configured to collect activity information indicative of the activity of the user and the communication unit is further configured to communicate the activity information indicative to the visual fatigue determining module; and/or

- the visual fatigue device is a head mounted device; and/or

- the visual fatigue device is a smartphone; and/or

- the visual fatigue device is a touch pad; and/or

- the visual fatigue device is a computer/ laptop equipped with a webcam.

The invention also relates to a method of determining the visual fatigue level of a user, comprising:

- a visual behavior data receiving step during which visual behavior data indicative of the visual behavior of the user are received,

- an activity data providing step, during which activity data indicative of the activity of the user are provided, and

- a processing step during which the visual behavior data are processed to generate visual fatigue information indicative of the visual fatigue level of the user, the visual fatigue information being generated based on the visual behavior data and the activity data.

The invention further relates to a method for improving a visual fatigue determining module according to the invention, comprising:

- a subjective fatigue level data providing step during which subjective fatigue level data indicative of a subjective fatigue level are provided, for example by the user of the visual fatigue determining module,

- a subjective visual behavior data receiving step during which subjective visual behavior data indicative of at least one visual behavior parameter of the user in the subjective fatigue level are provided,

- an adapting step during which the computer executable instructions for processing the visual behavior data are adapted based on the subjective fatigue level data and the subjective visual behavior data.

The invention further relates to a computer program product comprising one or more stored sequences of instructions that are accessible to a processor and which, when executed by the processor, causes the processor to carry out the steps of the method according to the invention.

The invention also relates to a computer-readable storage medium having a program recorded thereon; where the program makes the computer execute the method of the invention.

The invention further relates to a device comprising a processor adapted to store one or more sequence of instructions and to carry out at least one of the steps of the method according to the invention.

Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as "computing", "calculating", or the like, refer to the action and/or processes of a computer or computing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities within the computing system's registers and/or memories into other data similarly represented as physical quantities within the computing system's memories, registers or other such information storage, transmission or display devices.

Embodiments of the present invention may include apparatuses for performing the operations herein. This apparatus may be specially constructed for the desired purposes, or it may comprise a general purpose computer or Digital Signal Processor ("DSP") selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs) electrically programmable read-only memories (EPROMs), electrically erasable and programmable read only memories (EEPROMs), magnetic or optical cards, or any other type of media suitable for storing electronic instructions, and capable of being coupled to a computer system bus.

The processes and displays presented herein are not inherently related to any particular computer or other apparatus. Various general purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct a more specialized apparatus to perform the desired method.

The desired structure for a variety of these systems will appear from the description below. In addition, embodiments of the present invention are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the inventions as described herein.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention will now be described, by way of example only, and with reference to the following drawings in which:

Figure 1 is a schematic representation of a visual fatigue determining module according to the invention;

- Figure 2 is a schematic representation of a visual fatigue determining device according to the invention;

Figure 3 represents a network configuration of the visual fatigue determining device according to the invention;

Figures 4 and 5 are illustrations of chart-flow of methods according to the invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figure may be exaggerated relative to other elements to help improve the understanding of the embodiments of the present invention.

The invention relates to a visual fatigue determining module configured to determine visual fatigue level of a user. As illustrated on figure 1, the visual fatigue determining module 10 comprises a communication component 12, an image memory 14 and a processor 16. The communication component 12 is configured to receive visual behavior data, for example from a visual fatigue determining device as described in greater detail latter. The visual behavior data are indicative of at least one visual behavior parameter of the user.

The inventors have observed that among the different visual behavior parameter of the user visual behavior data relating to the pupil and/or vergence micro fluctuation and/or the near point of convergence, and/or microfluctuations of eyemovements and/or accomodation microfluctuation allow determining the visual fatigue with a great accuracy.

From the study that measured refraction and pupil with a power refractor before & after30 minutes of visual search task and processed using fast Fourier transformation in MATLAB to obtain accommodation and pupil microfluctuations (Low frequency component (LFC), high frequency component (HFC)) showed that, both microfluctuations of accommodation & pupil changes significantly after the task, particularly the low frequency component (LFC) Furthermore, capturing pupil may be relatively easy and quick and it can be done using a camera/ webcam.

Advantageously, using the micro fluctation of pupil of the user as visual behavior parameter allows direct measurement, easy-to -measure (no optical alignment neither fixation point) and cheap (simple camera, preferably in infrared for dark eyes) device for assessing visual fatigue.

Similarly, microfluctuations of vergence and eye movement increased significantly after 30 minutes (in particular LFC) of performing the task.

The memory 14 is configured to store at least computer executable instructions. The memory 14 may also be configured to store at least part of the received visual behavior data.

The memory 14 may also store further user related data that may be used for determining the user visual fatigue.

The processor 16 is configured to execute the computer executable instructions stored in the memory 14. The computer executable instructions comprise instructions for processing the visual behavior data to generate visual fatigue information indicative of the visual fatigue level of the user. According to an embodiment of the invention, the visual fatigue information may include, but is not limited to, statistical information based at least on the visual behavior data processing. The processing can be, for example, a statistical analysis.

Statistics involves the collection, organization, analysis, interpretation, and/or presentation of measured/collected data. With advances in technology, more extensive and complex computing allows massive amounts of data to be collected, stored and/or processed. Further, methods for evaluating the data are numerous.

Statistical analysis can be employed to process and/or evaluate data received by the visual fatigue module of the invention. The two main types of statistics are descriptive and inferential statistics.

Descriptive statistics includes methods for organizing and summarizing collected data. These methods include, but are not limited to, graphs, tables, charts and measurements such as averages, percentiles, and measures of variation of the data. Data mining for pattern detection, machine learning and artificial intelligence methods, regression modeling and summary statistics can be employed in descriptive statistics.

Inferential statistics is based on methods for making conclusions about data collected based on the evaluation of a sample of the data. For example, predictions can be made regarding the entire set of data. An example prediction can relate to the likelihood that a level of visual fatigue is reached based on the visual behavior data collected. Recommendations can be made according to such predictions.

Statistical methods such as regression analysis can be employed to analyze data. Regression analysis includes techniques for analyzing different variables to determine the relationship between one or more dependent variables and independent variables. For example, the analysis can be employed to determine how the value of a dependent variable changes when a value of one independent variable changes while keeping the values of other independent variables constant. Regression analysis can be employed for prediction and overlaps with the field of machine learning (a branch of artificial intelligence that employs algorithms to identify patterns in data and/or make predictions based on evaluated data). Different models can be employed in regression analysis to model the relationship between two variables. Linear regression is a type of regression analysis. Linear regression models the relationship between a dependent variable and an independent variable using linear predictor functions. Unknown model parameters are estimated from the data on which linear regression is performed. Interpolation methods can be employed to perform prediction based on values within the set of collected data used for model- fitting while extrapolation can be employed to perform prediction based on values outside the set of collected data.

In linear regression models, the conditional mean of an independent variable given the dependent variable value is typically an affine function. In some cases, the median, or some other quantile of the conditional distribution of the independent variable given the dependent variable is a linear function of the dependent variable.

Non-linear regression is a type of regression analysis in which observed information is modeled by a non- linear function. The non- linear function is a combination of the model parameters and depends on an independent variable.

According to a further embodiment of the invention, the processing of the visual behavior data is done by comparing said visual behavior data with at least one predetermined threshold value.

The processing of the visual behavior may further comprise comparing said visual behavior data with a set of threshold values allowing to predict or anticipate a level of visual fatigue of the user.

The visual fatigue information may be an alert information sent to the user or to a third party. The alert information may be of any type, such as visual alert as a message, an alert sound such as a specific sound, a haptic feedback such as a specific vibration. The alert information provides a feedback to the user or a third person on the determined visual fatigue level of the user.

The visual fatigue information may prompt the user that he may need anti-fatigue lenses and/or other general precautions like maintaining right posture, distance from computer, have a break or a pause, close his eyes for a given time etc.

Correspondence between the level of visual fatigue and the type of alert to be provided and to whom may be stored as a look-up table or a data base, for example in the memory of the visual fatigue determining module. Such correspondence may further be stored in a distant entity, such as a distant server, a smartphone, a touchpad, or a smart watch.

The communication component 12 is further configured to receive activity data indicative of the activity of the user. When generating visual fatigue information both the visual behavior data and activity data are processed. Indeed, the inventors have observed that the processing of the visual behavior is to be adjusted based on the activity of the user.

The activity data may identify directly an activity carried out by the user or may be data allowing determining such activity, for example an indication allowing determining the activity of the user from a data base and/or lookup table.

The person activity data may be provided directly by the user itself, for example by selecting an activity in a list of activities.

Furthermore, the person activity data may be determined based on analysis of data provided by sensors that measure the user's behavior or the environment of the wearer.

The activity data may identify the current activity of the user to adapt the processing of the visual behavior data. Indeed, the processing of the visual may be a different according to the activity of the user. For example if the user is reading or computing his visual fatigue may increase more quickly than if the user is walking in the street or in the forest.

The activity data may relate to the past activity of the user or the past so as, for example, to process more accurately the past visual behavior data.

The activity data may relate to a future activity. For example, the user may indicate that he is to carry out a specific activity and based on his current visual behavior, the module of the invention may generate information predicting a future visual fatigue level.

The activity that may be identified may be for example, but not limited to driving, sport, playing golf, playing tennis, practicing archery, reading, walking, paragliding, computing, etc... When the processing of the visual behavior data is done using one or a set of predetermined threshold values, the value(s) of the predetermined threshold may be adapted based on the activity data.

So as to improve the accuracy of the module of the invention, such module may be arranged to allow for calibration. Such calibration may be an initial calibration carried out when the user first uses the module or may be performed regularly when the user is using the module, so as to improve the processing of the visual behavior data specifically to said user.

Typically, the communication component may be configured to receive subjective fatigue level data indicative of a subjective fatigue level provided, for example by the user. The subjective fatigue level data are indicative of the visual fatigue level experienced by the user.

Typically, the user rates his visual fatigue level using a scale. Scale examples may include a letter grade or a numerical value, such as 1-10, but can be any desired scale.

Together with the subjective fatigue level data, the communication unit receives subjective visual behavior data indicative of at least one visual behavior parameter the user in the subjective fatigue level.

The processing of the visual behavior data may be adapted based on the subjective fatigue level data and the subjective visual behavior data.

Advantageously, the processing of the visual behavior may be more and more accurate as the user provides subjective visual behavior level.

The visual fatigue determining module 10 may further provide information concerning the general fatigue condition of the user. Indeed, in some cases, it is possible to link the visual fatigue level of the user with his general fatigue condition.

As illustrated on figure 2, the invention further relates to a visual fatigue determining device 20 intended to be worn by a user. Typically, the visual fatigue determining device is a head mounted device comprising a spectacle frame that may comprise optical lenses 22. Other head mounted device may be used, in particular head mounted devices that do not comprise optical lenses.

According to an embodiment of the invention, the visual fatigue determining device 20 may comprise active optical lenses. The optical function of the active optical lenses may be controlled by an optical function controller (not shown).

For example, the visual fatigue determining device 20 can determine that that the eyes of the user are fatigue and alerts the user and/or control the active optical lenses to adapt the optical function to the visual fatigue level of the user.

The optical function may comprise dioptric function, light absorption, polarizing capability, reinforcement of contrast capacity, etc...

The dioptric function corresponds to the optical lens power (mean power, astigmatism etc... ) as a function of the gaze direction.

The optical function of the head mounted device may comprise the dioptric function of at least one of the lenses that the head mounted device may comprise, a sun protection function for example by controlling a transmission parameter of the head mounted device or the polarization of a surface of at least one of the lenses that the head mounted device may comprise.

For example, the dioptric function may be adapted based on the visual fatigue level by adapting the addition in the near zone to relieve the user from the visual fatigue. The color or light absorption of the optical lenses may also be adapted based on the visual fatigue level of the user.

Advantageously, that optical function won't comprise the addition/ tint when it is not needed by the user and thus protecting eyes of the user from unnecessary symptoms of headache, dizziness etc.

The visual fatigue determining device 20 illustrated on figure 2, further comprises sensors 32 and a communication unit 38.

The sensors 32 are configured to sense at least one visual behavior parameter indicative of the visual behavior of the user when wearing the visual fatigue determining device. For measuring pupil microfluctation, binocular or monocular tracking may be user. For example capturing both pupil and then considering worst eye provides good results, monocular tracking is enough for pupilla size monitoring.

Pupil diameter is measured by image processing. A normalization relative to inter-pupillary distance or distance between two nodal points of the face permit to compensate variation of distance between camera and eyes.

For example, when measuring the pupil size, if the distance between the camera and the pupil becomes shorter, the pupil size may appear bigger on the camera sensor even if the real size is the same. The inter-pupillary distance may also similarly appear bigger, so it is possible to use the parameter:

DiamPupNor=DiamPupCam/DistPupCam, with DiamPupNorm being the normalized pupil diameter, DiamPupCam being the pupil diam size seen by the camera (size in pixels) and DistPupCam being the interpupilary distance seen by the camera (in pixels).

If measuring the pupilla size variation, the distance variation can be compensated using the size of the IRIS that is constant.

Spectrum of pupil diameter variation over time may be calculated with Fourier transform. Energy in specific bandwidth are assessed (low is below IHz, medium is between IHz and 2.5 Hz). From the results low frequency is good enough to measure.

If pupil microfluctuations exceeds a particular threshold in one eye (low frequency component>0.002) or evolves during the day then this would imply that person is visually fatigue and may need anti-fatigue lenses. The duration for measurement may typically be between 10 and 20 seconds.

It is further possible to measure the rate (or microfluctuations) of vergence and eye movement

The vergence fluctuation calculation can be done based on the center of rotation of the eye, interpupillary distance and distance between the camera and the eyes.

The vergence fluctuation can be calculated using the variation of the papillary distance, for example using the following formula: A=atan[(DistPup-DistPupMoy)/CRE]=atan(ADistPup/CRE)

With CRE being the radius of the eye and DistPup being the actual pupillary distance and

DistPupMoy being the average (vs time) pupillary distance

Δ being the fluctuation of convergence over a period of time

The vergence fluctuation can further be determined based on the gaze values of right and left eyes.

For example, if (alphaR,betaR) and (alphaL,BetaL) are the gaze direction for R/L eye,

Δ can be calculated using the variation of BetaL, BetaR for example A=(BetaL+BetaR)* 1.75 (in prism diopters)

Eyemovement speed can be calculated based on the gaze values of x- and y-coordinates for each eye.

For example, if (alphaR,betaR) and (alphaL,BetaL) are the gaze direction for R/L eye,

Δ for Right eye can be calculated as [sqrt(alphaR2-alphaRl) A 2 + (betaR2- betaRl) A 2]/Time2-Timel; Δ being the fluctuation of eye movement.

Similar to pupil micro fluctuations, spectrum of vergence and eye movement variation is calculated with Fourier transform.

Threshold for vergence - low frequency component >0.25 and threshold for eye movement - low frequency component >0.1. Considering low frequency component is good enough for vergence and eye movement microfluctuations. The visual fatigue determining device 20 according to the invention may further sense visual behavior of the user based on the near point of convergence.

An object or target is positioned at set distances and the user is asked if it appears double or examiner or camera can pick if one of the eyes loses fixation.

A target is shown which is placed at a particular defined distance and move towards the user and the user fixates at the target tip and reports when the target splits into two or the camera in the tool can detect the deviation of the eye. For example, it is possible to use image from the camera to determine the gaze direction of both eyes, using known techniques, for example using videooculography method. So it is possible to check if one of the eyes gaze direction do not go through the target.

It is also possible to determine the pupil position of both eyes using standard image processing, and detect the movement when the distance between pupils suddenly increase, that reveals a loss of convergence of the person.

It is also possible to use the camera to display on the tablet screen the position of both eyes, and let the user detect by himself when one of the two eyes deviates.

Distance from the eyes to the target may be recorded by the camera, or as an alternative can be recorded via a position sensor associated to the target.

Typically, for a user over 20 year old :

a distance smaller than or equal to 6 cm corresponds to no Fatigue a distance between 7 and 8 cm corresponds to a risk of being visually fatigue soon (moderate fatigue), needs preventive measures, for example prescribe small addition (Essilor Anti-fatigue or small addition lenses),

a distance greater than or equal to 9 cm correspond to a need of treatment for visual fatigue (Severe Fatigue).

For kids, teenagers and up to 20years of age, criteria can be slightly different:

a distance smaller than or equal to 5 cm corresponds to no Fatigue a distance between 6 and 8 cm corresponds to a risk of being visually fatigue soon (moderate fatigue), needs preventive measures, for example prescribe small addition (Essilor Anti-fatigue or small addition lenses),

a distance greater than or equal to 9 cm correspond to a need of treatment for visual fatigue (Severe Fatigue).

The communication unit 38 is configured to communicate visual behavior data indicative of the sense visual behavior parameter to a visual fatigue determining module 10 according to the invention. The communication unit 38 may further be configured to receive from the visual fatigue determining module 10 information indicative of the visual fatigue of the user.

As illustrated on figure 2, the visual fatigue determining device 20 may further comprise an output unit arranged to output a signal to the user based on the information indicative of the visual fatigue level of the user received from visual fatigue determining module 10.

Typically, the output unit may be a visual output unit configured to provide a visual signal to the user based on the information indicative of the visual fatigue level. Such visual signal output unit may be a simple led or a more complex display device allowing for example to display a text message to the user.

The output unit may be an audio output unit such as a speaker or an intraocular prosthesis outputting an audio message to the user.

The output unit may be configured to provide a haptic feedback to the user such as a specific vibration.

Although represented as part of the visual fatigue determining device 20, the output unit could be part of a distant entity connected to the visual fatigue determining device or module. For example the output unit may be part a personal digital assistants, an audio/video device, a mobile phone, a MPEG-1 Audio Layer 3 (MP3) player, a personal computer, a laptop, a tablet, a bluetooth headset, a watch, a wristband, etc...

Such distant entity may typically communicate with the visual fatigue determining device or module by wireless communication. The wireless communication can use different communication protocols such a Bluetooth, Zigbee, Wifi or others.

The visual fatigue determining device 20 may further comprise an activity input unit 18 configured to collect activity information indicative of the activity of the user. The activity information may be communicated to the visual fatigue determining module 10 by the communication unit 38.

The activity input unit 18 may comprise a sensor, such as a scene camera, adapted to determine information concerning the activity of the user. The activity input unit 18 may further comprise input means, such as voice control, a keyboard virtual or not, or any device that allows the user to provide an indication of his activity. For example the user may select his activity in a list of activities. Advantageously, the user may provide information concerning his past activities and/or future activities.

If the device assessing fatigue is connected to a device currently used by the user as a Smartphone, or a personal computer, the activity may be automatically provided.

As indicated previously, the activity data are used by the visual fatigue determining module 10 when generating the visual fatigue information.

In the example represented on figure 2, the visual fatigue determining module 10 is embedded in the visual fatigue determining device 20.

However, as represented on figure 3, the visual fatigue determining module 10 may be a distant entity communicating with the visual fatigue determining device 20.

The visual fatigue determining device 20 communicates with a distant entity that comprises a visual fatigue determining module 10 according to the invention. Communication can be done through different communication devices and protocols, like Bluetooth, Zigbee, WiFi or others.

Furthermore, the communication unit may be configured to communicate with the distant entity either to store the measured features in a memory MEM or to provide information indicative of the visual behavior of the user.

Typically, the distant entity comprises a communication module 12 configured to communicate at least with the communication unit 38 of the visual fatigue determining device 20, a memory 14, at least one processor 16 and program instructions stored on a non-transitory computer-readable medium and executable by the at least one processor to execute the steps of the method of the invention.

The distant entity can include different computing objects such as personal digital assistants, audio/video devices, mobile phones, MPEG-1 Audio Layer 3 (MP3) players, personal computers, laptops, tablets, bluetooth headset, watch, wristband, etc... Each computing object and the head mounted device can communicate with one or more other by way of a communication network, either directly or indirectly. Even though illustrated as a single element in figure 3, network can include other computing objects and computing devices that provide services to the system of figure 3, and/or can represent multiple interconnected networks, which are not shown.

In a network environment in which the communications network/bus can be the Internet, the computing objects can be Web servers, file servers, media servers, etc. with which the client computing objects or devices communicate via any of a number of known protocols, such as the hypertext transfer protocol (HTTP).

According to an embodiment of the invention, the device can be in the form of a simple stick having graduations for distance measurement, one end of the stick is intended to be in contact with the chin of the person, and a target movable along the stick.

In this case, it is preferable that an operator look at the user so as to check if there is a loss of convergence (instead of asking the person if he/she experiment double vision) because of the possibility of suppression of one of the both eye image by the person.

According to an embodiment of the invention, the visual fatigue determining device may be a smartphone comprising the visual fatigue determining module.

The camera of the phone can be used to sense the distance corresponding to the near point of convergence and if the camera detects 6/8 cm it may display on the screen 'move back' that is, to start from further distance.

When the camera is at a distance greater than 9 cm, a 'correct distance' or

'proceed' may be displayed.

A target, for example a tower such as the Eiffel tower, may be displayed on the screen and the user looks at the tip of the tower and if tower appears single then click on button 'OK' on the screen and move to next closer distance and if target still appears single click on 'OK' and if double then click on 'double' tab. A message may appear on the screen 'moderate fatigue' - needs preventive measures. If the user pushes 'double' tab for the distance of 9 cm then 'severe fatigue' is displayed which implies, need for visual fatigue treatment.

The camera of the smartphone or touch pad is be able to sense the distance in different ways:

For example, the camera can be a stereo camera that is able to sense the 3D scene, and so determine the distance of the imaged environment,

Furthermore, the camera is a standard camera, and known dimension of an imaged object ( the head size of the person, or the pupil distance of the person) is provided, so that it is possible to scale the image.

Other means can be provided such as time of flight sensor or triangulation.

Another way for visual fatigue assessment may be instead of having the user push the button, is to have the camera arranged to sense when one of the eyes deviates more than the specified convergence range. Depending on the distance from eye to the camera, the user's visual fatigue level is either no fatigue, moderate or severe fatigue.

One advantage of measuring the loss of convergence using the camera is that the user could suppress one of the images of the R/L eye instead of having double vision, leading to incorrect result, whereas measuring with the camera the convergence of the both eye provides correct results in any cases.

Advantageously, the device of the invention can be used for a specific process of delivery a lens or service for attenuating visual fatigue.

For example, if the distance is in the risk range, antifatigue lens, lens reducing glare, lens reducing reflection, or visual training may be proposed to the user.

The visual fatigue determining device may be a smartphone and used sense pupilla microflucation.

We having the user look away, while a smartphone is tracking one eye pupilla at close distance (10cm-15cm). Doing that, one has a very high resolution of one eye and track with accuracy the pupilla size and resolves black iris eyes concerns, even without IR source. Software within the smartphone analyses microfluctuation and give fatigue results on the display.

As illustrated on figure 4, the invention further relates to a method of determining the visual fatigue level of a user, comprising:

- a visual behavior data receiving step S 1 ,

- an activity data providing step S2, and

- a processing step S3.

During the visual behavior data receiving step, visual behavior data indicative of the visual behavior of the user are received, typically by the communication component of the visual fatigue determining module 10 from the communication unit 38 of the visual fatigue determining device 20.

The received data are processed during the processing step to generate visual fatigue information indicative of the visual fatigue level of the user.

The method further comprises, prior to the processing step, an activity data providing step S2. During the activity data providing step S2 activity data indicative of the activity of the user are provided.

During the processing step S3 the visual fatigue information may be generated based on the visual behavior data and the activity data.

The invention also relates to a method for improving a visual fatigue determining module according to the invention.

As illustrated on figure 5, the method for improving a visual fatigue determining module comprises:

- a subjective fatigue level data providing step S10,

- a subjective visual behavior data receiving step SI 1, and

- an adapting step S12,

Subjective fatigue level data indicative of a subjective fatigue level are provided during the subjective fatigue level data providing step. The subjective fatigue level data may be provided by the user or a third party. As indicated previously such data relates to a subjective indication of the visual fatigue level of the user. Together with the Subjective fatigue level data, subjective visual behavior data are received during the subjective visual behavior data receiving step SI 1. The subjective visual behavior data are indicative of at least one visual behavior parameter of the user in the subjective fatigue level.

The computer executable instructions for processing the visual behavior data are adapted based on the subjective fatigue level data and the subjective visual behavior data during the adapting step SI 2.

The invention has been described above with the aid of embodiments without limitation of the general inventive concept.

Many further modifications and variations will suggest themselves to those skilled in the art upon making reference to the foregoing illustrative embodiments, which are given by way of example only and which are not intended to limit the scope of the invention, that being determined solely by the appended claims.

In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that different features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be advantageously used. Any reference signs in the claims should not be construed as limiting the scope of the invention.