Title : [Device and method for inspecting a hair sample

[0001 ] [The present invention relates to a device and method for inspecting a hair sample and / or a surface of the scalp of a person comprising hairs.

[0002] The device and method are particularly directed to the analysis and treatment of human hairs, and more particularly, is to be used in conjunction with a method and system for bleaching or dyeing hairs such as disclosed in document

EP0443741.

[0003] The health and beauty industry leverages advances in technology to improve the consumer experience with their products and services. There is a deep trend to offer products that are tailored to the user’s needs and fit its specific traits. This trend is generally called“personalization”.

[0004]“Personalization” can pertain to any body part but is of particular interest for exposed body parts such as the face (makeup or care products, in particular foundation) and scalp / hairs (care or dyeing products for example).

[0005] It is known to offer and recommend foundation makeup products based on at least one property of the user’s skin (such as“Le Teint Particulier”® by

LANCOME®). It is also known to offer and recommend hair products based on some properties of the hairs (see for example EP0443741 previously

mentionned, and documents W02004002300A2 and US9316580B2).

[0006]“Personalization” goes beyond the mere offering of a more or less broad

range of products corresponding each to a dedicated category of users, the challenge often being to be able to recommend the most appropriate product to the concerned user depending on its personal traits.

[0007] As detailed in the previously cited documents,“personalization” generally

comprises a first analysis step aiming at obtaining data that are specific to said user, the data being then used to determine an appropriate subsequent treatment and/or product(s) to be applied to the user concerned body part. [0008] Until recently, the analysis step was often used to be performed manually or visually by an expert such as a hairdresser or a beauty adviser. It is for example known to address the user with a specific questionnaire, the answers of which are used to determine the allegedly most suitable product (e.g US20140216492). Of course such a method is highly variable and lacks precision.

[0009] In order to improve the relevancy and reliability of the product

recommendation, some or all the steps may be performed using tools and devices and even be automated.

[0010] For example, obtaining data from the user’s concerned body part can be done through measurement using an appropriate measurement device (called a “reader”) for obtaining one or more specific features that are looked after for determining the appropriate treatment or product. An example of such a device is the CAPSURE reader marketed by X-RITE and able to return a color data code of the skin of a user (see for example document US20100328667 although it is not explicitly directed to skin or keratinous surfaces).

[0011 ] The collected data may then be fed (possibly with other additional data) to a computing unit that will help determining the most suitable product according to a at least one set of rules (rules of applications).

[0012] The subsequent treatment or product determined according to the collected data may be a ready-made product chosen from a catalogue or in a database (such as in documents US5478238 or US9519927 disclosing methods for finding a matching foundation products) or a personalized product, the composition of which has been determined based on the previously obtained data.

[0013] The recommended product may then be bought or ordered by the user. In case of a personalized product (or custom-made product), said personalized product may be then manufactured on site, directly at the point of sale, in the shop or in the beauty / hair salon by a device able to mix components according to the personalized composition and dispense said composition. The

personalized product may also be ordered by the user for a later delivery.

[0014] As a full example of such a system, the above mentioned document

US9316580B2 discloses a method of performing a customized treatment of keratinous fibers comprising a diagnostic step using an optical reader configured to acquire a spectrum of the hairs, said spectrum being used to compute a subsequent hair treatment composition, the appropriate composition being then made and dispensed by a corresponding device. One may also refer to document WO2011024160A1.

[0015] As mentioned above, obtaining reliable, objective and relevant data from the user may be particularly challenging. This is especially the case for hairs or scalp due to their specific texture and environment.

[0016] Depending on the desired information that are looked for, different techniques may be used.

[0017] Document KR-A1 -101456942 discloses a hair and scalp condition diagnostic device comprising a sensor unit to diagnose a user's hair or scalp condition objectively by comparing previously stored hair or scalp samples based on diagnosis signals diagnosed by a hair or scalp condition. In particular, the device may comprise an image sensor for acquiring images of an area of the scalp. The acquired images may then be processed through an image analysis module using for example light intensity recognition, color recognition or contrast analysis in order to determine some properties of the hairs such as number of hairs, diameter, etc.

[0018] Document WO2017207455 filed in the name of the present applicant also proposes a method for analyzing a condition of the scalp and / or hairs

comprising the step of taking pictures under different lighting conditions (white light and UV-Blue light), in order to improve detection of the hairs and better reveal light and white hairs. The images are then processed namely through contrast analysis in a complementary way.

[0019] Document US2012253203 discloses a method for imaging a skin surface

presenting hairs, such as an area of the scalp in order to determine a skin and hair growth condition. The method comprising taking pictures of the concerned surface under different viewing angles, said pictures being then potentially processed by computer analysis in order to determine properties such as number of hairs protruding from the skin surface, thickness of hairs, diameter or cross sectional shape of hairs, length of hairs protruding from the surface. [0020] Document US2009036800 pertains to a hair densitometer. The densitometer works by taking magnified pictures of an area of the scalp. Hairs visible in the image may be counted and measured by a technician or by any suitable automated system.

[0021 ] For such image based analysis methods using a device able to acquire an image of the desired keratinous surface, the quality of the acquired image is paramount and there is a general need to ensure the required quality of said image. This is particularly true for methods in which the acquired image is further processed through image analysis algorithms, in particular through image recognition algorithms or machine learning algorithms. Indeed, the results of such algorithms highly depend on the quality of the input image data.

[0022] This is also particularly true in the specific area of hair dyeing or bleaching, where a reliable and true diagnostic of the initial hair parameters (such as hair color) is paramount since it will have a strong impact on the final color to be obtained.

[0023] The present invention aims at providing an improved device for inspecting a scalp surface of a user comprising hair and / or a hair sample.

[0024] To this end, the present application pertains to a device comprising a housing in which an image sensor is arranged to receive measurement light emitted from a measuring area configured to accommodate the keratinous surface, through a measurement window in a front wall of the housing, over a corresponding imaging light path.

[0025] According to the present application, the device is further equipped with an illumination ring arranged in the housing rear of the measurement window around the imaging light path, said illumination ring having two opposed partially peripheral illumination portions separated by two opposed complementary partially peripheral non-illuminating portions, the illuminating portions being further configured to illuminate the measuring area through the measurement window over a illumination light path, said illumination light path having an angle of incidence on the measurement area comprised between 30 to 60°, preferably about 45°. According to the present application, the device is configured so that both illumination portions may be switched on when an image is taken. [0026] Simply said, Illumination is implemented using a“ring-light” with only two quarters facing each other in use in a 45:0 measurement configuration. It has been indeed found that by associating an image sensor for acquiring an image of the keratinous surface arranged in the measuring area, to a partial illumination ring alternating non-illuminating portions and illuminating portions (called“two quarters” illumination), it improved the overall image quality by preventing some undesired reflections.

[0027] Advantageously, the illuminating portions of the light ring extend over a sector of 30 to 60°, preferably over a sector of 45°.

[0028] Also, by using a 45:0 measurement, lighting collection is greatly improved.

0:45, 45:0 and sphere measurement are usually considered for

spectrophotometers but appears to be also important with an image sensor. Indeed, it appears that the main color information from the hairs is perceived in this configuration.

[0029] In the specific case of hairs, the hairs can be modelled by a cylindrical object and when illuminating along the hair axis, the specular light is reflected in a conical fashion. When illuminating at 45 degrees, this reflected cone has a 45 degree angle and does not enter the measurement window, and thus does not follow the imaging light path. Advantageously, the two dark quarters would be roughly perpendicular to the hair follicles and scatter light into the measurement window along the imaging light path if they were in use.

[0030] An arrangement according to the present application allows for the acquisition of images with a low specular reflection. An alternative standard method for doing this would be using cross polarization between the illumination and the lens. However, due to the birefringent nature of hair, it cannot be done.

[0031 ] In addition, having two-quarter illumination configuration blurs the shadows of the hair on the scalp compared to illumination from one or two 45 degree directions. The distinct shadows could otherwise be confused with hair follicles.

[0032] The two-quarter illumination configuration is also less sensitive to positioning relative to the hair. When measuring hair on scalp, the follicles have a general direction, but are not perfectly aligned. [0033] Although such an arrangement may be common with spectrophotometer, it is not known to be used with image sensor for image analysis.

[0034] Preferably, the measurement area is substantially located at the

measurement window, and in particular within a distance of less than 2mm of said measurement window, preferably about 1 mm.

[0035] Advantageously, the imaging light path is equipped with a telecentric lens, preferably a double telecentric lens.

[0036] A telecentric lens allows for an image acquisition from a single direction angle, similarly to the way a spectrophotometer collects light. This also allows to use the 45/0 degree illumination configuration using an imaging device.

[0037] In addition, the use of a telecentric lens results in less vignetting than a

regular lens and in more uniformity in acquisition of light over the whole image. A regular lens has a Q ^L 4 intensity dependence, while a telecentric one, Q ^L 2. Colour alteration is also reduced.

[0038] Telecentric lens also gives fringe benefit and lowers distortion over the image.

This allows for uniform geometrical measurements over the whole image, such as hair diameter, density, etc.

[0039] The telecentric lens may be telecentric on the image side or the object side (preferred), better be telecentric on both sides, i.e. double telecentric.

[0040] Double telecentric lens allows for an easier implementation of an hybrid

design having both a regular RGB sensor and a multispectral component.

Passing through a cube beamsplitter with a non telecentric design would result in image aberrations that can more easily be corrected with a telecentric design.

[0041 ] One will also note that in case of using dichroic bandpass filters, those are very sensitive to input angle. A telecentric design allows for an equal input angle over the whole filter particularly advantageous in the multispectral implementation using a multispectral image sensor.

[0042] Preferably, the imaging light path is equipped with a 0.5x magnification lens.

Such a magnification value is a good compromise between field-of-View, resolution, and depth of field. In the specific hair analysis application, hair diameter is on the order of 70 microns, and between 5 to 10 pixels across each hair is usually need in order to correctly process the image though an image analysis module. With a pixel pitch on the order of 5 microns, we are getting an object side resolution of 10 microns.

[0043] Preferably, the imaging light path is fixed focus.

[0044] Preferably again the depth of field is between 0.5mm and 1 mm.

[0045] Advantageously, the imaging light path has a telecentricity below 1 degree.

[0046] An aperture between f/8 and f/16 of the optical system (lens) may be

advantageously used resulting in a resolution of around the pixel size and importantly a depth of field of +/- 5mm to 10mm. When the system is fixed focus without an auto-focus mechanism, the large depth of field allows to capture images in focus over the whole hair and scalp range.

[0047] The illuminating portions may also be independently controlled. More

precisely, the illuminating portions may be independently switched on and off.

[0048] By taking pictures with separately illuminated portions, we can assess

additional information on the acquired images such as the hair damage by comparing the two images. For example, raised hair cuticles would result in different levels of scattered light in each direction.

[0049] In particular, at least one or both illuminating portions comprise each several light sources, said light sources preferably being configured to be independently controlled. The light sources may be LEDs, more specifically High-CRI white LEDs were used to cover the whole visible spectrum as well as possible. IR LED may be used such as OSRAM broadband NIR LEDs, with or without filters to block the visible part of the spectrum of the emitted light. LEDs advantageously have a fast shutter time that will minimize potential picture-blur caused by vibrations during exposure time, especially when the inspecting device is handheld.

[0050] Having independently controlled LEDs allows for different illuminating

geometries when imaging the keratinous surface, in particular hair roots near the scalp and hair lengths. When measuring hair lengths, the strands are much better behaved in their direction and can therefore be illuminated with a narrower range of light source (LEDs), lowering the specularity even more. Also there is no shadow to worry about with lengths.

[0051 ] In a specific embodiment, the imaging light path is substantially normal to the measurement area. After the measurement area, the light path may comprise one or several mirror diverting the light, preferably to a right angle (90°). This allows to a better and more compact design of the device. For example, the image sensor may be located in a handle and the measurement window be located in a viewing head of the device, said measurement window opening perpendicularly to a longitudinal axis of said handle.

[0052] Depending on the used image sensor and the desired light waves to be

acquired, the imaging light path may be equipped with at least one wavelength filter, said filter being preferably located at the sensor.

[0053] The image sensor may be chosen in the group consisting of: a multispectral sensor, an IR sensor, a visible light imagine sensor, a RGB image sensor.

[0054] The image sensor may comprise at least one member of the group consisting of: a charge coupled device (CCD) and a complementary metal oxide

semiconductor (CMOS).

[0055] In addition, the device comprises at least one electronic module configured to output the collected image data to a corresponding communication interface, preferably a wireless interface.

[0056] The invention also pertains to a system for inspecting a keratinous surface of a user, preferably a hair sample or a surface of the scalp comprising hairs, said system comprising a device according to the invention and at least one image analysis module arranged to process image data received from the device so as to output at least one real-valued characteristic property of the inspected keratinous surface. The image analysis module may be part of the device itself and output the property directly through a communication interface, preferably a wireless interface. The image analysis module may also be distinct from the device and located in a distant server or a distinct machine.

[0057] By“image analysis”, it is meant the extraction of meaningful information from images; mainly from digital images by means of digital image processing techniques such as machine vision or machine learning algorithms. It does not encompass processing the image to merely display it on a monitor. Of course, the acquired image(s) may still be displayed in addition to the image analysis processing.

[0058] The invention also relates to a system for formulating a custom mixed

cosmetic (namely hair, such as a hair dye formulation) treatment product in response to at least one user specific input criteria, said system comprising an inspecting system according to the invention for generating at least one of said input criteria and a plurality of cosmetically functional mixtures stored in separate containers, said mixtures being capable of combining to form a cosmetic (hair) treatment product, the system being configured to dispense two or more of the cosmetically functional mixtures each in an proportion and/or amount determined according to a recipe based on the user specific input criteria. More preferably, the product is prepared at a point of sale.

[0059] The present invention also pertains to a method for inspecting a keratinous surface of a user, preferably a hair sample or a scalp surface comprising hairs, comprising the steps of :

- providing a device according to the invention so that the keratinous surface to inspect is located in the measurement area of the device,

- take at least one image of the keratinous surface to inspect.

[0060] More specifically, the keratinous surface is a hair strand that is placed in the measurement area. Preferably, the hair strand is arranged so that the hairs are generally orientated in a direction transverse to an axis of the illuminating portions. In another or complementary embodiment, the keratinous surface is a scalp surface comprising hairs, said hair being preferably parted along a partition line orientated in a direction transverse to an axis of the illuminating portions.

[0061 ] Illumination time may be between 30 and 200ms, preferably between 50 and 200 ms.

[0062] Image(s) may be taken with both illuminating portions switched on (preferred), and/or with each illuminating portion alternatively switched on and off in sequence.

[0063] The invention also relates to a method for analyzing a keratinous surface of a user comprising the steps of inspecting said keratinous surface according to the previous method and process the at least one acquired image data in a system according to the invention so as to output at least one real-valued characteristic property of the inspected keratinous surface.

[0064] The invention also relates to a method for formulating a custom mixed

cosmetic, preferably hair, treatment product, namely a hair coloration product, in response to at least one user specific input criteria, said method comprising the steps of analyzing a concerned keratinous surface of a user according to the previous method so as to obtain said user specific input criteria, and dispense two or more cosmetically functional mixtures each in an proportion and/or amount determined according to a recipe based on the user specific input criteria by using a system for formulating according to the invention.

[0065] The subject of the present application will be better understood in view of the following detailed description made in reference with the attached drawings in which:

[Fig 1 ] generally illustrates a system for making a personalized hair coloration cosmetic product comprising a device for inspecting an area of the scalp of a user comprising hairs and a device for dispensing cosmetically functional mixtures, namely dyes and oxidating creams, making up for the personalized product.

[Fig 2] is a schematic view of the device for inspecting hair sample according to the present invention as used in the system of figure 1.

[Fig 3] is a side view of the imaging light path inside the device of figure 2,

[Fig 4] is an internal side view of the measuring head of the device of figure 2,

[Fig 5] is an isolated view of the illumination ring equipping the device of figure 2, [Fig 6] is a schematic view of the lighting arrangement and lighting orientation of the LED in the illumination ring of figure 5,

[0066] Figure 1 schematically shows a system 1 for formulating a custom mixed

cosmetic hair coloration product in response to at least one user specific input criteria, such as hair tone h.

[0067] The system 1 comprises, on the one hand, a hair inspection device 100, also generally called hair reader, and on the other hand a dispensing device 300 carrying a plurality of cosmetically functional mixtures stored in separate containers.

[0068] More precisely, the dispensing device 300 carries a set of different hair dyes 301 and a set of oxidant base cream products 302 for mixing with the selected hair dyes in order to yielding a custom coloration product to be applied on the hairs of a customer.

[0069] The dispensing device 300 is equipped with a control board (not visible) able to selectively dispense each cosmetic product in a proportion and/or amount determined according to a recipe based on the user specific input criteria h obtained from the inspection device 100. The products are dispensed in a mixing bowl 303 where the mixture can be homogenized before application on the hair of the user.

[0070] For more details about such a system, one may refer to documents

EP0443741A1 and US9316580B2 previously cited.

[0071 ] The inspection device 100 is part of an inspection system 200 for inspecting a hair sample 10 of a customer. Hair sample 10 is actually a surface of the scalp comprising hairs 11 , but may also be a hair strand depending namely on whether we want to inspect the roots or the fiber of the hairs 11.

[0072] Inspection is performed preferably in vivo, i.e. directly on the head of the

customer. To this end, the reader or inspection device 100 is associated with a processor arranged to process image data / received from the device 100 so as to output the at least one real-valued characteristic property h of the inspected keratinous surface.

[0073] The processor may be part of the inspection device 100 or be located on a distant server (not shown), acquired image data / being sent, preferably wirelessly, to the processor for image analysis.

[0074] Preparation of a custom coloration product is generally performed as follow.

[0075] First the hair reader or hair inspection device 100 is used to acquire at least an image / of the customer’s hair, namely an image of a scalp portion 10 comprising hairs 11. The acquired image data / is sent to a processor to perform an image analysis algorithm and extract a relevant user specific data about the hair sample. User specific characteristic may for example be one or several parameters among hair count, hair density, hair diameter, hair color, percentage of white hairs, ... and hair tone h.

[0076] Of course the image reader may acquire several images so that the processor may give better results. For example, the processor may use several images taken at the same location or use several images taken at different locations (hair roots and hair tips for example or forehead / backhead / tophead).

[0077] The user specific parameter or parameters h are then sent to another or same processor as input data of an algorithm configured to formulating a hair coloration composition based on said parameters and a target color according to at least one set of application rules depending on at least the user specific parameter(s).

[0078] For more details about such a system, one may refer to documents

EP0443741A1 and US9316580B2 previously cited and hereby integrated by reference.

[0079] A schematic example of the hair reader or hair inspection device 100 is shown on figure 2. The hair reader comprises a housing 110 (dotted line) in which an image sensor 150 is arranged to receive measurement light emitted from a measuring area 160 configured to accommodate the hair sample 10, through a measurement window 103 in a front wall of the housing 110, over a

corresponding imaging light path 166.

[0080] More specifically, the housing is substantially longitudinal and comprises a handle 101 (rear) and an opposite head 102 (front) accommodating said measurement window 103. The measurement window 103 is laterally arranged for ergonomic reasons and opens perpendicularly to a longitudinal axis of the handle 101. The image sensor 150 is located in the handle with most of the other electronic elements. A mirror 165 located inside the head 102 of the device 100 allows for the change of direction of the light path 166 between the measurement window 103 and the image sensor 150, so that the measurement light entering the measurement window 103 is correctly directed to the image sensor 150, roughly at 90° in the exemplified case. Of course, other orientation of the handle with regard to the measuring head are possible. [0081 ] The device 100 is further equipped with an illumination ring 105 arranged in the housing 110 rear of the measurement window 103 around the imaging light path 166, said illumination ring 105 having two opposed partially peripheral illumination portions105a separated by two opposed complementary partially peripheral non-illuminating portions 105b.

[0082] More precisely, the illumination ring 105 is made from a support plate 115 able to be secured inside the housing 110 and which presents a central orifice allowing the imaging light path 166 to go through. The support plate 115 supports a set of light sources, in the present case LEDs 118, arranged around the imaging light path 166 so as to constitute semi-peripheral illuminating portions 105b. Non illuminating portions 105b are parts of the support ring 115 deprived from light sources.

[0083] As shown, the illuminating portions 105a are arranged so that they each

extends transversally to the longitudinal axis of the handle 101. As previously mentioned, when inspecting, the hairs will be preferably arranged so to have a general longitudinal axis extending along the longitudinal axis of the device, i.e. transvers to the illuminations portions 105a.

[0084] The illuminating portions 105a are further configured to illuminate the

measuring area 160 through the measurement window 103 over a illumination light path 155, said illumination light path 155 having an angle of incidence of about 45° thus yielding an 45:0 illumination configuration.

[0085] In order to achieve this configuration, the light sources (LEDs 118) are

mounted on the support ring 115 so as to have the desired inclination and so that their illumination cone is directed toward the measuring area with the desired angle of incidence. In an alternate embodiment, proper angle of incidence may be obtained by way of lenses directing the light emitted from the light sources in the desired direction.

[0086] As visible on figure 3, the measurement area 160 is substantially located at the measurement window 103. In use, the hair sample shall be preferably maintained against the measurement window 103, for example by using some clamping system or by slightly pressing the measuring head against the scalp surface of the user. [0087] As previously mentioned, the imaging light path 166 goes through a double telecentric lens 108 before reaching the image sensor 150. As shown, the double telecentric lens is located in the handle 101 of the device between the mirror 165 and the image sensor 150. The image light path 166 also goes through a 0.5x magnification lens 109 located at the entrance of the telecentric lens 108 and part of said telecentric lens 108.

[0088] The various optical elements are chosen so that the imaging light path 166 is fixed focus and the depth of field is between 0.5mm and 1 mm. In addition, the imaging light path has a telecentricity below 1 degree.

[0089] The device 100 also carries a control board for piloting all or some of the

various elements and namely manage the illumination ring while taking pictures.

[0090] The device 100, and more particularly its control board, is configured so that the illuminating portions 105a may be independently controlled, thus allowing to take pictures with both illuminating portions 105a light up or only one of them. In the latter case, the device 100 will advantageously take at least two pictures, one for each illuminating portion subsequently on.

[0091 ] Advantageously, the light sources LEDs 118 forming the illuminating portions may be independently controlled Device according to any one of claims 1 to 9, characterized in that at least one or both illuminating portions comprise each several light sources, said light sources preferably being configured to be independently controlled.

[0092] The electronic control boar of the device 100 also includes an electronic

module configured to output the collected image data to a corresponding communication interface with the image analysis module (external).