Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
ADVANCED PATHOLOGY LABORATORY GLASSES
Document Type and Number:
WIPO Patent Application WO/2021/194456
Kind Code:
A1
Abstract:
The invention relates to protective laboratory glass (1), which is a candidate to become indispensable for pathology laboratories with unique solutions to the problems related to the macroscopy process in pathology, comprising the computer (2) where the files will be shared or moved with a memory card and the report will be received, at least one camera (3), at least one microphone (4), at least one bone conduction Bluetooth headset (5), Wi-Fi and Bluetooth module (6), an open-source code to convert API-providing audio to text (7), a neural network and related data sets to be used in deep learning (8), a diseased tissue that needs to be studied (9), and an expert pathologist (10).

Inventors:
FARMANLI ORKHAN (TR)
KARATAŞ İHSAN (TR)
Application Number:
PCT/TR2021/050266
Publication Date:
September 30, 2021
Filing Date:
March 25, 2021
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
GOEKDEMIR CIHAN (TR)
FARMANLI ORKHAN (TR)
KARATAS IHSAN (TR)
International Classes:
G02B27/01; G02C11/06; G16H15/00; A61B1/00; G06F3/16; G10L15/06
Other References:
MITRASINOVIC, STEFAN ET AL.: "Clinical and surgical applications of smart glasses", TECHNOLOGY AND HEALTH CARE, vol. 23, 21 July 2015 (2015-07-21), pages 381 - 401, XP055862928, DOI: 10.3233/ THC-150910
ALBRECHT, U. V ET AL.: "Google Glass for documentation of medical findings: evaluation in forensic medicine", JOURNAL OF MEDICAL INTERNET RESEARCH, vol. 16, no. 2, 12 February 2014 (2014-02-12), pages e53, XP055862930, DOI: https://doi.org/10.2196/jmir.3225
AJAMI S: "Use of speech-to-text technology for documentation by healthcare providers", THE NATIONAL MEDICAL JOURNAL OF INDIA, vol. 29, no. 3, 2016, pages 148 - 152, XP055862932
Attorney, Agent or Firm:
DESTEK PATENT INC (TR)
Download PDF:
Claims:
CLAIMS

1. The invention is an "Advanced Pathology Laboratory Glass," (1) characterized by comprising;

- the computer (2) where the files will be shared or moved with a memory card and the report will be received,

- at least one camera (3),

- at least one microphone (4),

- at least one bone conduction bluetooth headset (5),

- wi-fi and bluetooth module (6), - open source code to convert API-providing audio to text (7),

- neural network and related data sets to be used in deep learning (8),

- diseased tissue that needs to be studied (9) and,

- an expert pathologist (10).

Description:
ADVANCED PATHOLOGY LABORATORY GLASSES

Technical Field

The invention relates to a laboratory glasses that can be used in pathology laboratories and similar type of laboratories, having feature of recording image, sound and converting sound to text.

Prior Art

Pathology is a branch of medicine, meaning the science of diseases. The diseases that occur in tissues and cells are diagnosed using special tests. Before looking at the samples (tissues, organs, biopsies, etc.) that come to the laboratory under the microscope, the pathologists sample them in the macroscopy rooms. They describe the tissues and organs before sampling, after the necessary description is done, the sampling phase proceeds. The importance of macroscopy in diagnosis is very high. An incomplete macroscopic description and sampling result is incorrect and incomplete diagnoses. Definition of macroscopy includes a description of the size, the colour of organs and tissues, the surgical procedure, overlying tumours, and similar lesions. In particular, accurate identification of lesions is of great importance in terms of a second person who will read the report can picture them in their mind, and the doctors can understand what kind of lesion they are facing when looking with a microscope. Therefore, when making a macroscopic description, it is very important to give an adequate and explanatory description so that the person who will read this description can envision it. But unfortunately, limited time and sometimes inadequate description of complex lesions cause problems. In particular, disputes arise between assistant doctors and teaching doctors.

In the current technique, a description is made by looking at pre-prepared templates when sampling organs and tissues in pathology laboratories; but sometimes, issues are faced in organs and tissues that are not included in the template for anatomical variation and/or pathological reasons and are difficult to describe. Another problematic issue is that the described lesion cannot be visualized while being read by a second person. In the current technique, when making a macroscopic description, we need to note what we see on a template or submitted patient files. This causes inappropriate results in terms of sterility. To avoid this, we ask a second person to write down what we have said, which is often not possible under laboratory conditions, and they have to take notes with bloody, surgical stained gloves. This, in turn, causes image pollution and problems with sterilization.

As a result, due to the disadvantages described above and the insufficiency of the current solutions, the necessity to produce pathology glasses called here "Advanced Pathology Laboratory Glasses" is arisen.

Brief Description of the Invention

The present invention relates to the laboratory glass to be used in pathology laboratories that meet the above-mentioned requirements, eliminates all disadvantages, and brings some additional advantages.

The main aim of the invention is to provide a more descriptive and understandable macroscopic description of organs and tissues, to ensure that the descriptions made can be noted quickly without causing the issue of sterilization and without requiring a second person.

Another aim of the invention is to shorten the time of description and writing.

Another aim of the invention is to ensure that macroscopic images and written texts regarding the organs or tissues of the patient are archived electronically.

The structural and characteristic features and all advantages of the invention outlined in the drawings below and in the detailed description made by referring to these figures will be understood clearly; therefore, the evaluation should be made by taking these figures and detailed explanations into consideration.

Brief Description of the Figures

The "Advanced Pathology Laboratory Glasses", which is the subject of this application, is shown in Figure-1 below, and the explanations of the reference pictures are also seen in the next section. Reference Numbers

Our invention titled "Advanced Pathology Laboratory Glasses", which is the subject of this application, consists of the following parts;

1 . Laboratory glasses

2. Camera

3. Microphone

4. Wi-Fi connection

5. Charging input

6. Memory card input

7. Bone conduction Bluetooth headset

Detailed Description Of The Invention

In this detailed description, the "Advanced Pathology Laboratory Glasses" of the invention is explained only for a better understanding of the subject matter and without any restrictive effect.

Also, some elements or process steps prepared to provide a better understanding of the invention may have been used in different ways to ensure the integrity of meaning within the sentence. The elements or process steps used in different expressions actually represent the same numbered corresponding element or process step.

The "Advanced Pathology Laboratory Glasses" of the invention comprises;

• Laboratory glasses with a camera and microphone necessary for the pathologist to take a photo of the pathological area on the sample instantly and make explanations.

• The pathologists will take pictures via voice commands with the "Advanced Pathology Laboratory Glasses," that are connected to the computer in the laboratory with the help of Wi-Fi or Bluetooth, without using their hands, and will make the necessary explanation from the microphone. Their speech will be converted to text on the computer and reported in the format of Office Word.

• Open source codes will be used to convert sound into writing. For the prototype, programs that provide APIs in this regard will be used. In the next development, a neural network will be designed and trained to understand medical terms and translate them into writing.

• In the prototype stage, photographs will be taken with voice commands and sent to the computer. When mass production is started, training data will be arranged with experts in the field of pathology, and these data sets will be labelled. A network design will be made for this data set with experts in the field of deep learning. With this designed neural network, training will also be carried out on the data set.

• When the training process is finished, the photographs taken with the voice command will pass through the trained neural network, anomaly detection will be made, and the areas found pathological will be taken into a box and uploaded as pictures to the Office Word. Besides, the model trained for sound will also convert the sound into text, converting each desired sample into a report.

Pathology glasses (1); an element used by experts to look at the abnormal appearance of pathological organs with the naked eye or under a microscope.

Camera (2): an element attached to the pathology glasses and used to photograph the desired parts.

Microphone (3): an element attached to pathology glasses and used to receive and transmit or record audio.

Memory card: an element to be used for saving and storing photos and desired sounds.

Battery: an element that will provide the necessary energy for the system to work.

Charger: an element necessary for charging the battery and operating without the battery, although it can also work with a battery.

Wi-Fi and Bluetooth module: although photos and audio can also be recorded on their own, they are necessary elements for data to be shared with the computer in the laboratory at any time.

Bone Conduction Bluetooth Headset: an element that allows you to answer incoming calls to the phone via the Bluetooth headset that it has without removing the lab glove. Working Principle of The "Advanced Pathology Laboratory Glasses" subject to invention:

There are pathological organs that need to be photographed and interpreted and shared with the necessary places and on which an expert team must work. These should be discussed and exchanged instantly by experts all over the world.

While the pathologists examine the pathological organ, simultaneous picturing and interpretation of this organ's pathology slow down the work considerably. Besides, it is important to use photographs in transferring information and photography to overcome the problems caused by the microscopic image, which is currently tried to be conveyed with hand-drawn pictures.

In the prototype stage, the sound-triggered camera will take and save photos of the desired locations and send them to the computer if desired.

Open source code will be used to convert sound to text with a microphone that will be used in the prototype stage.

Photos and audio taken and sent will be reported in Office Word, and more reliable results will be presented.

In the next step, anomaly detection will be made in the photos taken with the trained models and dangerous areas will be identified and shared. With models trained for sound, the pathologist's voice will be more accurately converted into writing and reported.

Application Of The Invention To Industry

The invention has features that can be easily used in all pathology laboratories and become indispensable for pathologists. All of these features are mentioned in the detailed descriptions above.