Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SYSTEM AND METHOD FOR INSTALLING BONE HARDWARE OUTSIDE AN END-EFFECTOR'S TOOL PATH
Document Type and Number:
WIPO Patent Application WO/2019/108925
Kind Code:
A1
Abstract:
A system and method are described herein for installing hardware in a bone outside an end-effector's tool path prior to modifying the bone. The method includes the installation of a first piece of hardware in the bone. The bone and a cut volume to be created in the bone is registered to a computer-assist device. A processor calculates whether the hardware is within the cut volume based on the geometry and POSE of the hardware relative to the POSE of the cut volume. A user is notified if the hardware is at or inside the cut volume based on the calculation. If so, a second piece of hardware is installed in the bone and the calculation is repeated to determine if the second piece of hardware is at or inside the cut volume. The surgical procedure may commence when an installed piece of hardware is installed outside the cut volume.

Inventors:
TORABI MEYSAM (US)
CIPRIANO ROSE (US)
Application Number:
PCT/US2018/063296
Publication Date:
June 06, 2019
Filing Date:
November 30, 2018
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
THINK SURGICAL INC (US)
International Classes:
A61B34/20; A61B17/17; A61B34/10; A61B34/35; A61B90/00; A61F2/46
Foreign References:
US6711432B12004-03-23
US20080033442A12008-02-07
US20120010710A12012-01-12
US20160125603A12016-05-05
US20160135890A12016-05-19
Other References:
See also references of EP 3716878A4
Attorney, Agent or Firm:
GOLDSTEIN, Avery N. (US)
Download PDF:
Claims:
CLAIMS

1. A method for installing hardware in a bone at locations outside and tool path of an end-effector prior to modifying the bone, comprising;

installing a piece of hardware in the bone;

registering a position of the bone and a cut volume to a computer assist device;

digitizing a first position of said first piece of hardware with a digitizer probe having a probe tip;

calculating, with a processor, a first position of the first piece of hardware relative to the cut volume;

notifying a user whether the first piece of hardware is at or inside the cut volume of the bone based on the calculations;

installing a second piece of hardware in the bone at a second position in the bone if the first piece of hardware is at or inside the cut volume;

digitizing the second piece of hardware;

calculating, with a processor, if the second piece of hardware is at or inside the cut volume; and

utilizing the second piece of hardware for a computer- assisted surgical procedure if the second piece of hardware is outside the cut volume as determined by the calculation.

2. The method of claim 1 wherein the first piece of hardware is a first set of recovery markers, and the second piece of hardware is a second set of recovery markers, wherein the method further comprises:

installing a first set of recover markers in the bone;

registering a position of the bone and a cut volume to a computer assist device;

digitizing a first position of said first set of recovery markers with a digitizer probe having a probe tip;

calculating, with a digital processor, a first position of one or more recovery markers in the first set of recovery markers relative to the cut volume;

notifying a user whether one or more markers in the first set of recovery markers is at or inside the cut volume of the bone based on the calculations;

installing a second set of recovery markers in the bone if one or more of the markers in the first set of recovery markers are at or inside the cut volume, where the first set of recovery markers remain in the bone to re-register the bone when there is bone motion while installing the second set of recovery markers on the bone;

digitizing the second set of recovery markers;

calculating, with the processor, a second position of one or more recovery markers in the second set of recovery markers relative to the cut volume;

removing the first set of recovery markers when the second set of recovery markers are installed outside the cut volume; and

utilizing the second set of recovery markers during the procedure to recover the registration of the bone.

3. The method of claim 1 wherein the digitizing steps are accomplished with a measurement system that is at least one of: an electro-mechanical sensor arm, an optical tracking system with an optically tracked probe, an electro-magnetic tracking system, an ultrasound tracking system, or an imaging system.

4. The method of claim 3 wherein said imaging system is at least one of computed tomography (CT), X-ray, fluoroscopy, ultrasound, or magnetic resonance imaging (MRI).

5. The method of claims 1 to 4 wherein the calculation utilizes a point- distance algorithm that determines a distance between a plurality of points along a length of the one or more markers in the first or second set of recovery markers relative to the cut volume.

6. The method of any one of clams 1 to 4 wherein the surgical procedure is computer-assisted total joint replacement (TJR) surgery.

7. The method of any one of clams 1 to 4 wherein the first position and the second position are digitized as one or more physical coordinates in three- dimensional space.

8. The method of any one of clams 1 to 4 wherein at least one of said first recovery marker or said second recovery marker further comprises a divot.

9. The method of any one of clams 2 to 4 wherein said first recovery marker or said second recovery marker is a groove recovery marker, the groove recovery marker further comprising a bone engaging portion, a proximal portion for engaging a driver tool, and a groove between the bone engaging portion and the proximal portion.

10. The method of any one of clams 1 to 4 wherein the digitizing steps are conducted with a mechanical digitizer that is integrated to a base of a robotic arm for a robotic surgical system to perform the surgical procedure on the bone.

11. The method of claim 1 further comprising a user navigating said probe tip in a direction along the surface of the bone to locate a position for said second set of recovery markers that is outside the cut volume.

12. The method of claim 11 wherein a feedback mechanism provides feedback to the user in the form of a visual signal displayed on a monitor.

13. The method of claim 12 wherein the visual signal further comprises lights, a written notification, a symbol notification, or a combination thereof.

14. The method of claim 12 wherein the monitor displays a distance calculator.

15. The method of claim 11 wherein the feedback mechanism is in the form of an acoustic signal.

16. The method of claim 12 wherein the feedback mechanism is in the form of a haptic signal.

17. The method of any one of claims 1 to 4 wherein said calculating steps are accomplished in real-time.

18. The method of claim 1 wherein the first piece of hardware and second piece of hardware is at least one of a screw, a pin, a recovery marker, a tack, a probe, a clamp, or a retractor.

19. A system for implementing the method of claim 1 during a surgical procedure, said system comprising:

one or more pieces of hardware to be installed in the bone;

a computer assisted surgical system having a processor and memory, said memory storing a surgical plan having a cut volume defined relative to a bone model;

a digitizer in communication with the surgical system for collecting points in physical space; and one or more software modules for execution by said processor, wherein said software module when executed by the processor causes the processor to:

register the cut volume relative to the bone based on a plurality of points collected on the bone by the digitizer;

calculate a first position of a first piece of hardware installed in the bone relative to the cut volume based on one or more points digitized on the first piece of hardware;

notify a user if the first piece of hardware is at or inside the cut volume of the bone based on the calculations;

instruct the user to install a second piece of hardware in the bone if the first piece of hardware is at or inside the cut volume;

calculate if the second piece of hardware installed in the bone is at or inside the cut volume; and

execute a surgical task if the second piece of hardware is outside the cut volume as determined by the calculation.

20. A system for implementing the method of claim 2 during a surgical procedure, said system comprising:

one or more pieces of hardware to be installed in the bone;

a computer assisted surgical system having a processor and memory, said memory storing a surgical plan having a cut volume defined relative to a bone model; a digitizer in communication with the surgical system for collecting points in physical space; and

one or more software modules for execution by said processor, wherein said software module when executed by the processor causes the processor to:

register the cut volume relative to the bone based on a plurality of points collected on the bone by the digitizer;

calculate a first position of one or more recovery markers in the first set of recovery markers relative to the cut volume based on one or more points digitized on one or more markers in the first set of recovery markers; notify a user if one or more markers in the first set of recovery markers is at or inside the cut volume of the bone based on the calculations; instruct the user to install a second set of recovery markers in the bone if one or more markers in the first set of recovery markers is at or inside the cut volume; re-register the bone using digitized points collected on the first set of recovery markers while installing the second set of recovery markers in the bone if there is bone motion while installing the second set of recovery markers on the bone;

calculate a second position of one or more recovery markers in the second set of recovery markers relative to the cut volume; and

utilizing the second set of recovery markers during the procedure to recover the registration of the bone if the second set of recovery markers are outside the cut volume.

Description:
SYSTEM AND METHOD FOR INSTALLING BONE HARDWARE OUTSIDE AN END-EFFECTOR’S TOOL PATH

TECHNICAL FIELD

[0001] The present invention generally relates to the field of computer-assisted orthopedic surgery, and in particular to installing hardware on a bone at locations that will avoid colliding with an end-effector tool of a computer-assisted orthopedic device as the end-effector tool prepares the bone to receive an implant.

BACKGROUND

[0002] Throughout a lifetime, bones and joints become damaged and worn through normal use, disease, traumatic events, or a combination thereof. Arthritis is a leading cause of joint damage that leads to cartilage degradation, pain, swelling, stiffness, and bone loss overtime. Arthritis can also cause the muscles articulating the joints to lose strength.

[0003] If the pain associated with the dysfunctional joint is not alleviated by less- invasive therapies, a joint arthroplasty procedure is considered as a treatment. Joint arthroplasty is an orthopedic procedure in which an arthritic or dysfunctional joint surface is replaced with an orthopedic prosthesis.

[0004] The accurate placement and alignment of an implant is a large factor in determining the success of joint arthroplasty. Even a slight misalignment of the implant may result in poor wear characteristics, reduced functionality, decreased prosthetic longevity, or a combination thereof. [0005] In order to achieve accurate implant placement and alignment, a cutting tool (e.g., a saw, drill, end-mill, reamer) is accurately positioned relative to the bone prior to making any bone cuts and/or modifications. In some methods, a cutting jig or alignment guide may be used to accurately position and orient a cutting tool. In still other conventional methods, the cuts may be made using a computer-assist device (e.g., a surgical robot) that controls a cutting tool. When a computer-assist device is used to make the cuts, the bone’s position and orientation (POSE) must be known precisely in three-dimensional space relative to the computer- assist device to ensure that the cuts and/or modifications are made in the correct location. Several methods to determine the POSE of a bone relative to a computer-assist device are known in the art such as the registration methods described in U.S. Pat. No. 6,033,415 and U.S. Pat. No. 5,951,475.

[0006] However, bone motions during the process of cutting may generate cutting inaccuracies during the procedure if the bone is assumed to be fixed with respect to the computer-assist device. Should a sufficient amount of bone motion occur, it is then necessary to immediately stop the cutting operation and restart the cutting procedure after re-locating the position of the bone with respect to the computer-assist device.

[0007] In order to facilitate the process of restoration of the registration after bone motion occurs, a system and method using recovery markers placed on the bone may be employed as described in U.S. Pat. No. 6,430,434. These recovery markers can be used to re-register the bone and track bone motion over time by simply re-digitizing the location of the recovery markers. In this conventional method however, a user installs the recovery markers at any desired location and depth on the exposed bone. Therefore, the recovery markers may be unknowingly installed at a position on the bone that may collide with autonomous or semi- autonomous movements of an end-effector tool controlled by a robotic arm. The placement of a portion of the recovery marker so as to be unintentionally positioned in the tool path of the end-effector can prove problematic. If the end-effector collides with the recovery marker while preparing the bone to receive the prosthesis, several problems can arise, illustratively including: the procedure being interrupted; the end-effector may be damaged in the collision; and the recovery marker now needs to be removed from the bone, re-installed at a new location, and the bone fully re-registered before the procedure can continue. In the event that any of these problems occurs, the procedure is delayed and the patient subjected to additional time under anesthesia.

[0008] It will be appreciated that many other orthopedic procedures require the use of hardware to be installed on the bone. For example, a computer-assisted surgical system may require the use of tracking array to be installed on the bone to track the bone with an optical tracking system. It is just as likely for the tracking array to be installed in an end-effectors toolpath.

[0009] Thus, there is a need in the art for a system and method to aid a surgical team in installing hardware on a bone outside an end-effectors tool path prior to modifying the bone. SUMMARY OF THE INVENTION

[0010] A method for installing hardware in a bone at locations outside and tool path of an end-effector prior to modifying the bone are described herein. The method includes the installation of a piece of hardware in the bone. The position of the bone and a cut volume is register to a computer-assist device. A first position of the first piece of hardware is digitized with a digitizer probe having a probe tip. A processor calculates a first position of the first piece of hardware relative to the cut volume. A user is notified if the first piece of hardware is at or inside the cut volume based on the calculation. If the first piece of hardware is at or inside the cut volume, a second piece of hardware is installed in the bone. The second piece of hardware is digitized. The processor calculated a second position of the second piece of hardware relative to the cut volume. If the second piece of hardware is outside the cut volume, then the second piece of hardware is used for a computer- assisted surgical procedure.

[0011] The first piece of hardware may be a first set of recovery markers and the second piece of hardware may be a second set of recovery markers. The method may then include the installation of the first set of recovery markers in the bone. A position of the bone and a cut volume are register to a computer-assist device. A first position of the first recovery markers are digitized with digitizer probe having a probe tip. A processor calculates a first position of one or more recovery markers in the first set of recovery markers relative to the cut volume. A user is notified if the first set of recovery is at or inside the cut volume of the bone based on the calculations. A second set of recovery markers are installed in the bone if one or more markers in the first set of recovery markers are inside the cut volume. The first set of recovery markers remain in the bone for re-registration if the bone moves while installing the second set of recovery markers. The second set of recovery markers are digitized. The processor calculates if one or more markers in the second set of recovery markers is at or inside the cut volume. If the second set of markers are outside the cut volume, the first set of marker are removed and the second set of markers are used for re-registration during the surgical procedure.

[0012] A system for implementing the above method is also described herein. The system includes the following. One or more pieces of hardware are provided to be installed in the bone. A computer-assisted surgical system having a processor and memory for executing a surgical procedure. The memory has a surgical plan stored therein having a cut volume defined relative to a bone model. A digitizer is in communication with the surgical system for collecting point in physical space. The memory further includes one or more software modules to be executed by the processor. The one or more software modules when executed by the processor cause the processor to perform the following actions. Register the cut volume relative to the bone based on a plurality of points collected on the bone by the digitizer. Calculate a first position of a first piece of hardware installed in the bone relative to the cut volume based on one or more points digitized on the first piece of hardware. Notify a user if the first piece of hardware is at or inside the cut volume of the bone based on the calculations. Instruct the user to install a second piece of hardware in the bone if the first piece of hardware is at or inside the cut volume. Calculate if the second piece of hardware installed in the bone is at or inside the cut volume. Execute a surgical task if the second piece of hardware is outside the cut volume as determined by the calculation.

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Examples illustrative of embodiments of the present invention are described below with reference to figures attached hereto. In the figures, identical structures, elements or parts that appear in more than one figure are generally labeled with a same numeral in all the figures in which they appear. Dimensions of components and features shown in the figures are generally chosen for convenience and clarity of presentation and are not necessarily shown to scale. The figures are listed below.

[0014] FIG. 1 depicts a flowchart of a method to aid a surgical team in installing a set of recovery markers at one or more locations on a bone that ensures the markers avoid colliding with an end-effector tool of a computer-assisted device;

[0015] FIG. 2A depicts a prior art point recovery marker;

[0016] FIG. 2B depicts a prior art groove recovery marker;

[0017] FIG. 3 depicts a first set of recovery markers installed on a bone at a location inside a volume of bone to be removed in accordance with embodiments of the invention;

[0018] FIGs. 4A - 4B, visually depicts an algorithm to determine if a recovery marker is located inside a volume of bone to be removed (i.e., a cut volume) in accordance with embodiments of the invention, where FIG. 4A depicts the relative distance of a first point on the recovery marker relative to the cut volume, and FIG. 4B depicts the relative distance of a second point on the recovery marker relative to the cut volume;

[0019] FIGs. 5 A - 5C depict several feedback mechanisms to notify a user when a set of recovery markers are located on or inside a cut volume, where FIG. 5 A depicts a visual signal, FIG. 5B depicts an audible signal, and FIG. 5C depicts a haptic signal in accordance with embodiments of the invention;

[0020] FIG. 6 depicts a first set of recovery markers installed on a volume of bone to be removed and a second set of recovery markers installed outside of a volume of bone to be removed in accordance with embodiments of the invention;

[0021] FIG. 7 depicts a tracking array installed inside a volume of bone to be removed in accordance with embodiments of the invention; and

[0022] FIG. 8 illustrates a surgical system in the context of an operating room (OR) in accordance with embodiments of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0023] The present invention has utility as a system and method for aiding a surgical team in installing a set of recovery markers on a bone at locations outside an end-effector’s tool path prior to modifying the bone. The present invention has further utility in providing the surgical team with the ability to re-register the bone in the event bone motion occurs while installing a second set of recovery markers on the bone, if needed. It should be appreciated, that although the installation of recovery markers is described herein, the method is equally useful and advantageous for installing other hardware (e.g., optical tracking arrays) on the bone at locations that ensure the hardware is installed outside of an end effector’ s tool path. [0024] The present invention will now be described with reference to the following embodiments. As is apparent by these descriptions, this invention can be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. For example, features illustrated with respect to one embodiment can be incorporated into other embodiments, and features illustrated with respect to a particular embodiment can be deleted from that embodiment. In addition, numerous variations and additions to the embodiments suggested herein will be apparent to those skilled in the art in light of the instant disclosure, which do not depart from the instant invention. Hence, the following specification is intended to illustrate some particular embodiments of the invention, and not to exhaustively specify all permutations, combinations and variations thereof.

[0025] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

[0026] All publications, patent applications, patents, and other references mentioned herein are incorporated by reference in their entirety.

Definitions

[0027] Unless indicated otherwise, explicitly or by context, the following terms are used herein as set forth below. [0028] As used in the description of the invention and the appended claims, the singular forms“a,”“an” and“the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0029] Also as used herein,“and/or” refers to and encompasses any and all possible combinations of one or more of the associated listed items, as well as the lack of combinations when interpreted in the alternative (“or”).

[0030] As used herein, the term“recovery marker” refers to a physical reference marker designed to permit a measurement system, such as a mechanical tracking system, optical tracking system, electro-magnetic tracking system, ultrasound tracking system, and/or an imaging system (e.g., computed tomography (CT), X- ray, fluoroscopy, ultrasound, magnetic resonance imaging (MRI)), to determine at least one of a position or orientation of at least a portion of the reference marker.

[0031] As used herein, the term“registration” refers to the determination of the spatial relationship between two or more objects or coordinate systems such as a computer-assist device and at least one of a bone, or an image data set of a bone. “Re-registration” refers to any subsequent registration procedure that occurs after an initial registration and is executed with the use of the recovery markers.

[0032] As used herein, the term“cut volume” refers to a volume of a bone to be removed by a computer-assist device.

[0033] As used herein, the term“digitizer” refers to a measuring device capable of measuring physical coordinates in three-dimensional space. Examples of a “digitizer” include a high-resolution electro-mechanical sensor arm as described in U.S. Pat. No. 6,033,415, an optically tracked probe as described in U.S. 7,043,961, an end-effector of a robotic system, and similar measuring devices that may be tracked by other tracking systems known in the art.

[0034] As used herein, the term“digitizing” refers to the collection, recordation, or measurement of one or more physical coordinates in three-dimensional space.

[0035] As used herein, the term“real-time” refers to processor in which input data is processed within milliseconds such that calculated values are available within 10 seconds of computational initiation.

[0036] Also, referenced herein are computer-assist devices, which may also be referred to as computer-assisted devices, computer-assisted surgical systems, and robotic surgical systems. Examples of computer-assist devices illustratively include a l-N degree of freedom hand-held surgical system, an optical tracking system tracking one or more tools (e.g., tracked instruments, manipulator arms) in space, a navigated surgical system, a serial-chain manipulator system, a parallel robotic system, or a master-slave robotic system, as described in U.S. Pat. Nos. 5,086,401, 6,033,415, 7,206,626, 8,876,830 and 8,961,536, U.S. Pat. App. No. 2013/0060278, 2005/0216032 and U.S. Prov. App. No. 62/054,009 all of which are incorporated by reference herein in their entirety. The computer-assisted surgical system may provide autonomous, semi-autonomous, haptic, or no (passive) control, or any combination thereof.

[0037] While the present invention is illustrated visually hereafter with respect to a femur as the bone for which the recovery markers are installed and to which the present invention is applied, it is appreciated that the present invention is equally applicable to other bones of a human, non-human primate, or other mammals. [0038] With reference to the figures, FIG. 1 depicts a method for installing one or more recovery markers on a bone to avoid a potential collision with an end- effector tool of a computer assist device. The method generally includes: installing a first set of recovery markers on a bone (S 100) ; registering a bone and a cut volume to a computer assist device (S 110); digitizing the first set of recovery markers with a tracked digitizer probe (S120); calculating, with a processor in real-time, the position of one or more recovery markers in the first set of recovery markers relative to a cut volume (S130); notifying a user whether the first set of recovery markers are at or inside the cut volume of the bone based on the calculations (S140); installing a second set of recovery marker on the bone, wherein the first set of recovery markers remain in the bone to re-register the bone if there is bone motion while installing the second set of recovery markers on the bone;(Sl50); digitizing the second set of recovery marker with the tracked digitizer probe (S160); calculating, with a processor in real-time, the position of one or more recovery markers in the second set of recovery markers relative to the cut volume (S170); removing the first set of recovery markers if the second set of recovery markers are outside the cut volume and utilizing the second set of recovery markers during the procedure to recover the registration (S180). Specific embodiments of the method and components are further described in detail below.

[0039] With reference to FIGs. 2A and 2B, a prior art example of a set of recovery markers is shown including a point recovery marker 100 shown in FIG. 2A and a groove recovery marker 110 shown in FIG. 2B. The point recovery marker 100 is described in U.S. Pat. No. 6,430,434. The point recovery marker 100 generally includes a divot 102 for facilitating the collection of a fixed point, and a bone-engaging portion 104 for engaging a bone. The groove recovery marker 110 includes a bone-engaging portion 112, a proximal portion 114, and a groove 116 between the bone-engaging portion 112 and the proximal portion 114. The bone- engaging portion 112 of the groove recovery marker 110 may include threads or flutes to grasp the bone. A driver tool, such as a screwdriver or drill, may receive the proximal portion 114 to aid in driving the groove recovery marker 110 into the bone. The groove 116 facilitates the collection of a series of points along the length of the groove 116. A method for re-registering a bone using the point recovery marker 100 and groove recovery marker 110 is described in U.S. Prov. Pat. App. 62/302,733 filed March 02, 2016 assigned to the assignee of the present application and incorporated by reference herein in its entirety.

[0040] In a particular inventive embodiment, with respect to FIG. 3, a bone B is shown having a point recovery marker lOOa and a groove recovery marker llOa installed therein at two locations, respectively, corresponding to step S100 of FIG. 1. The point recovery marker lOOa and groove recovery marker l lOa make-up a first set of recovery markers (Sl). A set of recovery markers is needed to establish a coordinate system on the bone to re-register the bone if bone motion occurs. Here, the point recovery marker lOOa and the groove recovery marker 1 lOa act as the first set of recovery marker installed on the bone B, however it should be appreciated that any combination and number of recovery markers (e.g., three point recovery markers) may be installed on the bone B and act as a set of recovery markers without deviating from the scope of the invention.

[0041] A cut volume CV of the bone to be removed is then registered to the bone B and the computer-assist device using techniques known in the art corresponding to step S110. In a particular embodiment, the POSE of the cut volume CV relative to the bone B is defined in a pre-operative planning workstation, where a user plans the position and orientation (POSE) of a virtual implant model relative to virtual bone model. The location of the cut volume CV is then defined as the intersection of the virtual implant model with the virtual bone model. The cut volume CV itself, may have a volume corresponding to the volume of the virtual implant model intersecting with virtual bone model; however, it should be appreciated a user or technician may adjust the size or geometry of the cut volume CV to accomplish one or more specific goals (e.g., reduce the cut volume relative to the volume of the implant model to create a press-fit between the actual implant installed in a prepared bone). After the user plans the POSE of the virtual implant model/cut volume relative to the virtual bone model, the plan is transferred to the computer-assisted device and registered to the bone B such that the computer-assist device knows where to remove the bone B according to the cut volume CV.

[0042] As shown in FIG. 3, the user has unknowingly installed the point recovery marker lOOa and groove recovery marker 1 lOa at locations where at least a portion of the point recovery marker lOOa and groove recovery marker l lOa intersect inside the cut volume CV. The cut volume CV is shown as a bounding line on the bone B representing where a computer-assist device will remove bone. Note, that the user has no knowledge of where the cut volume CV is located, and only the computer-assist device knows where to remove bone according to the cut volume CV after registration.

[0043] Also shown in FIG. 3 is a detailed view of a mechanical digitizer 118 for digitizing the bone and the recovery markers. The mechanical digitizer 118 includes articulating links 120 joined by joints 122, and a probe 124 having a probe tip 126 attached to a distal link of the digitizer 118. Each joint has encoders to determine at least one of a position and orientation of the probe tip 126 in three- dimensional space. In a specific embodiment, the mechanical digitizer 118 is integrated to the base of a robotic arm and registered to a robotic arm as described in U.S. Pat. No. 6,033,415. Although a mechanical digitizer 118 is shown and described in detail in FIG. 3 , it should be appreciated that the other aforementioned digitizers (e.g., optically tracked digitizer probe) may measure, collect, and record points in physical space.

[0044] In a particular inventive embodiment, corresponding with step S120 of FIG. 1, a digitizer is used to digitize the point recovery marker lOOa and the groove recovery marker llOa of the first set of recovery markers Sl to: i.) establish a bone coordinate system to recover the registration; and ii.) aid in the determination of the entire POSE of the point recovery marker lOOa and the groove recovery marker 1 lOa in physical space, where the POSEs are used by the processor to calculate if one or more of the recovery markers (lOOa, l lOa) are at least partially installed inside the cut volume CV. In a specific embodiment, the bone coordinate system is determined as described in PCT/US2017/020175 and/or U.S. Patent No. 6,430,434 both assigned to the assignee of the present application and incorporated by reference herein in their entirety. To aid in the determination of the POSE of the point recovery marker lOOa and the groove recovery marker 1 lOa in physical space, the user digitizes the top of the point recovery marker lOOa (e.g., the divot 102) and the top of the groove recovery marker 1 lOa (e.g., the most proximal point, or end, of the proximal portion 114). The user then aligns a longitudinal axis of the digitizer probe 124 with a longitudinal axis of the point recovery marker lOOa and a longitudinal axis of the groove recovery marker llOa to collect the orientation of the point recovery marker lOOa and the groove recovery marker 1 lOa, respectively, in physical space. By knowing: a. where the top of each recovery marker (lOOa and 1 lOa) is located; b. the orientation of each recovery marker (lOOa and 1 lOa); and c. the length of each recovery marker (lOOa and l lOa), then the POSE of each recovery marker (lOOa and llOa) is precisely known in physical space. The length of each recovery marker (lOOa and llOa) is known based on manufacturing specifications and stored in the computer- assist device memory. The diameter of the recovery markers (lOOa and l lOa) may further be stored in memory, to further define the volume that the recovery markers (lOOa and llOa) occupy in physical space, which may be accomplished by modeling the recovery markers (lOOa and 1 lOa) as cylinders. By knowing the POSE of each recovery marker (lOOa and 1 lOa) in physical space, and optionally the volume, the processor can calculate if a portion of either recovery marker (lOOa and/or l lOa) is at or inside the cut volume CV as further described below.

[0045] Corresponding with step S 130 of FIG. 1, a processor associated with at least one of a digitizer or a computer-assisted surgical device, calculates the position and orientation (POSE) of: a.) the point recovery marker lOOa relative to the cut volume CV; and b.) the groove recovery marker l lOa relative to the cut volume (CV). With reference to FIGs. 4A and 4B, a particular embodiment of a method to determine the POSE of the recovery markers (lOOa, 1 lOa) relative to the cut volume CV is illustrated with a groove recovery marker l lOa installed in the proximal femur. As only a groove recovery marker llOa is shown in this example, the same procedure may be used for the point recovery marker lOOa and other installed hardware. To begin, the POSE of the groove recovery marker is determined in physical space with the aforementioned techniques (e.g., a proximal end 128 of the groove recovery marker 1 lOa is digitized, an orientation of the groove recovery marker 1 lOa is determined, and a distal end 130 of the groove recovery marker 1 lOa is determined by knowing the location of the proximal end 128, the orientation of the marker 1 lOa, and the length of the marker 1 lOa). Therefore, the entire body of the marker 1 lOa is known in physical space. Next, in one embodiment, the entire body of the marker 1 lOa in physical space is transformed to the coordinate system of the cut volume CV stored in the computer-assist device to compare the POSE of the marker 1 lOa relative to the cut volume CV in the same coordinate system. In another embodiment, the calculations are performed in the physical space coordinate system with the cut volume CV registered to the physical location of the bone B. A cut volume virtual model may also be generated representing the outer boundaries of the cut volume CV to aid in the calculations. In any case, the POSE of the recovery marker 1 lOa is then examined relative to the cut volume CV or cut volume virtual model using an algorithm. In a specific inventive embodiment, the algorithm is a point-distance algorithm that measures the distance of all the points on the recovery marker 1 lOa from the cut volume CV or cut volume model CVM. For example, as shown in FIG. 4A, a first point 132 on the recovery marker 1 lOa is examined to determine the distance between the first point 132 and any point on a cut volume model CVM. The lines l34a, l34b, and l34c illustrate the distance of the first point 132 relative to three points on the cut volume model CVM. With reference to FIG. 4B, a second point 135 on the recovery marker l lOa is subsequently examined to determine the distance between the second point 135 and any point on the cut volume model CVM. The lines l36a, l36b, and l36c, likewise illustrate distances between the second point 135 relative to three points on the cut volume model CVM. The point-distance algorithm performs the distance calculations for points along the entire length of the marker llOa relative to the entire volume of the cut volume CV or coverage area of the cut volume model CVM. If a calculated distance between a point on the marker 1 lOa and the cut volume model CVM is below a threshold distance, then the computer-assist device warns or alerts the user that the recovery marker 1 lOa is inside the cut volume CV. In some embodiments, the threshold distance is less than 1 mm.

[0046] Corresponding with step S140 in FIG. 1 and with reference to FIGs. 5A- 5C, a feedback mechanism notifies a user if the first set of recovery markers Sl is located at, inside, or outside the cut volume. In more detail as shown in FIG. 5 A, the feedback may be provided in the form of a visual signal 140 displayed on a monitor 138. The visual signal 140 may include a variety of lights, a written notification, a symbol notification, or any indicia equivalent thereof. In a specific embodiment, the monitor 138 may also include a distance calculator visual display 150. The distance calculator visual display 150 may calculate and visually notify the user of the calculated distance between one or more points on a recovery marker (100, 110) relative to the cut volume CV. With reference to FIG. 5B, the feedback may be provided in the form of an acoustic signal 160. The acoustic signal 160 may further include a variety of audible notification sounds illustrative including a beeping sound, a vocal sound, or a combination thereof. With reference to FIG. 5C, the feedback may be provided in the form of a haptic signal 170. The haptic signal 170 may be in any form of a vibration or other imposed force on the user. Here, it should be appreciated that the feedback system may be in the form of any of acoustic, motion, visual signals, or a combination thereof.

[0047] Corresponding with step S150 of FIG. 1 and as shown in FIG. 6, if a portion of one or more recovery markers (lOOa, l lOa) in the first set of recovery markers Sl is determined to exist at or inside the cut volume CV, a user is prompted to install a second set of recovery markers S2 on the bone B, while leaving the first set of recovery markers S 1 in the CV of the bone. A bone coordinate system was established with the first set of recovery markers S 1 such that the user can re-register the bone B if bone motion occurs while the second set of recovery markers S2 are being installed and/or digitized. The user attempts to install the second set of recovery markers S2 outside the cut volume CV. Corresponding to step S160 in FIG. 1 a user then digitizes the second set of recovery markers S2 to: i.) establish a bone coordinate system to recover the registration with the second set of recovery markers S2; and ii.) aid in the determination of the entire POSE of the point recovery marker lOOa and the groove recovery marker llOa in physical space, where the POSEs are used by the processor to calculate if one or more of the second set of recovery markers (lOOa, l lOa) is at least partially installed inside the cut volume CV. Corresponding to step S170 in FIG. 1 , a processor then calculates, in real-time, the position of the second set of recovery markers S2 relative to the cut volume. It should be appreciated that the method of digitizing the second set of recovery markers S2 and calculating the position of the second set of recovery markers S2 relative to the cut volume CV is the same method as described above in steps S120- S130 for the first set of recovery markers Sl. [0048] In a particular inventive embodiment, the method described herein further includes the assembly of a bone motion monitor to the bone B prior to bone registration. The bone motion monitor may be a probe disposed on the bone and in communication with a 3 to 6 degree-of- freedom strain gauge, or other force sensor, to detect if motion occurs beyond a specific threshold. If bone motion is detected while installing the second set of recovery markers S2, then the user is notified to re-register the bone with the first set of recovery markers Sl using the methods described in PCT/US2017/020175 and/or U.S. Patent No. 6,430,434. After re registration, the user is prompted to continue installing the second set of recovery markers S2.

[0049] In a particular inventive embodiment, the computer-assist device may assist the user in locating one more locations to install one or more secondary recovery markers (lOOb, l lOb) such that the markers (lOOb, l lOb) are outside of the cut volume CV. In one embodiment, the user may use a digitizer, such as the mechanical digitizer 118, to probe around the bone B to search for a suitable location. For example, if the processor calculated that a portion of a first groove recovery marker 1 lOa was installed having 3 mm of the marker 1 lOa inside the cut volume CV, then a suitable location may be 4 mm in a particular direction. Then, when the digitizer is probed 4 mm in the appropriate direction and outside the cut volume CV, then the computer-assist device provides a signal indicating so. The user may then install a second recovery marker (lOOb, l lOb) in that location. A more detailed description of probing the bone B with a digitizer to find a location to install hardware is described in U.S. Provisional Pat. App. 62/446,719 assigned to the assignee of the present application. In another inventive embodiment, the monitor 138 may provide visual instructions to the user. The monitor 138 may display a representation of the POSE of the first set of recovery markers S 1 relative to the cut volume CV and highlight where or how the first point recovery marker lOOa and/or first groove recovery marker l lOb is positioned relative to the cut volume CV. The user then has a reference (i.e., the POSE of the first set of recovery markers S 1 installed in the bone relative to the cut volume CV) to install the second set of recovery markers S2 outside of the cut volume CV.

[0050] Corresponding to step S180 in FIG. 1, if the calculated position of the second set of recovery markers S2 is outside the cut volume CV, then the user may remove the first set of recovery markers S 1 and proceed with the surgical procedure (i.e., modifying the bone B) without worry that the set of recovery markers S2 will collide with the modifying tool (e.g., an end-effector tool of a surgical robot). The user may then use the second set of recovery markers S2 to recover the registration, if needed. However, if the processor calculates that a portion of one or more of the second recovery markers (lOOb, llOb) in the second set of recovery markers S2 is inside the cut volume CV, then the same process is repeated with a third set of recovery markers S3 and so on, until a set of recovery markers SN is located outside the cut volume CV.

Tracking Arrays and other Hardware

[0051] The method described herein may be adapted to aid a user in installing other hardware on a bone B to ensure the hardware is installed outside a cut volume prior to modifying the bone B. In a particular inventive embodiment, with reference to FIG. 7, a tracking array 180 is shown installed on a bone B via pins (l82a, l82b). One or more pins (l82a, l82b) are inserted into the bone B and an assembly block 184 assembles or attaches the pins (l82a, l82b) to the tracking array 180. The tracking array 180 permits the bone B to be tracked by an optical tracking system in real-time. However, the one or more of the pins (l82a, l82b) may be installed inside a cut volume CV. Therefore, the method described above may be used to ensure that one or more pins (l82a, l82b) are not installed at or inside the cut volume CV prior to modifying the bone. The pins (l82a, l82b) in conjunction with a checkpoint (not shown) may also be used to re-register the bone if the tracking array 180 moves relative to the bone B during the procedure using the tracking array registration recovery method as described in PCT/US2017/020175.

Computer- Assist Device

[0052] With reference to FIG. 8, an embodiment of a computer-assist device, and more specifically a robotic surgical system is shown generally at 200 capable of implementing embodiments of the inventive method described herein is shown in the context of an operating room (OR). The surgical system 200 generally includes a surgical robot 202, a computing system 204, and includes at least one of a mechanical digitizer 118 or a non-mechanical tracking system 206 (e.g., optical tracking system). The end-effector of the surgical robot 202 may also have the capabilities of the mechanical digitizer 118 directly, where the mechanical digitizer 118 is no longer needed.

[0053] The surgical robot 202 may include a movable base 208, a manipulator arm 210 connected to the movable base 208, an end-effector flange 212 located at a distal end of the manipulator arm 210, and an end-effector assembly 201 for holding and/or operating an end-effector tool 203 removably attached to the flange 212 by way of an end-effector mount 213. The movable base 208 in some inventive embodiments includes a set of wheels 217 to maneuver the movable base 208, which may be fixed into position using a braking mechanism such as a hydraulic brake. The manipulator arm 210 includes various joints and links to manipulate the tool 203 in various degrees of freedom. If the mechanical digitizer 118 is not present, the end effector assembly 201 may be fitted with a probe to act as a digitizer directly. The joints are illustratively prismatic, revolute, spherical, or a combination thereof.

[0054] The computing system 204 generally includes a planning computer 214; a device computer 216; an optional tracking computer 236 if a tracking system 206 is present; and peripheral devices. The planning computer 214, device computer 216, and tracking computer 236, may be separate entities, single units, or combinations thereof depending on the surgical system. The peripheral devices allow a user to interface with the surgical system components and may include: one or more user-interfaces, such as a display or monitor 138; and user-input mechanisms, such as a keyboard 220, mouse 222, pendent 224, joystick 226, foot pedal 228, or the monitor 138 where in some inventive embodiments the monitor 138 has touchscreen capabilities.

[0055] The planning computer 214 contains hardware (e.g., processors, controllers, and memory), software, data and utilities that are in some inventive embodiments dedicated to the planning of a surgical procedure, either pre- operatively or intra-operatively. This may include reading medical imaging data, segmenting imaging data, constructing three-dimensional (3D) virtual models, storing computer-aided design (CAD) files, providing various functions or widgets to aid a user in planning the surgical procedure, and generating surgical plan data. The final surgical plan includes operational data for modifying a volume of tissue that is defined relative to the anatomy, such as a set of points in a cut-file to autonomously modify the volume of bone to be removed (i.e., cut volume), a set of virtual boundaries defined to haptically constrain a tool within the defined boundaries (i.e., cut volume) to modify the bone, a set of planes or drill holes to drill pins in the bone, or a graphically navigated set of instructions for modifying the tissue. The surgical plan data in some inventive embodiments also includes instructions for the end-effector assembly 201 to control the tool 203. The data generated from the planning computer 214 may be transferred to the device computer 216 and/or tracking computer 236 through a wired or wireless connection in the operating room (OR); or transferred via a non- transient data storage medium (e.g., a compact disc (CD), a portable universal serial bus (USB) drive) if the planning computer 214 is located outside the OR.

[0056] The device computer 216 in some inventive embodiments may be housed in the moveable base 208 and contain hardware, software, data and utilities that are preferably dedicated to the operation of the surgical device 202 to execute a surgical task. This may include surgical device control, robotic manipulator control, the processing of kinematic and inverse kinematic data, the execution of registration algorithms, the execution of calibration routines, the execution of surgical plan data, coordinate transformation processing, providing workflow instructions to a user, utilizing position and orientation (POSE) data from the tracking system 206, and executing algorithms to determine if one or more recovery markers (100, 110) or other hardware is installed inside a cut volume.

[0057] The optional tracking system 206 of the surgical system 200 includes two or more optical receivers 230 to detect the position of fiducial markers (e.g., retroreflective spheres, active light emitting diodes (LEDs)) uniquely arranged on rigid bodies. The fiducial markers arranged on a rigid body are collectively referred to as a tracking array 232, where each tracking array 232 has a unique arrangement of fiducial markers, or a unique transmitting wavelength/frequency if the markers are active LEDs. An example of an optical tracking system is described in U.S. Pat. No. 6,061,644. The tracking system 206 may be built into a surgical light, located on a boom, a stand 242, or built into the walls or ceilings of the OR. The tracking system computer 236 may include tracking hardware, software, data and utilities to determine the POSE of objects (e.g., bones B, surgical device 204) in a local or global coordinate frame. The POSE of the objects is collectively referred to herein as POSE data, where this POSE data may be communicated to the device computer 216 through a wired or wireless connection. Alternatively, the device computer 216 may determine the POSE data using the position of the fiducial markers detected from the optical receivers 230 directly.

[0058] The POSE data is determined using the position data detected from the optical receivers 230 and operations/processes such as image processing, image filtering, triangulation algorithms, geometric relationship processing, registration algorithms, calibration algorithms, and coordinate transformation processing. For example, the POSE of a digitizer probe 238 with an attached probe tracking array 232b may be calibrated such that the probe tip is continuously known as described in U.S. Pat. No. 7,043,961. The POSE of the tool tip or tool axis of the tool 203 may be known with respect to a device tracking array 232a using a calibration method as described in U.S. Pat. App. 15/548,138. The device fiducial marker 232a is depicted on the manipulator arm 210 but may also be positioned on the base 208 or the end-effector assembly 201. Registration algorithms may be executed to determine the POSE and coordinate transforms between a bone B, a tracking array 232c or 232d, and a surgical plan, using the registration methods described in U.S. Pat. No. 6,033,415, and 8,287,522.

[0059] Upon assembly of the device tracking array 232a to the surgical robot 202 prior to surgery, the POSE’s of the coordinate systems, 232a and the end effector tool 203, are fixed relative to each other and stored in memory to accurately track the end effector tool 203 during the surgery (see for example U.S. Patent Publication 20140039517 Al) relative to the bone anatomy (e.g., bones B). The POSE data may be used by the computing system 204 during the procedure to update the bone and surgical plan coordinate transforms so the surgical robot 202 can accurately execute the surgical plan in the event any bone motion occurs. However, if there is unintentional movement between the tracking arrays (232c, 232d) and the bone B after initially registering the bone B, then the bone needs to be re-registered to re-establish the coordinate systems between the tracking arrays (232c, 232d) and the bone B, which may be accomplished with embodiments of the inventive method described herein. It should be appreciated that in certain embodiments, other tracking systems may be incorporated with the surgical system 200 such as an electromagnetic field tracking system or a 6-DOF mechanical tracking system. An example of a 6-DOF mechanical tracking system is described in U.S. Pat. No. 6,322,567. In a particular inventive embodiment, the surgical system 200 does not include a tracking system 206, but instead employs a bone fixation and monitoring system that fixes the bone directly to the surgical robot 202 and monitors bone movement as described in U.S. Pat. No. 5,086,401.

Other Embodiments

[0060] Patents and publications detailed herein are representative of the skill in art at the time of the present invention. These references are hereby incorporated by reference to the same extent as if each patent or publication was specifically and individually incorporated by reference.

[0061] While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the described embodiments in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient roadmap for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes may be made in the function and arrangement of elements without departing from the scope as set forth in the appended claims and the legal equivalents thereof.