Science Education
>

The Use of Mixed Reality in Custom-Made Revision Hip Arthroplasty: A First Case Report

PREPARAÇÃO DO INSTRUTOR
CONCEITOS
PROTOCOLO DO ALUNO
JoVE Journal
Medicina
É necessária uma assinatura da JoVE para visualizar este conteúdo.  Faça login ou comece sua avaliação gratuita.
JoVE Journal Medicina
The Use of Mixed Reality in Custom-Made Revision Hip Arthroplasty: A First Case Report

The protocol follows guidelines of the Human Research Ethics Committee of the Medical University of Warsaw. The patient gave informed consent to the procedure and acknowledged the fact that it will be recorded. The patient agreed to that prior to the procedure.

NOTE: The basic criterion for including the patient in the surgery project was the necessity to intervene because of the anatomical dysfunction, which made it impossible to use a standard implant. Mixed reality was aimed at better placement of the prosthesis, increasing the chances of successful surgery.

1. Preparation

  1. Prepare a custom-made acetabular implant and plan the surgical procedure before the patient's hospitalization.
    NOTE: In this case study, persons skilled in the art of medical image diagnostics prepared the custom-made acetabular implant.
    1. Before the planned admission to the hospital, perform an x-ray in the diagnostic imaging unit.
    2. Perform a pelvic X-ray in an anterior-posterior projection.
    3. Assess the current condition of the patient's pelvis based on the X-ray.
    4. Compare the image obtained with the earlier X-ray images.
  2. Take a pelvic CT scan and acquire DICOM (Digital Imaging and Communications in Medicine) files according to the protocol.
    1. Place the patient on the moveable CT scan platform.
    2. Click on the thickness button and select 512 x 512 px thickness for the scans.
    3. Click on the parameter that determines the thickness of the 1 mm layer.
    4. Start the procedure by clicking, wait for the test result.
  3. Ask an engineer to design an implant proposal that can be sent digitally as a technical scheme, or a 3D printed model prototype (Figure 1).
    1. Visualize the computed tomography result in the DICOM viewer.
    2. Determine the needs for the implementation of the implant, taking into account the current anatomical conditions of the patient, biomechanics, and the function of the joint.
    3. Consult the engineer for suggestions on implants, including fixation.
    4. Approve the project and wait for shipment.
      NOTE: The final shape of the implant involves combining 3D data from a patient's CT scan with the input of a design engineer and a surgeon.
  4. Print the custom-made 3D implant from the titanium alloy powder (TiAl6V4) using electron beam technology26,27. Inside a chamber containing small amounts of TiAl6V4 powder, each time the electron beam is fired, there is selective melting and accumulation of material (plasma coating).
  5. Check whether the implant was sterilized. Sterilization of implant trials and the final implant was guaranteed by the manufacturer.

2. Pre-surgery checkups

  1. Perform a standard of care laboratory tests and specialist consultations.
    1. Exclude patients with potential periprosthetic joint infection (no radiological features, normal c-reactive protein (<10 mg/L), and erythrocyte sedimentation rate of 1-10 mm/h for women, 3-15 mm/h for men).
  2. Check for the clinical signs of infection such as fever (systemic), pain, swelling, redness (local), and reduced joint function28.
    1. Exclude patients having signs of local inflammation during the clinical examinations (redness, temperature increase, pain, swelling and loss of function indicate local inflammation). The patient gave complete informed consent to the operation.

3. Mixed reality model

NOTE: The process is performed to achieve proper implant and pelvis visualization, which will be used intraoperatively.

  1. Process the pelvic CT DICOM file into a holographic representation using dedicated application.
    1. Load the CT image into mixed reality headset from acquired CT DICOM files.
      1. Open holographic DICOM Viewer.
      2. Select the folder containing CT DICOM files.
      3. Check the IP that is displayed when the headset is switched on and enter it in a designated place in the holographic DICOM Viewer.
      4. Click on the Connect button to be able to see the visualization in the mixed reality headset.
    2. Segment the pelvis bone tissue structures. This is performed manually by using the Scissors option. When the option is enabled, the user clicks the left mouse button and moves the mouse around to remove the structures that are selected with this tool.
      1. End the selection with another click of the left mouse button, which creates a pop-up for the user to confirm that he/she wants to cut out the structures that are selected.
        NOTE: The user can choose areas to be cut out from the visualization in both 3D and 2D views. It is possible to remove the structures from within or outside the selection. This is repeated until only the necessary parts of the CT image are visible.
    3. Choose a predefined transfer function (color visualization parameters) dedicated to orthopedic procedures from the list of available functions by clicking on its name: CT Bone Endoprosthesis. If needed, adjust the visualization by changing the window and level using the right mouse button connected with mouse movement in the 3D visualization window.
    4. Connect to the headset to see the prepared visualization in the 3D holographic space. Adjust the image using voice commands: Rotate, Zoom, Cut Smart, and Hand Gestures.
    5. Use the Cut Smart command to use and adjust a cutting plane that is perpendicular to user's line of sight. The closer the user moves the head into the hologram, the deeper the plane goes.
    6. Perform these movements to see the inner parts of the visualization because structures that are located anteriorly to the plane are not visualized.
      NOTE: This view is important to assess the geometrical relations between structures (pelvis, femur, and implant) (Figure 2 and Figure 3).

4. Surgery

  1. Perform the surgical procedure of revision hip arthroplasty due to aseptic loosening of the acetabular component with the use of a custom-made acetabular implant and mixed reality device14,16,29. Use a scalpel, an electrosurgical knife with a coagulator, a Luer tool and cutters for the operation.
    1. Give 1.5 g of ceftriaxone intravenously 30 min prior to the skin incision, and two subsequent doses are to be given on the day of the surgery to prevent infection. Initiate thromboprophylaxis on the day before the surgery with low molecular weight heparin (LMWH). Continue the single daily dose of 40 mg enoxaparin for 30 days after the procedure.
    2. Place and secure the patient under general anesthesia, lying down on the operating table.
    3. Release the connective tissue adhesions using the Hardinge access to the hip joint and remove the loose acetabular implant.
    4. Perform the operation in the same way as other revision procedures of the hip joint, but use a wider access.
    5. Remove all soft tissues from the surface of the acetabulum so that the shape is exactly the same as in the model provided. The implant model must perfectly adhere to the surface of the acetabular bone.
    6. Fix the new uncemented implant using specially designed screws that stabilize the implant.
    7. Perform a femoral nerve block after surgery.
  2. Intraoperative holographic visualization of processed images
    1. Load the visualization of the DICOM CT scan prepared in the pre-procedural planning to the mixed reality application.
    2. Connect the mixed reality headset to the mixed reality application to see the prepared visualization in the 3D holographic space.
    3. Use intraoperative holographic visualization of the processed images to achieve adequate and precise pelvic bone surface preparation as well as for removal of the excess of connective tissue that developed as a response to loosening of the acetabular component.
    4. Ensure that the operator looks at the holographic visualization as a reference image.
    5. Use a scalpel, an electrosurgical knife with a coagulator, a luer tool, and cutters for the operation. Visualization of the 3D pelvis model should minimize the risk of damaging neurovascular structures and mistakes in implant placement.
    6. Ensure that the head-mounted display is connected to the workstation through a WiFi network. The processing of the images and the rendering is performed on the workstation and the results are displayed on the headset as holograms. Use gestures and voice commands. If necessary, get help from an engineer with POV preview.

5. Postoperative care

  1. Make the patient undergo a standard rehabilitation and recovery protocol, including rehabilitation and mobilization on the first day after surgery30,31,32.
    NOTE: Rehabilitation was implemented by a dedicated team experienced in the hip and knee arthroplasty.
  2. Implement pharmacological thromboprophylaxis. Thromboprophylaxis was initiated on the day before the surgery with low molecular weight heparin (LMWH). The single daily dose of 40 mg enoxaparin was continued for 30 days after the procedure.

The Use of Mixed Reality in Custom-Made Revision Hip Arthroplasty: A First Case Report

Learning Objectives

Image preprocessing
Binary masks of the pelvic bone, femur, and endoprosthesis were semi-automatically segmented from CT DICOM images by experienced radiologic technologists using thresholding and region growing algorithms with available software33. The prepared label maps were also manually corrected by a radiologist. Label maps were used to enhance the visualization by adding them to the CT scan in the next step. This approach made it possible to merge the volumetric rendering, which allows to see the bone structure and surrounding tissues on the CT scans, with the segmented parts indicating important tissues. The segmentation results were concluded in the original stack, which avoided constructing only a 3D graphical model of structures but made it possible to maintain information about all Hounsfield Units (HU) values. It resulted in an interactive visualization that allowed one to display tissues, implant and conduct bone segmentations simultaneously or one at a time, depending on the surgical situation (Figure 1 and Figure 4) visualizations of the fixed implant. The processed CT data set was visualized as holograms using dedicated software.

Pre-procedural planning and hospitalization
On the basis of computer tomography data and visualizations, an operation plan was prepared. The plan included important values: hip center of rotation, acetabular inclination, anteversion, and the direction, method and zones of implant mounting. The position of the implant was determined by bone and anatomical points, while the appropriate configuration was additionally confirmed after setting the trial head of the prosthesis and clinical checking of the implant's stability during the procedure. Post-operative CT was performed in order to confirm the correct position of the implant. The position of the screws was planned on the basis of the CT by the engineer and surgeon, which allowed to avoid contact of the screws with the vascular-nerve structures and their damage (Figure 5). The acetabular defect was classified as 3B Paprosky classification34. Type 3B is the most severe destruction of all acetabular structures, including walls and columns34. The clinical HHS score before surgery was 44 (Table 1).

Activities to prepare the patient for the procedure included internal medicine consultation and standard laboratory tests. Essential examinations were also necessary: ECG and X-ray: chest X-ray, pelvic X-ray. The control image was also taken after surgery. The patient received standard thromboprophylaxis (Clexane 40 mg, 1 x 1 s.c.) and antibiotic prophylaxis (Tarsime 3 x 1.5 g i.v.) during hospitalization. Individualized pain therapy was included. All other medications were taken according to the patient's standard recommendations.

In January 2019, an arthroplasty revision of the left hip was performed, which included the replacement of a loose acetabular component with the custom-made implant: Triflanged acetabular component, Polyethylene insert, constrained, Fastening screws-10 pieces, Co-Cr-Mo constrained modular head (36 mm), and a 9 mm neck.

The operation lasted for 4 h and was executed without complications. Verticalization with the help of a walker took place on the second day after the procedure. The patient was discharged on day 14 in a good general condition (long rehabilitation time due to foot paralysis after cerebral palsy). Control visits took place following the appointed dates. Radiological control-CTs and X-rays were performed before the surgery (Figure 3, Figure 6, and Figure 7), after the surgery (Figure 2 and Figure 8) and after 2 years (Figure 9). Implant placement was performed in accordance with the assumptions of the project. The offset, range of motion, and length of the limbs were restored. The function and patient's quality of life were relatively good on the subsequent visit and improved significantly since the initial diagnosis. Before the operation, the patient moved to a wheelchair because of pain-the patient's subjective assessment on the 10-point visual analog pain-intensity scale was 8 (VAS 8). After surgery, during rehabilitation, she stopped using two orthopedic crutches. The patient currently walks with one crutch due to foot drop-peroneal nerve palsy after previous surgery in another hospital. According to the authors' knowledge, it was the first such procedure in Poland and one of the first in the world. It was a medical student research team that proposed the idea of using modern technology in the Department of Orthopedics and Traumatology of the Musculoskeletal System.

Anatomical structures that require surgical intervention must be visible for adequate implant fixation as planned. In the case of non-standard patients with significant bone defects and deformation, the appropriate visualization and adjustment of a custom-made prosthesis are of fundamental importance for the treatment process. Proper implant fixation reduces the risk of postoperative complications such as loosening or instability. The technology of mixed reality allows without risk and in a non-invasive way to accurately visualize the pelvis, bones, and soft tissues, increasing the chances of good implant placement and even possibly shortening the time of surgery in the future. The ability to manipulate the image, for example, zooming in the selected fragments of the complex anatomical structures, allows excluding the imperfections of the surgeon's eye (Figure 10 and Figure 11). In summary, a precise, fully personalized complex revision arthroplasty was performed. The authors see opportunities for the further development of mixed reality in orthopedics, not only in arthroplasty and traumatology, but also in orthopedic oncology, where it is often necessary to perform very extensive resections with a high level of precision. The appropriate visualization of difficult-to-access anatomical areas with surrounding neurovascular structures can make surgery easier for the surgeon and safer for the patient.

Figure 1
Figure 1: Visualization of the fixed implant. Please click here to view a larger version of this figure.

Figure 2
Figure 2: X-ray one day after the surgery. The letter 'L' represents the left side of the body on the X-ray. In this case, a photo of the left hip. Please click here to view a larger version of this figure.

Figure 3
Figure 3: X-ray before the surgery. Please click here to view a larger version of this figure.

Figure 4
Figure 4: Visualization of the fixed implant. Visualization is prepared in the process of preoperative planning. It shows the potential fixation of the implant. The blue color in the visualization is the border of the implant. Please click here to view a larger version of this figure.

Figure 5
Figure 5: 3D project for insertion of implant fixing screws. Colors are used by engineers for better and more accurate visualization. This makes it easy to distinguish bolts having different parameters-length, cross-section. The mounting sequence can also be taken into account. The colors are illustrative and are used in the pre-operative planning process. In the process of planning the implant mounting, it is important to exclude intraoperative damage to blood vessels and nerves. Please click here to view a larger version of this figure.

Figure 6
Figure 6: CT-3D reconstruction before the surgery shows the hip joints and part of the femur. Visible degeneration and destruction of bone structures, pelvic asymmetry. Please click here to view a larger version of this figure.

Figure 7
Figure 7: CT-3D reconstruction before the surgery. Please click here to view a larger version of this figure.

Figure 8
Figure 8: X-ray 6 weeks after the surgery. The implant was fitted correctly, it did not come loose. Visible left hip endoprosthesis with fixing elements. X-ray in combination with the clinical examination of the patient confirms the success of the operation. Please click here to view a larger version of this figure.

Figure 9
Figure 9: X-ray 2 years after the surgery. Please click here to view a larger version of this figure.

Figure 10
Figure 10: Mixed reality user's point of view – pelvis from the front. Please click here to view a larger version of this figure.

Figure 11
Figure 11: Mixed reality user's point of view – pelvis from the side. Please click here to view a larger version of this figure.

Figure 12
Figure 12: Mixed reality user's point of view – the photo taken during the surgery – the hologram shows a part of the pelvis. Please click here to view a larger version of this figure.

Figure 13
Figure 13: The photo taken during the surgery – main operator, Prof. Łęgosz uses mixed reality technology. Please click here to view a larger version of this figure.

HSS SCORE
BEFORE SURGERY 6 WEEKS AFTER SURGERY 6 MONTH AFTER SURGERY 12 MONTH AFTER SURGERY
44 74,5 80 82

Table 1: HHS Score table – presenting the patient's results according to the Harris Hip score before the procedure, 6 weeks after the procedure, 6 months after the procedure, 12 months after the procedure.

List of Materials

CarnaLifeHolo v. 1.5.2 MedApp S.A.
Custom-Made implant type Triflanged Acetabular Component BIOMET REF PM0001779
Head Constrained Modular Head + 9mm Neck for cone 12/14, Co-Cr-Mo, size 36mm BIOMET REF 14-107021
Polyethylene insert Freedom Ringloc-X Costrained Linear Ringloc-X 58mm for head 36mm / 10 * BIOMET REF 11-263658

Preparação do Laboratório

The technology of 3D printing and visualization of anatomical structures is rapidly growing in various fields of medicine. A custom-made implant and mixed reality were used to perform complex revision hip arthroplasty in January 2019. The use of mixed reality allowed for a very good visualization of the structures and resulted in precise implant fixation. According to the authors’ knowledge, this is the first described case report of the combined use of these two innovations. The diagnosis preceding the qualification for the procedure was the loosening of the left hip’s acetabular component. Mixed reality headset and holograms prepared by engineers were used during the surgery. The operation was successful, and it was followed by early verticalization and patient rehabilitation. The team sees opportunities for technology development in joint arthroplasty, trauma, and orthopedic oncology.

The technology of 3D printing and visualization of anatomical structures is rapidly growing in various fields of medicine. A custom-made implant and mixed reality were used to perform complex revision hip arthroplasty in January 2019. The use of mixed reality allowed for a very good visualization of the structures and resulted in precise implant fixation. According to the authors’ knowledge, this is the first described case report of the combined use of these two innovations. The diagnosis preceding the qualification for the procedure was the loosening of the left hip’s acetabular component. Mixed reality headset and holograms prepared by engineers were used during the surgery. The operation was successful, and it was followed by early verticalization and patient rehabilitation. The team sees opportunities for technology development in joint arthroplasty, trauma, and orthopedic oncology.

Procedimento

The technology of 3D printing and visualization of anatomical structures is rapidly growing in various fields of medicine. A custom-made implant and mixed reality were used to perform complex revision hip arthroplasty in January 2019. The use of mixed reality allowed for a very good visualization of the structures and resulted in precise implant fixation. According to the authors’ knowledge, this is the first described case report of the combined use of these two innovations. The diagnosis preceding the qualification for the procedure was the loosening of the left hip’s acetabular component. Mixed reality headset and holograms prepared by engineers were used during the surgery. The operation was successful, and it was followed by early verticalization and patient rehabilitation. The team sees opportunities for technology development in joint arthroplasty, trauma, and orthopedic oncology.

Tags