Accuracy study of a binocular-stereo-vision-based navigation robot for minimally

Ran Wang,Ying Han,Min-Zhou Luo,Nai-Kun Wang,Wei-Wei Sun,Shi-Chong Wang,Hua-Dong Zhang,Li-Juan Lu

Ran Wang,Ying Han,Nai-Kun Wang,Wei-Wei Sun,Shi-Chong Wang,Li-Juan Lu,Department of Pain Management,Nanjing Drum Tower Hospital The Affiliated Hospital of Nanjing University Medical School,Nanjing 210008,Jiangsu Province,China

Min-Zhou Luo,Hua-Dong Zhang,Institute of Intelligent Manufacturing Technology,Jiangsu Industrial Technology Research Institute,Nanjing 210000,Jiangsu Province,China

Abstract

Key words:Navigation robot;Binocular stereo vision;Interventional procedure;Pain management;Trigeminal neuralgia;Needle placement

INTRODUCTION

Recently,minimal invasive surgery has been an irresistible trend in clinical treatment.In the field of chronic pain management,interventional therapy has also become the main approach for its advantages of exact therapeutic effect and minimal invasion[1].The percutaneous puncture is a vital process of minimally invasive surgery,and its successful operation requires the accurate location of the target and the precise placement of the interventional tool.Although many imaging technologies such as fluoroscopy,computed tomography (CT) and ultrasound have been utilized to enhance accuracy and visualization[2-4],complex spatial puncture is still an intractable problem.For this reason,the clinical need for guidance has increased along with the trend of minimal invasion[1,5].

Apart from basic imaging equipment,many other navigation tools have been designed for clinical demand[6-8].Among these techniques,the medical robot is the most promising one.This technology has shown great potential in increasing the accuracy and consistency of needle punctures in many kinds of interventional therapies.For spinal surgery,the reported accuracy rate of a pedicle screw under the guidance of a robot can be up to 96.7%-98.9%[9-11].For neurological surgery,the navigation robot can not only ensure the accuracy of deep brain stimulation implantation but also shorten the operation time[12,13].So far,few documents have reported the application of a navigation robot for chronic pain management,but the superiority of this tool would exactly complement the demand in this field.

To date,a series of robots have been released,including Mazor X (Mazor Robotics Ltd)[9],TiRobot (TINAVI Medical Technologies Co.,Ltd)[14],Excelsius Global Position System(Globus Medical Ltd)[15]and BrainLab Cirq (Brainlab AG Ltd)[15].However,none of these systems were designed for chronic pain treatment.The tracking markers of these robot systems need to be fixed on a specific position of the body,such as the ilium,which may be far from the surgical spot.Therefore,additional unnecessary radiation exposure will occur.This exposure may be acceptable for patients under general anesthesia because such preoperative scanning usually needs to be performed once.However,interventional treatment for chronic pain is always performed under local anesthesia,thus body dodging and twisting as well as breathing movement are inevitable influences on navigation accuracy.The scanning for placement planning needs to be repeated several times.

Our team proposes a new registration method using skin tracking markers and binocular vision[16].The markers just need to be pasted on the skin of the operation region,avoiding extra radiation of the nonsurgical region.Using this method,we developed a CT-image based navigation robot.The objective of this study was to evaluate the feasibility,accuracy and stability of this new robot.We implemented it in preclinical experiments using box models to quantitate the puncture error.For assessment of clinical feasibility,head phantoms were also used to simulate interventional treatment on the Gasserian ganglion through the foramen ovale (FO).The placement procedure was conducted by free hand and under the guidance of the robot.We compared the operation parameters of the two methods.

MATERIALS AND METHODS

Navigation robot and experimental models

This binocular-stereo-vision-based navigation robot was independently designed by Nanjing Drum Tower Hospital,the affiliated hospital of Nanjing University Medical School,and the Institute of Intelligent Manufacturing Technology,Jiangsu Industrial Technology Research Institute.The navigation robot is composed of binocular stereo visual tracking equipment,an operation planning and controlling system and a sixaxis robotic arm (UR3 robot,Universal Robots,Odense,Denmark).The binocular stereo visual tracking equipment is a binocular camera,which automatically identifies and locates the spatial position of the markers on the robot arm and operation object.The operation planning and controlling system consists of a program for image processing,spatial registration,cannulating trajectory design and movement control of the robot arm (Figure 1).

To investigate the accuracy of the navigation robot,one cuboid box model and three head phantoms were used.The box model was made of acrylic resin and filled with sponge.On the upper surface of the box,one insertion line was drawn with contrast agent parallel to the narrow edge.Nine lead spheres (three sets) with a 1 mm radius were inserted into different positions in the box.We used these artificial spheres targets to simulate respectively the short-distance,moderate-distance and longdistance operation goals.The absolute distances from the target to insertion line on the surface include 50 mm (three spheres),100 mm (three spheres) and 150 mm (three spheres) (Figure 2).

The head phantom (1:1 model of patient’s head) was also used for evaluating the clinical feasibility and stability of robot,by comparing with the free-hand operation.FO was set as the target to simulate the procedure of intervention therapy on the trigeminal ganglion.The head phantom was printed with nylon.To enhance the simulated effect,the skin of the cheek was replaced by a plasticized sponge,which fully packs the space from the face to FO (Figure 3).The long diameter and short diameter of FO were 4.9 mm and 3.4 mm on right side and 5.3 mm and 4.0 mm for left side.

Study design

Box model was used in the first part of the experiment.On the box model,the puncture procedure was repeated three times for each goal.Therefore,a total of 27 insertion procedures were performed with the guidance of the navigation robot.When applying the robot-guided puncture,the box was placed on the bed panel with the insertion line perpendicular to the scanning coil.After trajectory planning,the insertion depth and insertion angle were measured.The insertion depth was the distance from entry point to target.The insertion angle was the angle of insertion trajectory and horizontal line.Needle was placed with the guide of robot.TheEuclidian error was used to evaluate the accuracy of the navigational system.This parameter was the vertical dimension from the center of the target to the tip of real needle,which was measured on CT images (Figure 4).The Euclidian error for different targets were compared.

Figure 1 Schematic diagram of the binocular-stereo-vision-based navigation robot.The navigation robot was composed of binocular stereo visual tracking equipment,an operation planning and controlling system and a six-axis robotic arm.

Figure 2 Schematic,photo and three-dimensional computed tomography image of box model.A:Schematic diagram of box model;B:One insertion line was drawn on the upper surface with contrast agent parallel to the narrow edge;C:Nine artificial targets were set inside the box,respectively 50 mm(target a),100 mm (target b),150 mm (target c) far from the insertion line;D:Image and 3D-computed tomography of box model with insertion line and target marked with solid arrow and triangular arrow;E:The box model was made of acrylic resin and filled with sponge.

Head models were used for needle insertion targeting the FO in the second part of the experiment.The procedure was conducted by three attending doctors who have performed such an interventional operation at least 400 times.FO on each side of three head phantoms were operated twice (free hand and robotic guided).According to the navigation methods,free-hand group and robotic group were set in the study.In the free-hand group,FO placement was performed through the traditional Hartel approach manually[17].In the robotic group,FO puncture was performed with thenavigation of the robot.CT scanning was utilized for needle adjustment in both groups.The operation time and adjustment time were recorded.The one-time success rate of placement was also calculated and compared between two groups.Meanwhile,operation time and adjustment time of robot-guided puncture were also compared among three performers.

Figure 3 Head phantom.A:The 1:1 head phantom was 3D printed with nylon and filled with sponge;B:The foramen ovale is marked with solid arrow.

Figure 4 Measurement of insertion parameters and deviation distance.A:Insertion depth and angle were measured on preoperative planning image.Insertion depth (b) was the distance from entry point (dotted arrow) to target (solid arrow).Insertion angle (a) was the angle of insertion trajectory and horizontal line;B:Euclidian error was the vertical dimension (d) from the center of target (solid arrow) to real needle (triangular arrow).

Process of robot-guided FO puncture

The basic work process of the binocular-stereo-vision-based navigation robot is illustrated in Figure 5.Before the interventional surgery placement,a CT scan of the operation object with four visual markers placed on the skin surface was conducted.The markers were black round labels with one lead sphere (a radius of 1 mm) in the center.The four markers were not placed in one plane.The scanning range of CT images covered the operation target and skin for percutaneous puncture.Then,the CT images were uploaded to the computer system.After three-dimensional reconstruction of the skin surface,the program acquired the spatial location of the markers for registration from cephalad to caudal.Concurrently,a puncture trajectory was designed with the target point and the entry point on the insertion line.

The robot arm and stereo camera were placed beside the operation table.A series of pictures were taken by a stereo camera for locating the markers on the operation object and the robot arm.In the coordinate system of the robot,the location of markers on the arm was obtained automatically after the posture was fixed.Then,the registration process was automatically finished by the system,and the robot arm started to move to the predetermined position for navigation.Through the guiding device at the terminal of the robot arm,the interventional tool was inserted along the planedapproach to a certain depth.

Figure 5 Workflow of robot guided puncture.Before placement,computed tomography images of operation object with four visual markers on skin were obtained and uploaded to the computer system.The robot arm and stereo camera were placed beside the operation table.After locating the markers on operation object and robot arm with camera,registration process was complicated.Puncture trajectory was designed with the target point and entry point on the insertion line.Then,robot arm was commanded to move to specific position.Needle was inserted through the guiding device at the terminal of robot arm to certain depth.

Statistical analysis

The statistical analysis was conducted with SPSS Statistics Version 25 software (IBM Corp.,Armonk,NY,United States).The normality distribution of the quantitative parameters was determined by the Shapiro-Wilk test.Quantitative data are presented as the mean ± SD or the median with 25thand 75thpercentiles.The qualitative parameters are expressed as a number and percentage.Thet-test,analysis of variance(least significant difference method) and Mann-WhitneyUwere used for the comparison of quantitative data between groups.Fisher's exact test was utilized for the comparison of qualitative data.The level of statistical significance was set toP<0.05.

RESULTS

Needle insertion on the box model

Puncture of three short-distance targets,three moderate-distance targets and three long-distance targets were all repeated three times.A total of 29 punctures were conducted.The puncture parameters of different targets are stated in Table 1.The difference of mean Euclidian error among three kinds of targets was statistically significant.The mean Euclidian error for long-distance target was significantly greater than those of short-distance target and moderate-distance target (P<0.05).No significant differences were found between short and moderate distance targets (P>0.05).

Needle insertion on head phantom

A total of 18 procedures were done in both groups.Between the two groups,no significant difference was found in operation time (P>0.05),but the one-time success rate in robotic group was significantly higher than that in free-hand group (P<0.05).Median adjustment time was also fewer in robotic group than in free-hand group (P<0.05) (Table 2).

In robotic group,the average operation times were 403 ± 87 s,358 ± 71 s and 406 ±100 s for three operators.Median adjustment times were 0 (0,1),0 (0,0.5) and 0 (0,1)for three performers.No significant differences in operation time and adjustment time were found among performers (P>0.05).

Table 1 Puncture parameters and Euclidian error for different targets

Table 2 Comparison of operation parameters between two methods

DISCUSSION

The tracking method is the pivotal process in surgical navigation.This method is used to match the spatial position of target,instrument or robot arm,and this can influence the accuracy of the whole navigation system.The tracking systems applied in most commercial navigation equipment is the active optical tracking system[18-20].The active optical tracking system is superior to other methods,such as electromagnetic tracking systems,but it is expensive and inconvenient for further development[19].Our team has recently designed an optical tracking method based on binocular stereo vision with a high-resolution ratio and low cost.Black round labels were used as markers pasted on the skin of operation region and the robot arm.The three-dimensional location of label center can be recognized by the ZED binocular camera for registration and tracking[16].The error of this tracking method was evaluated in our previous study.In this research,we further evaluated the position accuracy of the navigation robot system based on this tracking method.

The interventional therapies for chronic pain vary from one another,and the depths of different operation targets are also variant.To evaluate the position error of the robot as comprehensively as possible,we set three kinds of simulated targets in the box model with three levels of puncture depth.As the thinnest scanning thickness of our CT is 1 mm,the radius of sphere target was set as 1 mm to reduce the influence of scanning.When compared with other equipment[21-24],the results of our research are promising given the same accuracy of the navigation robot.For short- and mediumdistance targets,the position errors were 1.7 ± 0.9 mm and 2.4 ± 1.0 mm,respectively.Although the target is still,this accuracy is acceptable and compatible for most interventional treatments.For long-distance targets,the position error was 4.4 ± 1.4 mm and relatively large for surgical navigation.The inaccuracies of this robot system may have come from several sources.The first one is the system error,and the error of the tracking system may account for the main part.The mechanical error of the robot arm is very small because the Universal Robot arm is used for industry processes,and the error is significantly less than 1 mm.The second factor may be the bending of the needle.With the existence of an inclined plane,the longer the needle is inserted,the more obvious the needle bends.Furthermore,the orientation of the inclined plane may also affect the accuracy[25].

Trigeminal neuralgia is a common chronic pain disease[26].Most of the interventional therapies for this disease require placement of the FO,which is a difficult and challenging procedure[27].We compared the difference of FO punctures performed by freehand and under guidance of the robot to evaluate the clinical potential.The result showed that robot assistance can significantly raise the success rate of punctures.Furthermore,the operation time was also shortened.The longest and shortest diameters of the FO inside hole were X and Y mm.The insertion depth was Z mm.Considering the placement distance,the diameter of the FO is relatively larger than the position error.Finally,five robot-assisted cases were not completed in one time.Timewise, this robot system is reasonable. The preparation time included preoperative scanning,image processing,trajectory design,registration and the robot arm moving.The whole preparation took approximately 5 min,and the registration time was approximately 1 min.Although no difference was found between the operation time of the two groups,the whole time was still slightly shorter with the robot.Our data showed no significant difference in operation time and adjustment time among the performers.This result indicated that our robot system is stable and not easily influenced by the operator.

Our study has several limitations.The first one was the still model.When operating on patients under local anesthesia,the inevitable dodge,body twist and breathing movements can influence the puncture.However,these factors were not simulated in our study.To reduce the influence of these factors in clinic,based on our experience,three measures can be taken:Fixation with headrest,sufficient local anesthesia before registration and appropriate sedation.Second,the needle used in our experiment has a cutting edge,which may induce a needle-tissue force.Pen-point needles should be used for the improved evaluation of position error.The test time was small.More tests with different angles at different depths should be conducted.

In conclusion,in the laboratory environment,the accuracy of the binocular-stereovision-based navigation robot is acceptable for interventional treatment with a target at a 100 mm depth or less.The robot navigation is stable,and accuracy of FO placement can be improved with the guidance of robot.In spite of the need for improved performance,we believe this navigation tool deserves clinical application and promotion.

ARTICLE HIGHLIGHTS

Research background

Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomographyimage based navigation robot using new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.

Research motivation

The feasibility,accuracy and stability of this new robot need to be tested before clinical application.

Research objectives

To assess quantitatively the feasibility,accuracy and stability of the binocular-stereovision-based navigation robot for minimally invasive interventional procedures.

Research methods

A box model was designed for assessing the accuracy for targets at different distances.Nine (three sets) lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm (short-distance),100 mm (medium-distance)and 150 mm (long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms (both sides) by freehand or under the guidance of robot (18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidance methods were compared.

Research results

On the box model,the mean puncture errors of navigation robot were 1.7 ± 0.9 mm for the short-distance target,2.4 ± 1.0 mm for the moderate target and 4.4 ± 1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers (P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods (P>0.05).The accuracy measurement was conducted on still models,and further clinical research on patients need to be conducted.

Research conclusions

In laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.

Research perspectives

Based on our research,binocular-stereo-vision-based navigation robot is a promising system in the future.It deserves promotion after clinical verification,especially for interventional treatment of chronic pain.