|M.Sc. candidate||Anna Mafrica|
|Thesis||Design of an electromagnetic cortical stimulator for brain mapping during open skull neurosurgery|
|Supervisors||Elena De Momi, Giancarlo Ferrigno|
|Description||Awake brain surgery is a neurosurgical technique mainly involved in brain tumors resection or in epilepsy surgery. In this procedure, the use of intraoperative brain mapping becomes essential firstly to reliably identify cortical areas and subcortical pathways involved in motor, sensory, language, and cognitive function in order to preserve the functional cortex and secondly to maximize the resection of the lesion. The actual golden standard to perform brain mapping is Direct Cortical Stimulation (DCS): a current is directly injected in the cortical tissue and the peripherical response is analysed in order to map the most important cortical areas near the lesion that has to be removed. The main drawbacks of DCS are firstly that the direct injection of currents in the brain cortex can induce seizures and secondly that this technique has a low resolution and very low penetration below the cortex surface.
The aim of this work is to propose an alternative tool for the intraoperative cortical mapping, allowing for a navigated, contactless stimulation of the cortex using coils inducing fast changing magnetic field on the brain tissues through a flexible magnetic circuit. The concept is to exploit an effect similar to Transcranial Magnetic Stimulation technique (already used to perform preoperative brain mapping) during the intraoperative phase and with a substantial higher resolution in space.
|M.Sc. candidate||Maria-Paola Forte|
|Thesis||Mathematical methods to recognize and analyse surgical tasks|
|Supervisors||Elena De Momi, Nima Enayati|
|Description||In recent years, the advancements in technology deeply influenced the surgical field leading to the development and wide adoption of Robotic Minimally Invasive Surgery (RMIS) systems, such as Intuitive Surgical’s daVinci. This technology has several advantages compared to the traditional surgery, among which greater precision, smaller incisions and shorter recovery time.
da Vinci’s ability to acquire the video from its stereo endoscope opens the opportunity of creating mathematical methods to recognize and analyse surgical tasks. These models can then be used to provide assistance to either trainees or expert surgeons. By now the robotic guidance is mainly rigidly-designed for specific tasks (especially by means of Virtual Reality). As a further step, the idea is to try to offer a context-aware assistance.
The aim of this project is to create a general platform able to provide the afore-mentioned guidance in real-time. Features from the acquired video are extracted with Computer Vision techniques and then Machine Learning is used to build the model of the under-analysis surgical task. Once the next phase of the task is predicted, the relative cognitive assistance will be provided.
|M.Sc. candidate||Laura Erica Pescatori|
|Thesis||Action recognition during minimally invasive robot assisted surgery|
|Supervisors||Elena De Momi, Hirenkumar Nakawala|
|Description||Robot-assisted minimally invasive surgery has been developing and increasing over the last years. One of the main robots used with this aim is the da Vinci robot. It allows the surgeon to see inside the patient’s body thanks to a camera and to control the instruments inserted in the patient’s cavity through the use of a console. Many kind of surgery can be carried on with da Vinci and the one considered in this work is partial nephrectomy which consists of the removal of the tumor situated in the kidney.
The aim of this work is to use neural networks in order to allow the robot understand which action the surgeon has been carried on and, based on this, also what would be the following action. This network is created thanks to the use of annotated videos of such surgery procedures. Using images extracted from videos and the optical flow calculated between two subsequent images the network can be trained and thus will be able to classify the correct actions once a new video is fed to it.
|M.Sc. candidate||Andrea Mariani, Edoardo Pellegrini|
|Thesis||Motor-Learning In Surgical Tele-Operation: Training Assessment And Improvement|
|Supervisors||Elena De Momi, Peter Kazanzides (JHU), Nima Enayati|
More in detail, the project comprises two principal aims:
1) Design and evaluation of physical assistive methods in training
The first aim of the thesis is to investigate the effects of providing physical guidance in primary phases of tele-operated surgical training. This robot-assisted training guides the trainee through motion, force, torque, or vibration cues applied by the master device and is adapted to users’ progress. Such an assistive method is hypothesized to facilitate the initial stages of training by preventing cognitive overload. These methods are studied through multiple experiments using a tele-operation virtual reality setup with statistically significant populations of subjects. The results of the study should reveal potential benefits or harms of motion guidance in skills training in terms of both immediate improvements and long-term retention.
2) Design and evaluation of adaptive training programs
The second objective of the study is the evaluation of a method that aims at automatically scheduling the training on the base of an objective assessment of the trainee’s performances. More precisely, the underlying hypothesis turns into: can a “smart” training allow to obtain better final performances with respect to a self-managed training, where the word “smart” refers to the fact that the training schedule is arranged in an automatic and performance–based way? Moving from the identification of the basic and fundamental surgical skills towards the design of teleoperative tasks that could train these skills, the study focuses on the formulation of ML methods to assess the surgeon mastery of these abilities and the autonomous adaptation of the training program accordingly. Finally, the potentialities of this training approach are evaluated through the experimental comparison of statistically significant populations of subjects, one of which attending a ‘smart’ adaptive schedule and the other a canonical approach (i.e. employed by the commercial trainers) based on the user’s choices.
|M.Sc. candidate||Francesco Grigoli|
|Thesis||Segmentation of surgical gestures for tasks recognition and skills evaluation|
|Supervisors||Nima Enayati, Elena De Momi, Aleks Attanasio|
|Description||New technologies, as the robotic surgical systems, record motion and video data guaranteeing access on hidden features useful evaluate the surgeon’s skills. Data as the completion time, force/torque interaction and kinematic values can be directly used for this purpose.
Other approaches use the acquired features to segment surgical gestures and build models to classify surgical expertise using also the uncover concealed patterns. Considering the statistical distance from the user’s model from that of an expert a more complete measure of the user’s skills is reached.
To model surgical tasks, variations of the Hidden Markov models (HMMs), as in speech recognition, are widely used, however, due to the high complexity of the surgical procedures the definition of the observation model is challenging and the problem is still open. Using the kinematic labelled data from the JIGSAWS dataset, we are traying to overcome this issue paring a time series Neural Network (NN) algorithm, rude but able to catch the general aspects surgical gestures common to many tasks with a task specific HMM.
The HMM we are using for one task is composed by two levels. The deepest one is built considering an HMM for each gesture with multivariate Gaussian distributions as emitting states; these models are trained independently with the Baum-Welch algorithm, over data reduced with Linear Discriminant Analysis (LDA). The second level is an HMM that links all the models of the gestures considering task specific constrains. The final Algorithm will give a good classification of the gestures in a surgical procedure allowing us in building the user’s model to be compared with the expert one.
|M.Sc. candidate||Mohatashem Reyaz Makhdoomi|
|Thesis||Adaptive Control of Teleoperated KUKA LWR 4+ in Minimally Invasive Surgery|
|Supervisors||Elena De Momi|
|Description||The well-known KUKA Light Weight Robots (LWR) have been popularly integrated into surgical systems for MIS with the advantage of achieving good surgical precision, enhanced dexterity and range of motion. These robots are light-weight, capable of high accuracy, have large DOFs and compliance. They can be manipulated manually and can follow defined tool-trajectories relative to anatomical features on the patient through different control modes. For the sake of achieving compliance during minimally invasive surgeries, cartesian impedance control is used to secure the accuracy of the surgical task. A secondary task, such as the guaranteeing a flexible workspace to the medical staff, by enabling a compliant swivel motion at the robot’s elbow can be obtained by controlling its null space. However, there are limitations in the mentioned strategies. Despite guaranteeing compliant behavior, Cartesian Impedance control does not guarantee the accuracy as high as demanded by a surgical intervention. During teleoperation, the surgical tool tracks the specified desired cartesian position albeit with some undesirable error. Since the uncertain human-robot interaction in the null space, the forces experienced by the robot manipulator are uncertain and time-varying, leading to the error in the surgical task. Impedance control parameters are not competent enough to work out such uncertainties.
In the field of control engineering, direct adaptive fuzzy controllers are known to perform well in presence of uncertainties and disturbances. In addition to it, supervisory control has been used to restrict the error within certain feasible limits. It is capable to achieve higher accuracy and quality in the MIS.
This work aims at addressing the above-mentioned limitations. It is divided into two objectives: Firstly, to develop an adaptive fuzzy controller to reduce the task error despite the uncertainties. Secondly, to develop a supervisory control to constrain the error within feasible limits. The work has been performed in three stages:
– Validating the proposed controllers in Simulink.
– Development and Implementation of controllers on simulations using V-rep and ROS.
– Implement of the proposed algorithm on the real robot
|M.Sc. candidate||Andrea Passoni|
|Thesis||Human – Robot Interaction in Teleoperation: stiffness modulation during a reaching task|
|Supervisors||Elena De Momi, Jacopo Buzzi|
|Description||In tele-operated robot assisted surgery, surgeons use a robotic input device (master) to control the remote tele-manipulator (slave). With respect to traditional laparoscopy, tele-operated robotic surgery has brought several advantages, like improved ergonomics, motion scaling and the possibility of filtering the surgeon’s hand tremor, but remains a complex sensorimotor task also due to the multiple redundancies (kinematic and kinetic) that characterize the human motor control.
Up to now, the dynamic properties of the human arm have not been fully considered in the design and optimization of the master interfaces, considering both the human operator and the robot as passive elements. Through the estimation of user’s arm endpoint stiffness, that is the predominant component of the arm impedance, it would be possible to implement a master controller able to regulate the human – robot interaction.
The aims of this master thesis are, in particular:
|M.Sc. candidate||Anna Morelli|
|Thesis||Intra-operative deformable registration for Augmented Reality in nephrectomy|
|Supervisors||Elena De Momi, Sara Moccia|
|Description||Renal cell cancer is a kind of kidney tumor that affects 14,068,000 patients all over the world. The treatment for this disease is nephrectomy, a surgical procedure in which the entire kidney, or only a part of it, is removed. Nowadays the procedure can be performed in minimally invasive surgery, allowing reduction of bleeding, of pain and of recovery time; the drawbacks of this technique is, for the surgeon, the impairment of haptic feedback for the discrimination of different structures. To overcome this limitation, Augmented Reality (AR) systems have been proposed. In an AR operating environment the pre-operative kidney model, usually extracted from CT or MRI, is superimposed onto the surgical field of view. Potential clinical advantages are offered in two stages: 1) in the identificiation of important structures, such as vessels, tumor, healthy tissues, in the initial phase; 2) during tumor resection, fixing negative surgical margins for the instruments.
Focusing on the first advantage, the superimposition during the first phase can be obtained starting from a landmark-based initial alignment of the model to the intra-operative scene. The intra-operative scene is recorded with a stereo-camera to obtain the intra-operative 3D reconstruction, i.e. the intra-operative point cloud. Then, with a deformable registration algorithm, it is possible to find the transformation to map the pre-operative model into the intra-operative point cloud.
The aims of this project are: i) implementing an algorithm for the initial registration based on manual identified landmarks; ii) implementing a deformable registration algorithm to robustly deal with the intra-operative deformation of the kidney.
|M.Sc. Candidate||Antonio Gallarello|
|Advisor||Elena De Momi; Helge Wurdemann|
|Collaboration||Mechanical Engineering Lab, University College London|
|Title||Patient Specific 3D printed test bed for Transcatheter Aortic Valve Implantation procedure|
Aortic stenosis (AoS) is a disorder characterized by the reduced cardiac output from the left ventricle (LV) due to a narrowing of the aortic valve. The causes of this diseases are both age-related calcifications and bicuspid valve. The most important aspect of this disease is that is associated with significant comorbidities in more than one-third of cases. The disease is similar to atherosclerosis; progressive deposition and valvular thickening results in the obstruction of the LV outflow tract. This leads to a LV hypertrophy, a reduced ventricular compliance and a diastolic dysfunction. The onset of symptoms of sever AoS is the starting point of a rapid decline with a mortality rate in the first year around 50% (8).
The surgical aortic valve replacement (AVR) is a procedure that is currently used, even for elderly patients, as long as they are suitable for that. Indeed, the European Society of Cardiology recommend TAVI (Transcatheter Aortic Valve Implantation) only for people who are unsuitable for the surgical procedure due to many comorbidities. Moreover, conventional AVR might be very challenging or prohibitive in patients with mediastinal fibrosis or adhesions following radiotherapy or previous surgery.
In 2002, the first TAVI procedure was performed (22). Since then, its rate has risen greatly with more than 50000 having been performed worldwide (23). This procedure allows the treatment of patients that cannot undergo surgical valve replacement. Moreover, it has better outcomes in terms of functional capacity and also the hospitalization have reduced.
The first TAVI was performed using a venous access (right femoral vein), with a trans septal puncture to reach the left ventricle . This high-risk procedure was soon replaced by the currently used which exploits an arterial insertion point (femoral or subclavian artery), with a retrograde approach. The use of peripheral vessels requires a favourable anatomy. In presence of small calibre, heavily calcified ort tortuous vessels some problems may arise. Another technique reckons on a direct cardiac access through the apex of the heart with a mini thoracotomy. This is more invasive than the ones previously explained.
The aim of this work is to develop a 3D printable, patient-specific, vascular phantom with mechanical properties similar to the human tissue so as to be used as a test bench for the developing of a new technology of TAVI catheter. Different steps are required: Image segmentation, Model refining, material and thickness evaluation and 3D printing. The overall device should be a made of different modular parts, independently printed but linkable.
|M.Sc. Candidate||Stefano De Nigris|
|Advisor||Elena De Momi, Digna M González-Otero (EHU-UPV), Jesús Ruiz(EHU-UPV), Sofía Ruiz de Gauna(EHU-UPV)|
|Title||Application of accelerometer-based chest compression feedback devices in novel scenarios|
|Collaborations||Laboratorio GSC (Grupo Señales y Comunicaciones), Universidad del País Vasco (EHU-UPV), Bilbao, Spain|
Sudden cardiac arrest is the largest cause of natural death worldwide. Early cardiopulmonary resuscitation (CPR) is key for patient survival. Resuscitation guidelines emphasize the importance of providing high quality chest compressions, that is, with a rate of 100 compressions per minute and a depth of 5cm in adults and one third of the diameter of the chest in children. However, meeting these requirements is difficult, even for well-trained rescuers.
The use of feedback systems can help rescuers increase chest compression quality. Most of these devices measure the acceleration of the chest during compressions, and guide the rescuer towards the target rate and depth. However, these systems present two main limitations. First, they are designed for adult patients, and thus present a target depth of 5cm, which is inadequate for children. Second, they could be inaccurate when used in moving vehicles, such as a train or a plane, as they would register the acceleration of the vehicle along with that of the patient’s chest.
The work tackles those two limitations. It is divided in two main objectives: First, to develop and test an algorithm to measure the diameter of the chest using an accelerometer. This algorithm could be used to adapt feedback systems to be used in pediatric patients. Second, to propose and test an additive model to evaluate the accuracy of accelerometer-based CPR feedback devices in moving vehicles, and to apply it to the case of a plane and train.
The results of this thesis could extend the scenarios of application of feedback systems, allowing their use in pediatric cardiac arrests or in public transportation means.