PhD Candidate

Sara El Hadji

Advisors

Elena De Momi; Giuseppe Baselli

Description

Segmentation and visualization of brain vessels are important in many neurological diagnostic and therapeutic applications: Embolization of cerebral arteriovenous malformations (AVMs), or their radio-surgical treatment, make the three-dimensional (3D) reconstruction of brain vasculature of utmost importance and several studies indicate that 3D visualization of brain vasculature within multimodal imaging proved to be useful in epilepsy surgery. In particular, StereoElectroEncephaloGraphy (SEEG) planning, in addition to an accurate reconstruction of the cerebral vascular tree, requires also a distinction of arteries and veins, in order to increase the safety of the intervention and improve the completeness of the pre-operative planning phase.
The main objective of this PhD thesis is the development of a novel method for the automatic classification as arteries or veins of previously segmented vessels, obtained through the post-processing of cone-beam CT (CBCT) raw projection data together with the angiogram obtained from a CBCT digital subtraction angiography (DSA). The presented approach extends the iterative algebraic solution from a linear time invariant (ART) to a linear time variant system exploiting information about system dynamics during contrast-enhanced CBCT acquisitions. The Acronym ART was thus extended to the case of dynamic image reconstruction, accordingly named ART 3.5D. The strategy works on the 3-D angiography, previously segmented in the standard way, and reprocesses the dynamics hidden in the raw data to recover an approximate dynamic in each segmented voxel. Next, a classification algorithm labels the angiographic voxels and artery or vein.
Other topics investigated during the phd includes the application of deep learning technique for 3D brain vasculature segmentation, sinogram preprocessing and artifacts reduction and CBCT reconstruction.
This research study is conducted in collaboration with Dr. Francesco Cardinale, Epilepsy neurosurgeon at the Ospedale Ca’ Granda, Niguarda (Italy), and Medtronic (Littleton, Boston, USA).

PhD Period

XXXII cycle (February 2016 – F ebruary 2019).

PhD Candidate

Andrea Cimolato

Advisors

Elena De Momi, Leonardo De Mattos, Matteo Laffranchi

Collaborations

Italian Institute of Technology

Title

EMG-driven control in lower limb prosthesis

Description

Background: Neurorobotics leads human-technology interaction in the field of rehabilitation and prosthesis devices. Recent technology innovations made possible to design the modern generation of smart prostheses able to behave accordingly to different environmental interaction and user locomotion recognition. Thanks to hierarchical controllers (Fig 1), semi-active and powered prosthesis can change their joint impedance adapting to user necessities, avoiding undesired energy expenditures. In spite of this, lower limb microprocessor controlled prostheses stands far behind from upper limb solutions, those are able to decode volitional motion intent through the employment of Electromyographic (EMG) signals.

Purpose: The objective of this PhD project is to design a novel control approach for lower limb neuroprosthesis based on EMG signals and other mechanical variables such joint angle position and velocities, linear accelerations and load. The designed control should permit the user to both voluntarily and automatically control the prosthesis depending on the incoming sensor signals.

On Going Work:

1) The first intent of this study will be to exploit the great potentialities resilient in musculoskeletal models for the design of novel EMG-driven control. The use of musculoskeletal model results particular handy in situation where biological internal variables are not directly accessible such as muscle length and activation (Fig 2). In this way, it is possible to compare the model results with the EMG measurements in order to derive a particular correlation that will be employed for the prosthesis control.

2) Second perspective of this is to study and to understand the possible employment of muscle synergies in the design of a neuro-driven Human Machine Interface. Further analysis will investigate how these synergies decay or modify with the amputation of the limb in final users.

PhD Period

XXXII cycle (May 2017 – May 2020).

PhD Candidate

Matteo Sposito

Advisors

Elena De Momi, Jesus Ortiz

Collaborations

Italian Institute of Technology

Title

Advanced physical Human-Robot Interfaces for full body orthotic devices

Description

There is growing interest in devices that aim to relief workers while performing physically demanding tasks characterized by poor ergonomics (e.g. overhead assembly or load lifting). Force augmenting industrial exoskeletons are one of the solution that is more promising for the performances they are capable of. However, several aspects still need to be optimized for a widespread of those devices in factories. Physical Human-Robot Interfaces (pHRI) are one of those aspects; an interface is responsible of transmitting assistive force to the body and link the exoskeleton to wearer. Interfaces alone are a matter of safety, comfort and efficiency of the device itself.
This work aims at developing a full set of interfaces (such as cuffs, braces, shoulder straps or any other type of attachment) that are optimized for unloading and transmitting forces in a comfortable and efficient way. Design requirements are dictated by user safety and comfort metrics, force transmission and robot stability. This research project includes different activities such as the formal description of the problem of stability and force transmission of the whole exoskeleton with a free body diagram, evaluation of different pressure and F/T sensors for the attachment in order to monitor user comfort, safety and collect feedback for an iterative design process, attachment prototyping and assessment.

PhD Period

XXXIII cycle (May 2018 – May 2021).

PhD Candidate

Alice Segato

Advisors

Elena De Momi

Collaboration

San Raffaele Hospital

Title

3D Navigation and Path Planning using Reinforcement Learning for Steerable Needle.

Description

The PhD Thesis focuses on developing a new model based reinforcement learning method that efficiently combines path planning methods and learnable heuristics for keyhole neurosurgery.
The problem of finding the best trajectory for brain surgery intervention can be formulated as a decision process where at every visited node an optimal action has to be taken minimizing the total accumulated cost. Replacing cost by reward, any such algorithm that generates cost minimizing actions generates reward maximizing actions thus becoming a candidate solver for Markov Decision Processes (MDPs). The final aim is to assist surgeons during the trajectories planning phase and improve the results in terms of precision, safety and time consumption. The work uses the EDEN2020 steerable catheter as a case study and defines surgical trajectories in the context of Convention Enhanced Delivery.

PhD Period

XXXIV cycle (Nov 2018 – Nov 2021)

PhD Candidate

Soheil Gholami

Advisors

Elena De Momi, Dr Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Developing an Ergonomic Shared-Autonomy Teleoperation Interface.

Description

Most of the current teleoperation frameworks have focused on the system’s stability and transparency; however, another equally important aspect, i.e. the intuitiveness-of-use of the teleoperation interfaces, has received less attention. This is of particular importance when users must operate multi degrees-of-freedom (DoF) slave systems that are embedded with dexterous loco-manipulation potential such as mobile manipulators or humanoids. In most of the related interfaces, a human-user, who is equipped with motion capture systems and watching a graphical user interface, constantly generates appropriate motions for a slave robot to accomplish the desired task. Nevertheless, such an interface may be perceived as bothersome during prolonged or repetitive tasks, e.g., for long-distance target reaching operations. To address this problem, a fully autonomous system seems to be a practical solution. However, it lacks flexibility in incorporating human reactive, monitoring and supervisory roles for handling unpredicted system’s faults and behaviors. Utilising autonomous and corrective control inputs simultaneously, which are somehow combined with the human monitory commands may arise as an effective solution to improve target-reaching accuracy and time. This kind of system may be called shared-autonomy teleoperation. Besides, monitoring the human-factors and ergonomics to be remained at an optimal level, based on some predefined indices, has particular importance to decrease human physical and mental workloads during the task accomplishment. Hence, the purpose of this Ph.D. theme is to develop an “Ergonomic Shared-Autonomy Teleoperation” interface to deal with the before-mentioned challenges.

PhD Period

XXXIV cycle (May 2019 – May 2022)

PhD Candidate

Alessandro Casella

Advisors

Elena De Momi, Leonardo De Mattos, Sara Moccia

Collaboration

Italian Institute of Technology

Title

Computer Vision Technologies for Computer-Assisted Fetal Therapies.

Description

Twin-to-twin transfusion syndrome (TTTS) may occur, during identical twin pregnancies, when abnormal vascular anastomoses in the monochorionic pla-centa result in uneven blood flow between the fetuses. If not treated, the risk of perinatal mortality of one or both fetuses can exceed 90%. To recover the blood flow balance, the most effective treatment is minimally invasive laser surgery in fetoscopy. Limited field of view (FoV), poor visibility, fetuses’ movements, high illumination variability and limited maneuverability of the fetoscope directly impact on the complexity of the surgery. In the last decade, the medical field has seen a dramatic revolution thanks to the advances in surgical data science analysis such as Artificial Intelligence (AI) and in particular Deep Learning (DL). However, few efforts have been spent in fetal surgery applications, mainly to the reduced availability of datasets and the complexities of fetoscopic videos, which are of low resolution, and lack in texture and color contrast.
Considering these challenges and limitations in the state of the art, this PhD project focuses on the exploration of deep learning techniques for the development of tools for computer-assisted fetal surgery.

PhD Period

XXXIV cycle (May 2019 – May 2022)

PhD Candidate

Zhen Li

Advisors

Elena De Momi, Jenny Dankelman

Collaboration

Delft University of Technology (TU Delft)

Title

Path planning and real-time re-planning

Description

Given the deformable nature of the surroundings, RT planning and control is needed in order to guarantee that a flexible robot reaches a target site with a certain desired pose. ESR 13 will implement an accurate kinematic and dynamic model of the flexible robot incorporating knowledge on the robot limitations right in the planning algorithm so that the best paths are executed pre-operatively, considering the constraints on allowable paths, the location of the anatomic target and intra-operatively including the uncertainties in the adopted (and identified) flexible robot model and of the collected sensor readings (ESR5).
Advanced exploration approaches will be adapted to each specific clinical scenario, its constraints as well as the robot constraints such as its manipulability. Specific clinically relevant optimality criteria will be identified and integrated. This methods could try to keep away sharp parts of the instrument (e.g. tip) from lumen edges. RT capabilities will grant the possibility to re-plan the path during the actual operation.

PhD Period

XXXV cycle (Nov 2019 – Nov 2022)

PhD Candidate

Jorge Lazo

Advisors

Elena De Momi

Collaboration

ATLAS

Title

Computer Vision and Machine Learning for Tissue Segmentation and Localization

Description

The ATLAS project will develop smart flexible robots that autonomously propel through complex deformable tubular structures. This calls for seamless integration of sensors, actuators, modelling and control.
While contributing to the state of the art, the candidates will become proficient in building, modelling, testing, interfacing in short in integrating basic building blocks into systems that display sophisticated behavior.
Each flexible robot will be equipped with extero- and proprioceptive sensors (such as FBG) in order to have information on position and orientation, as well as on-board miniaturized cameras. Additionally, RT image acquisition will be performed using US sensors externally placed in contact with the patient outer body. In order to track the position of the flexible robot and to simultaneously identify the environment conditions RT US image algorithms will be developed. Deep learning approaches combining Convolutional Neural Networks (CNNs) and automatic classification methods (e.g. SVM) will extract characteristic features from the images to automatically detect the:

1) Flexible robot shape
2) The hollow lumen edges positions (to be integrated with ESR5)
3) Information on surrounding soft tissue shape and location

RT performance will be achieved by parallel optimization loops.

PhD Period

XXXV cycle (Nov 2019 – Nov 2022)

PhD Candidate

Luca Fortini

Advisors

Elena De Momi, Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Online Robotic and Feedback Strategies for Ergonomic Improvement in Industry

Description

Today manufacturing industries are faced with an increasingly competitive market. Production lines must be flexible and less structured to easily adapt to new workflows. As a result, industrial workers may be exposed to greater danger in terms of posture and load increasing the already dramatic statistics on Musculoskeletal Disorders (MSDs).​ My PhD project aims at improving the online monitoring of human body status to prevent wrong behaviours through the adoption of countermeasures either passive (feedback informative systems) and/or active (cobots, exoskeletons). To guarantee a continuous monitoring the subject is equipped with a set of sensors whose outputs are prerequisites for the estimation of custom ergonomic indexes. Depending on the task performed, a multi-objective ergonomic-based optimisation is run to establish the most suitable way of executing the duty. The outcome is then communicated to the feedback interface and/or to the robotic counterpart.

PhD Period

XXXV cycle (May 2020 – May 2023)

PhD Candidate

Luca Sestini

Advisors

Giancarlo Ferrigno, Nicolas Padoy

Collaboration

ATLAS

Title

Image-Based Tool-Tissue Interaction Estimation

Description

One of the keys to bring situational awareness to surgical robotics is the automatic recognition of the surgical workflow within the operating room (OR). Indeed, human-machine collaboration requires the understanding of the activities taking place both outside the patient and inside the patient.

This project will focus on the modelling and recognition of tool-tissue interactions during surgery to produce human–understandable information to be exploited during procedures inside the OR. The project will involve:
1)Developing a model to represent the actions performed by the endoscopic tools on the anatomy (e.g. through triplets: tool, action performed, anatomy acted upon)
2)Developing and training a deep-learning model to link the procedural knowledge describing the surgery to digital signals (such as endoscopic videos)
3)Exploiting robot model and kinematic information in order to limit the need for manual annotations for model training.

PhD Period

XXXV cycle (Nov 2019 – Nov 2022)

PhD Candidate

Chun-Feng Lai

Advisors

Elena De Momi, Jenny Dankelman

Collaboration

ATLAS

Title

Distributed follow-the leader control for minimizing tissue forces during soft-robotic endoscopic locomotion through fragile tubular environments

Description

Using prior experience on developing snake-like instruments for skull base surgery, the PhD candidate will elaborate these mechanical concepts into advanced soft-robotic endoscopes able to propel themselves forward though fragile tubular anatomic environments to hard-to-reach locations in the body. The ESR has two main goals:
• to use advanced 3D-printing to create novel snake-like endoscopic frame-structures that can be easily printed in one printing step without need for assembly, and that easily integrate cameras, actuators, biopsy channels and glass fibres. FEM-simulations to optimize a) shapes that are easy to bend yet hard to twist and compress (e.g. by using helical shapes), b) minimal distributions of actuators enabling complex and precisely controlled motion.
• to develop follow-the-leader locomotion schemes for moving through fragile tubular environments (e.g. colon or ureter) and evaluate this ex-vivo in anatomic tissue phantoms.

PhD Period

XXXV cycle (Nov 2019 – Nov 2022)

PhD Candidate

Emir Mobedi

Advisors

Elena De Momi, Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Design and Development of Assistive Robotic Technologies for Industrial Applications

Description

In this project, I will propose a novel one DoF underactuated exoskeleton device to allow the human workers achieve their tasks in an ergonomic way. Such a device can then provide assistance for the internal (resulting from the human body) and external (task-related payload) loading. Moreover, the controller frameworks also will be developed to include the aforementioned exoskeletons into the HRC frameworks. Consequently, robot responses will be formed to assist the worker to perform the intended manipulation task in configurations in which the effect of external stimuli on human factors are minimum. An experimental evaluation of the proposed framework will be carried out at HRI2 lab. The outcome of my PhD studies will drive radical improvements in adaptability and time-efficient reconfigurability of the HRC systems to the worker physical states and tasks, and will contribute to the reduction of musculoskeletal disorders (MSDs).

PhD Period

XXXVI cycle (May 2020 – May 2023)

PhD Candidate

Francesco Iodice

Advisors

Elena De Momi, Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Advance Human-Robot Interaction and Collaboration

Description

The collaboration between man and robot is one of the fundamental aspects of Industry 4.0. In this regard, the objective of this theme is to create advanced predictive control schemes that, integrated with computer vision techniques for detection and tracking, and algorithms for mapping and localization of the robot in the environment, will allow the real-time adaptation of collaborative robots to dynamic factors and human intentions. This flexibility will minimize the risk of injury to workers.

PhD Period

XXXVI cycle (May 2020 – May 2023)

PhD Candidate

Fabio Fusaro

Advisors

Elena De Momi, Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Robotic Human-Aware Task Planning And Allocation For Human Robot Collaboration

Description

The raising awareness of worker ergonomics and the flexibility requirements of the modern enterprises have called for a radical change in manufacturing processes. Thereupon, companies started to focus on the design of new production lines, rather than on corrective ex post interventions, which were much more expensive and not always effective. Several new tools such as collaborative robots (cobots) and wearable sensors and displays (e.g., augmented reality) were introduced, with the aim to provide better working conditions for human labour, while keeping high levels of productivity, flexibility, and cost-efficiency in manufacturing processes.
Cobots, in particular, have demonstrated the potential of pushing small-medium enterprises towards highly adaptive and flexible production paradigms. The idea is to exploit robots capabilities to plan and allocate tasks in industrial environments to enhance the efficiency of the production lines not only from an enterprise point of view, e.g. reducing cycle times, costs, but also to improve worker conditions and safety, e.g. reducing workload, improving ergonomics.

PhD Period

XXXVI cycle (May 2020 – May 2023)

PhD Candidate

Francesco Tassi

Advisors

Elena De Momi, Arash Ajoudani

Collaboration

Italian Institute of Technology

Title

Augmented Hierarchical Quadratic Programming based control algorithm for improved human-robot collaboration.

Description

Across many application domains, robots are expected to work in human environments, side by side with people. Interactions between robots and their users will take many forms, from a trained operator supervising several industrial robots, to an older adult receiving care from a rehabilitation robot, to a child safely practicing social, cognitive, or emotional skills with a readily available socially assistive robot. Robotic products are expected to be intuitive, easy to use, and responsive to the needs and states of their users, making human-robot interaction (HRI) a key area of research.
Some areas of robot control deal with very fast interactions with the environment, but HRI is unique in requiring a broad spectrum of temporal dynamics: interactions that happen very quickly (a wink or a twitch of the mouth), interactions that happen very slowly (gradually getting used to a pattern of behavior), and interactions that change unexpectedly (due to context or intent inaccessible to the robot).
The purpose of the PhD theme is to follow this direction in order to deal with the multiple open challenges that characterize the field of HRI. More in detail, the work considers an alternative control algorithm that does not strictly rely on pure motion planning in order to navigate and move in a realistic environment, but that instead allows to specify a desired behavior for the robot, that would be able to accomplish a series of tasks. This is done through the use of optimization-based techniques and Hierarchical Quadratic Programming (HQP), which permits to define a Stack of Tasks (SoT) to be performed by the robot in hierarchical manner. In this way, it possible to account also for human intentions and movements, adjusting the robot behavior on the fly. The aim is thus to improve collaboration between human and robot, increase confidence level and trust in the machine, and ease the human from the most physically and mentally stressful tasks and operations.

PhD Period

XXXVI cycle (May 2020 – May 2023)

PhD Candidate

Ziyang Chen

Advisors

Elena De Momi, Giancarlo Ferrigno, Hang Su

Collaboration

–

Title

Vision-Driven Automatic Path Planner for Da Vinci surgical robot

Description

For the traditional minimally invasive surgery, the surgeon needs to manually design the surgical path, which is time-consuming and not accurate. This project focuses on the design of a novel automatic path planner based on vision for Da Vinci surgical robot. Only through the real-time acquisition of depth images during the operation, a safe and feasible operation path can be automatically planned to solve the disadvantages of the traditional operation mode. The ultimate goal is to help surgeons complete automatic path planning, and improve the safety, accuracy and real-time characteristics of minimally invasive surgery. This research first analyzes the mechanical structure and kinematics of Da Vinci surgical robot. Then, research makes a detailed theoretical analysis of advanced computer vision algorithms. Considering the time-consuming problem of the deep learning model in motion decision-making training, this research also proposes a new working method of dual model selection to improve the training efficiency.

PhD Period

XXXVI cycle (November 2020 – October 2024)

PhD Candidate

Junhao Zhang

Advisors

Elena De Momi, Hang Su

Collaboration

–

Title

Human-robot intelligent collaborative control by multi-sensors based human motion prediction for minimally invasive surgery

Description

In some medical tasks, the medical robot should have the function of assisting human operators to complete some tasks, for example, assisting physicians, patient support, and so on, they provide a flexible workspace for nurses or other staff. In this case, it is necessary to ensure the safety and the flexibility. Therefore, in this project:
1)Firstly, some human motion intention estimation methods will be proposed. With the help of inertial sensors, visual sensors and force sensors, human motion trajectories and force trajectories can be modeled with probabilistic models, such as the Gaussian process, through which human motion intention can be predicted by regression.
2)Secondly, the robot can adapt its own control strategy based on human motion prediction. Different from trajectory planning, this work aims to solve how to design an adaptive control strategy with real-time human motion prediction ability for robots.

PhD Period

XXXVI cycle (November 2020 – October 2024)

PhD Candidate

Junling Fu

Advisors

Elena De Momi, Hang Su

Collaboration

–

Title

Human-robot skills transfer during robot-assisted minimally invasive surgery

Description

Robot-assisted minimally invasive surgery has great potential for improving the accuracy, dexterity of surgeons while minimizing trauma to the patients. However, surgeons are required to implement delicate and complex operations during RAMIS, including cutting, stitching, knotting. To release the complexity of surgical operations and reduce the workloads of surgeons, human-robot skill transferring is proposed to improve the practicability of surgical robots.
1) Learning the surgical skills from surgeon experts and reproduce these surgical operations is an effective way to enhance the autonomy of the surgical robot in RAMIS. Three stages are included in this process, namely, demonstration, learning, and reproduction.
2) To improve the flexibility of surgical manipulators and achieve human-like control, advanced control algorithms will be implemented, e.g. variable stiffness control. Besides, haptic feedback will be integrated to realize the realistic immersion and enhance safety during RAMIS.

PhD Period

XXXVI cycle (November 2020 – October 2024)

PhD Candidate

Ke Fan

Advisors

Elena De Momi, Giancarlo Ferrigno, Hang Su

Collaboration

–

Title

Augmented reality (AR) guidance of the surgeon based on real-time 3D reconstruction of the surgical field

Description

Augmented reality (surfaces reconstruction and feature tracking) can enhance the surgical safety in robotic-based interventions largely. Based on the real-time 3D reconstruction of the surgical area, using dynamic active constraints, wearable devices are used for augmented reality guidance for surgeons and restrict the instrument to a safe area. The demonstration platform is based on the da Vinci surgical system. The laboratory model will be tested with surgeons to make the technology easier to develop and validate the acceptance by clinicians.

PhD Period

XXXVI cycle (November 2020 – October 2024)