George Mylonas

RO
h-index28
6papers
2,618citations
Novelty35%
AI Score26

6 Papers

5.8ROJun 19
Overcoming Imperfect Kinematics in Surgical Robotics Through Sim-to-Real Visuomotor Learning

Zhaoxuan Yan, Kaizhong Deng, Zhaoyang Jacopo Hu et al.

Robot-Assisted Surgery is integral to modern minimally invasive procedures, with automation emerging as the next frontier to enhance precision and reduce surgeon fatigue. This evolution is largely impeded by the inherent kinematic inaccuracies of surgical robots, where unreliable internal sensors lead to significant control errors. While previous methods attempted to mitigate these issues through complex model-based calibration, they often suffer from high cost and limited effectiveness. This work utilises a learning-policy to actively compensate for hardware inaccuracies using closed-loop visual feedback that was trained from a teacher-student learning framework. The policy can fuse unreliable internal readings with precise external visual data, allowing it to correct for kinematic errors in real time without needing a perfect physical model. The learned policy was successfully deployed on the da Vinci Research Kit, where experiments validated the fundamental feasibility of using external vision to overcome internal sensor deficits. This research provides a foundational and reliable control methodology, paving the way for more advanced and robust surgical automation.

14.5ROMay 9, 2025
Multi-Agent Systems for Robotic Autonomy with LLMs

Junhong Chen, Ziqi Yang, Haoyuan G Xu et al.

Since the advent of Large Language Models (LLMs), various research based on such models have maintained significant academic attention and impact, especially in AI and robotics. In this paper, we propose a multi-agent framework with LLMs to construct an integrated system for robotic task analysis, mechanical design, and path generation. The framework includes three core agents: Task Analyst, Robot Designer, and Reinforcement Learning Designer. Outputs are formatted as multimodal results, such as code files or technical reports, for stronger understandability and usability. To evaluate generalizability comparatively, we conducted experiments with models from both GPT and DeepSeek. Results demonstrate that the proposed system can design feasible robots with control strategies when appropriate task inputs are provided, exhibiting substantial potential for enhancing the efficiency and accessibility of robotic system development in research and industrial applications.

7.2ROJul 14, 2018
Free-View, 3D Gaze-Guided, Assistive Robotic System for Activities of Daily Living

Ming-Yao Wang, Alexandros A. Kogkas, Ara Darzi et al.

Patients suffering from quadriplegia have limited body motion which prevents them from performing daily activities. We have developed an assistive robotic system with an intuitive free-view gaze interface. The user's point of regard is estimated in 3D space while allowing free head movement and is combined with object recognition and trajectory planning. This framework allows the user to interact with objects using fixations. Two operational modes have been implemented to cater for different eventualities. The automatic mode performs a pre-defined task associated with a gaze-selected object, while the manual mode allows gaze control of the robot's end-effector position on the user's frame of reference. User studies reported effortless operation in automatic mode. A manual pick and place task achieved a success rate of 100% on the users' first attempt.

3.2RODec 11, 2017
Surgical task-space optimisation of the CYCLOPS robotic system

T. J. C. Oude Vrielink, Y. W. Pang, M. Zhao et al.

The CYCLOPS is a cable-driven parallel mechanism used for minimally invasive applications, with the ability to be customised to different surgical needs; allowing it to be made procedure- and patient-specific. For adequate optimisation, however, appropriate data on clinical constraints and task-space is required. Whereas the former can be provided through preoperative planning and imaging, the latter remains a problem, primarily for highly dexterous MIS systems. The current work focuses on the development of a task-space optimisation method for the CYCLOPS system and the development of a data collection method in a simulation environment for minimally invasive task-spaces. The same data collection method can be used for the development of other minimally invasive platforms. A case-study is used to illustrate the developed method for Endoscopic Submucosal Dissection (ESD). This paper shows that using this method, the system can be succesfully optimised for this application.

3.2RODec 9, 2017
ESD CYCLOPS: A new robotic surgical system for GI surgery

Timo J. C. Oude Vrielink, Ming Zhao, Ara Darzi et al.

Gastrointestinal (GI) cancers account for 1.5 million deaths worldwide. Endoscopic Submucosal Dissection (ESD) is an advanced therapeutic endoscopy technique with superior clinical outcome due to the minimally invasive and en bloc removal of tumours. In the western world, ESD is seldom carried out, due to its complex and challenging nature. Various surgical systems are being developed to make this therapy accessible, however, these solutions have shown limited operational workspace, dexterity, or low force exertion capabilities. The current paper shows the ESD CYCLOPS system, a bimanual surgical robotic attachment that can be mounted at the end of any flexible endoscope. The system is able to achieve forces of up to 46N, and showed a mean error of 0.217mm during an elliptical tracing task. The workspace and instrument dexterity is shown by pre-clinical ex vivo trials, in which ESD is succesfully performed by a GI surgeon. The system is currently undergoing pre-clinical in vivo validation.

1.7RODec 9, 2017
A cable-driven parallel manipulator with force sensing capabilities for high-accuracy tissue endomicroscopy

Kiyoteru Miyashita, Timo Oude Vrielink, George Mylonas

This paper introduces a new surgical end-effector probe, which allows to accurately apply a contact force on a tissue, while at the same time allowing for high resolution and highly repeatable probe movement. These are achieved by implementing a cable-driven parallel manipulator arrangement, which is deployed at the distal-end of a robotic instrument. The combination of the offered qualities can be advantageous in several ways, with possible applications including: large area endomicroscopy and multi-spectral imaging, micro-surgery, tissue palpation, safe energy-based and conventional tissue resection. To demonstrate the concept and its adaptability, the probe is integrated with a modified da Vinci robot instrument.