Medical and Hospital News
SPACE MEDICINE
Robot learns surgery skills by watching videos, matches human precision
illustration only
Reuters Events SMR and Advanced Reactor 2025
Robot learns surgery skills by watching videos, matches human precision
by Clarence Oxford
Los Angeles CA (SPX) Nov 18, 2024

A surgical robot trained by observing videos of experienced surgeons has successfully executed surgical tasks with a level of skill matching human doctors.

This breakthrough in robotic training employs imitation learning, significantly simplifying the process of programming surgical robots. By using visual input rather than coding each movement, this approach advances the potential for robots to perform complex surgeries autonomously.

"It's really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery," said senior author Axel Krieger. "We believe this marks a significant step forward toward a new frontier in medical robotics."

The research, highlighted at the Conference on Robot Learning in Munich, showcases collaboration between Johns Hopkins University and Stanford University. The team trained the da Vinci Surgical System, known for its widespread use but also its precision limitations, to perform tasks like needle manipulation, tissue lifting, and suturing. Unlike traditional training, which requires precise, step-by-step programming, this model uses machine learning similar to that behind ChatGPT. Instead of processing language, this model interprets kinematic data - breaking robotic motion into mathematical expressions.

Researchers trained their model using hundreds of wrist camera recordings from da Vinci robots during surgeries. These recordings, collected globally for postoperative analysis, provide a vast dataset for imitation learning. The da Vinci system, employed in nearly 7,000 units worldwide and familiar to over 50,000 surgeons, offered ample video data.

The innovation lies in training the model to recognize and execute relative motions, avoiding inaccuracies associated with absolute actions. "All we need is image input and then this AI system finds the right action," explained lead author Ji Woong "Brian" Kim. With just a few hundred demonstrations, the model can learn and adapt to new environments.

The robot demonstrated proficiency in performing the selected surgical tasks, mirroring human skill levels. Remarkably, it adapted to unexpected situations, such as picking up a dropped needle autonomously. "Here the model is so good learning things we haven't taught it," Krieger noted.

The researchers envision rapid training for various surgical procedures, contrasting with the lengthy hand-coding previously required. "It's very limiting," Krieger said. "What is new here is we only have to collect imitation learning of different procedures, and we can train a robot to learn it in a couple days. It allows us to accelerate to the goal of autonomy while reducing medical errors and achieving more accurate surgery."

The team is now working on expanding this method to train robots for complete surgeries. Contributors from Johns Hopkins included PhD student Samuel Schmidgall, Associate Research Engineer Anton Deguet, and Associate Professor Marin Kobilarov. The Stanford team included PhD student Tony Z. Zhao.

Related Links
Johns Hopkins University
Space Medicine Technology and Systems

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
SPACE MEDICINE
Health research on the ISS aims to uncover impacts of spaceflight on blood
Los Angeles CA (SPX) Nov 07, 2024
The International Space Station (ISS) showcases remarkable engineering that sustains human life in the extreme environment of space. However, it cannot fully counter the health risks posed by zero gravity and increased cosmic radiation, which may significantly impact astronauts' well-being. A collaborative team of ground-based scientists and NASA crew members is extending health research into space, with the goal of mitigating the risk of blood clots for astronauts and advancing treatment options ... read more

SPACE MEDICINE
Keeping global consumption within planetary boundaries

Spain PM to address parliament on catastrophic floods

'Monsoon brides': Extreme weather fuels Pakistan child marriages

Leader of Spain flood region admits 'mistakes'

SPACE MEDICINE
Space Systems Command and U.S. Navy achieve major MGUE program milestone

N. Korea jams GPS signals, affecting ships, aircraft in South

Successful demo showcases BAE Systems' next-gen M-Code GNSS technology

BeiDou remote sensing experiment enhances ecological monitoring in Yellow River

SPACE MEDICINE
12,000-year-old stones might represent early wheel-like technology

Location of ancient ochre mine found in Eswatini

Chimpanzees show improved performance on difficult computer tasks with an audience

New findings on Denisovans reveal their role in shaping early human genetics

SPACE MEDICINE
Fifty years of data reveal significant African elephant population declines

Bees help tackle elephant-human conflict in Kenya

New tools give researchers hope for fungus-ravaged US bats

Critically endangered Sumatran elephant calf born in Indonesia

SPACE MEDICINE
Spread of dengue fever in Bangladesh worries medics

Climate shifts and urbanisation drive Nepal dengue surge

Covid lessons learned? UN summit mulls plan for healthy planet, and humans

WHO launches plan to rein in 'alarming' dengue spread

SPACE MEDICINE
China battles rare wave of violent crime as economic woes bite

China clears memorial to victims of deadly car ramming attack

China removes memorials to victims of deadliest attack in a decade

Chinese slimmers trim down at weight-loss camps

SPACE MEDICINE
El Salvador troops target gangs in large-scale operation

Hungary's Orban says corks will pop if Trump wins US election

SPACE MEDICINE
Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.