A robot trained on videos of surgeries performed a lengthy phase of a gallbladder removal without human help. The robot operated for the first time on a lifelike patient, and during the operation, responded to and learned from voice commands from the team—like a novice surgeon working with a mentor.
The robot performed unflappably across trials and with the expertise of a skilled human surgeon, even during unexpected scenarios typical in real life medical emergencies.
I doubt it. It simply would be enough, if the AI could understand and say when it reaches its limits and hand over to a human. But that is even hard for humans as Dunning & Kruger discovered.