In a small but multi-institutional study, an artificial intelligence-based system improved providers’ assessments of whether patients with bladder cancer had complete response to chemotherapy before a radical cystectomy (bladder removal surgery).
Yet the researchers caution that AI isn’t a replacement for human expertise and that their tool shouldn’t be used as such.
MORE FROM MICHIGAN: Sign up for our weekly newsletter
“If you use the tool smartly, it can help you,” said Lubomir Hadjiyski, Ph.D.a professor of radiology at the University of Michigan Medical School and the senior author of the study.
When patients develop bladder cancer, surgeons often remove the entire bladder in an effort to keep the cancer from returning or spreading to other organs or areas. More evidence is building, though, that surgery may not be necessary if a patient has zero evidence of disease after chemotherapy.
However, it’s difficult to determine whether the lesion left after treatment is simply tissue that’s become necrotic or scarred as a result of treatment or whether cancer remains. The researchers wondered if AI could help.
SEE ALSO: Preparing clinicians for artificial intelligence, machine learning
“The big question was when you have such an artificial device next to you, how is it going to affect the physician?” Hadjiyski said. Is it going to help? Is it going to confuse them? Is it going to raise their performance or will they simply ignore it?”
Fourteen physicians from different specialties – including radiology, urology and oncology – as well as two fellows and a medical student looked at pre- and post-treatment scans of 157 bladder tumors. The providers ratings for three measures that gave assessed the level of response to chemotherapy as well as a recommendation for the next treatment to be done for each patient (radiation or surgery).
Then the providers looked at a score calculated by the computer. Lower scores indicated a lower likelihood of complete response to chemo and vice versa for higher scores. The providers could revise their ratings or leave them unchanged. Their final ratings were compared against samples of the tumors taken during their bladder removal surgeries to gauge accuracy.
Across different specialties and experience levels, providers saw improvements in their assessments with the AI system. Those with less experience had even more gains, so much so that they were able to make diagnoses at the same level as the experienced participants.
“That was the distinct part of that study that showed interesting observations about the audience,” Hadjiyski said.