Sign up FAST! Login

IBM’s Automated Radiologist Can Read Images and Medical Records

Stashed in: Awesome, Medicine, Turing, MIT TR, Robot Jobs, Machine Learning, IBM, Artificial Intelligence

To save this post, select a stash from drop-down menu or type in a new one:

IBM has software that can learn to read CAT scans to look for embolisms and tumors.

It's training to be a radiologist's assistant. Another obot worker ready to help save the day!

The software is code-named Avicenna, after an 11th century philosopher who wrote an influential medical encyclopedia. It can identify anatomical features and abnormalities in medical images such as CT scans, and also draws on text and other data in a patient’s medical record to suggest possible diagnoses and treatments.

Avicenna is intended to be used by cardiologists and radiologists to speed up their work and reduce errors, and is currently specialized to cardiology and breast radiology. It is currently being tested and tuned up using anonymized medical images and records. But Tanveer Syeda-Mahmood, a researcher at IBM’s Almaden research lab near San Jose, California, and chief scientist on the project, says that her team and others in the company are already getting ready to start testing the software outside the lab on large volumes of real patient data. “We’re getting into preparations for commercialization,” she says.


In a demo of the system, Syeda-Mahmood showed Avicenna taking on the case of a 28-year-old woman complaining of shortness of breath. The patient’s medical record included pulmonary angiogram images of the blood vessels around her lungs, some blood tests, and text noting that her mother had experienced multiple miscarriages.

Avicenna knew that family history can be associated with a tendency to form blood clots, which can lead to miscarriages, knowledge that changed how it analyzed the angiogram images. The software suggested pulmonary embolism as the most likely diagnosis, and highlighted several possible embolisms in the patient’s left and right pulmonary arteries. When a radiologist independently reviewed the same case, he or she made the same diagnosis and highlighted more or less exactly the same embolisms.

IBM’s are not the only researchers trying to build software that combines text and other medical record data to work like a radiologist. But Kenji Suzuki, an associate professor at the medical imaging research center at the Illinois Institute of Technology, says that IBM’s commercial ambitions for Avicenna are unique. “No other company is attempting or envisioning that total integration of text, structured data, and medical imaging,” he says.


Last year the company acquired a collection of billions of medical images when it purchased the company Merge Healthcare. Those images are not yet available to Avicenna, but when they are, they could help make the software more accurate, says Syeda-Mahmood. The project may also get a boost from 50 million anonymized electronic health records that IBM received in the acquisition last year of a startup called Explorys.

I noticed they never mention the name Watson in the article. 

You May Also Like: