Opendata, web and dolomites

Report

Teaser, summary, work performed and final results

Periodic Reporting for period 1 - MIRA (Next Generation Machine Intelligence for Medical Image Representation and Analysis)

Teaser

Machines capable of analysing and interpreting medical scans with super-human performance would transform healthcare as much as medical imaging itself did over the last century. With an increasing complexity and volume of data the interpretation of images and extraction of...

Summary

Machines capable of analysing and interpreting medical scans with super-human performance would transform healthcare as much as medical imaging itself did over the last century. With an increasing complexity and volume of data the interpretation of images and extraction of clinically useful information push human abilities to the limit. There is high risk that critical patterns of disease go undetected. We require powerful and trustworthy computational tools based on machine intelligence to support experts and go beyond human performance to tackle the major challenges in clinical practice. Two key ingredients are currently missing: 1) interpretable statistical representations that capture important information while reducing complexity; 2) intelligent algorithms that leverage knowledge across multiple tasks to solve the most challenging problems such as early detection of pathology.

This project is devoted to redefine the state-of-the-art in medical image analysis by developing a new generation of machine intelligence using powerful techniques of representation learning. Key to the project is its unique access to some of the largest and most comprehensive imaging databases combined with world-leading expertise in machine learning and medical imaging. An overarching objective is to harvest information from population data to construct what will be the most advanced statistical models of anatomy. In contrast to previous attempts that focus primarily on specific organs or pathology, here shared representations are learned from highly complex data by jointly solving multiple tasks. Linking the representations with demographics, lifestyle, genetics and disease allows probing of genetic and environmental determinants related to specific anatomical and pathological phenotypes across organs. This will provide insights into complex diseases, and enables a novel approach to abnormality detection that aims to automatically find subtle signs of pathology in new medical scans.

Work performed

The project has made significant progress on its four challenges: (C1) Leveraging knowledge across multiple tasks for optimal use of available data; (C2) Learning comprehensive statistical representations from large-scale population data; (C3) Devising an effective abnormality detection system to find subtle signs of pathology; (C4) Building trust and providing confidence by better understanding black box machines.

Final results

The project has already led to a number of advances that push the boundaries of the state-of-the-art in machine intelligence for medical image analysis. We have shown that it is possible and beneficial to learn simultaneously from multiple imaging modalities such as CT and MRI, and that there is indeed knowledge to be shared across different tasks. We have developed a new algorithm for detecting very small lesions in CT images which surpasses the performance of previous methods by a significant margin. We have also demonstrated that it is possible to estimate the quality of automatically derived predictions which is important to gain the trust in black box machine learning in clinical settings. We also found ways of adapting a pre-trained model to new data which is essential for deploying machine learning methods in clinical practice.

Website & more info

More info: http://project-mira.eu.