The computer vision based algorithm tries to localize the spatial position of cancer. Further, it tries to find similar regions on the other views (CC to MLO etc. image comparison). Then, for each of the found suspicious regions, image based features are extracted. The trained model helps detect and score new patients. This algorithm has shown to successfully reduce unnecessary biopsies significantly, when used in conjunction with a radiologist reading.

The figures on the right show that (1) even in a dense breast, the algorithm is able to correctly pick up the cancer mass lesion and score it as suspicious, without flagging normal and benign regions, (2) we can correctly pick up lesion region and boundaries, (3) algorithmic score tracking the cancer evolving over time.


Developments in computational image analysis tools have positively impacted  predictive modelling of digital pathology images from a detection, segmentation, feature extraction, and tissue classification perspective. These have brought  improvements in predictive modelling of tissue appearance and also deep learning schemes for both object detection and tissue classification

Image Analysis & Machine Learning

There has been substantial recent interest in combining and fusing multi-modality images, like radiology and proteomics, genomics based measurements with features extracted from digital pathology images towards better prognostication, and prediction of patient outcome.

Patient Data Analytics

Models can predict with a reasonable accuracy in key challenge areas; how well a particular patient will adhere to a treatment plan; how the patient will respond to different modifications in the treatment plan; segment the population into different groups based on their behaviour, and target the highest risk patient groups to improve their outcomes. ML models can go steps further into segmenting or clustering patients into risk-based sub-groups based on response patterns and the evolution of their clinical complexity.

Advanced tools will become possible in the future, whereby these can be used at the point of care by doctors to discuss available courses of treatment options with their patients, consider their potential efficacy projected at a cohort and personal level.