Previous studies have shown that there is a strong correlation between radiologists' diagnoses and their gaze when reading medical images. The extent to which gaze is attracted by content in a visual scene can be characterised as visual saliency. There is a potential for the use of visual saliency in computer-aided diagnosis in radiology. However, little is known about what methods are effective for diagnostic images, and how these methods could be adapted to address specific applications in diagnostic imaging. In this study, we investigate 20 state-of-the-art saliency models including 10 traditional models and 10 deep learning-based models in predicting radiologists' visual attention while reading 196 mammograms. We found that deep learning-based models represent the most effective type of methods for predicting radiologists' gaze in mammogram reading; and that the performance of these saliency models can be significantly improved by transfer learning. In particular, an enhanced model can be achieved by pre-training the model on a large-scale natural image saliency dataset and then fine-tuning it on the target medical image dataset. In addition, based on a systematic selection of backbone networks and network architectures, we proposed a parallel multi-stream encoded model which outperforms the state-of-the-art approaches for predicting saliency of mammograms.

We introduce and demonstrate an unsupervised machine learning technique for spectroscopic analysis of quantitative MRI experiments. Our algorithm supports estimation of one-dimensional spectra from single-contrast data, and multidimensional correlation spectra from simultaneous multi-contrast data. These spectrum-based approaches allow model-free investigation of tissue properties, but require regularised inversion of a Laplace transform or Fredholm integral, which is an ill-posed calculation. Here we present a method that addresses this limitation in a data-driven way. The algorithm simultaneously estimates a canonical basis of spectral components and voxelwise maps of their weightings, thereby pooling information across whole images to regularise the ill-posed problem. We show in simulations that our algorithm substantially outperforms current voxelwise spectral approaches. We demonstrate the method on multi-contrast diffusion-relaxometry placental MRI scans, revealing anatomically-relevant sub-structures, and identifying dysfunctional placentas. Our algorithm vastly reduces the data required to reliably estimate spectra, opening up the possibility of quantitative MRI spectroscopy in a wide range of new applications. Our InSpect code is available at github.com/paddyslator/inspect.