Attenuation compensation (AC), while being beneficial for visual-interpretation tasks in myocardial perfusion imaging (MPI) by SPECT, typically requires the availability of a separate X-ray CT component, leading to additional radiation dose, higher costs, and potentially inaccurate diagnosis due to SPECT/CT misalignment. To address these issues, we developed a method for cardiac SPECT AC using deep learning and emission scatter-window photons without a separate transmission scan (CTLESS). In this method, an estimated attenuation map reconstructed from scatter-energy window projections is segmented into different regions using a multi-channel input multi-decoder network trained on CT scans. Pre-defined attenuation coefficients are assigned to these regions, yielding the attenuation map used for AC. We objectively evaluated this method in a retrospective study with anonymized clinical SPECT/CT stress MPI images on the clinical task of detecting defects with an anthropomorphic model observer. CTLESS yielded statistically non-inferior performance compared to a CT-based AC (CTAC) method and significantly outperformed a non-AC (NAC) method on this clinical task. Similar results were observed in stratified analyses with different sexes, defect extents and severities. The method was observed to generalize across two SPECT scanners, each with a different camera. In addition, CTLESS yielded similar performance as CTAC and outperformed NAC method on the metrics of root mean squared error and structural similarity index measure. Moreover, as we reduced the training dataset size, CTLESS yielded relatively stable AUC values and generally outperformed another DL-based AC method that directly estimated the attenuation coefficient within each voxel. These results demonstrate the capability of the CTLESS method for transmission-less AC in SPECT and motivate further clinical evaluation.

Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search-reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors.

Virtual clinical trials (VCTs) of medical imaging require realistic models of human anatomy. For VCTs in breast imaging, a multi-scale Perlin noise method is proposed to simulate anatomical structures of breast tissue in the context of an ongoing breast phantom development effort. Four Perlin noise distributions were used to replace voxels representing the tissue compartments and Cooper’s ligaments in the breast phantoms. Digital mammography and tomosynthesis projections were simulated using a clinical DBT system configuration. Power-spectrum analyses and higher-order statistics properties using Laplacian fractional entropy (LFE) of the parenchymal texture are presented. These objective measures were calculated in phantom and patient images using a sample of 140 clinical mammograms and 500 phantom images. Power-law exponents were calculated using the slope of the curve fitted in the low frequency [0.1, 1.0] mm−1region of the power spectrum. The results show that the images simulated with our prior and proposed Perlin method have similar power-law spectra when compared with clinical mammograms. The power-law exponents calculated are −3.10, −3.55, and −3.46, for the log-power spectra of patient, prior phantom and proposed phantom images, respectively. The results also indicate an improved agreement between the mean LFE estimates of Perlin-noise based phantoms and patients than our prior phantoms and patients. Thus, the proposed method improved the simulation of anatomic noise substantially compared to our prior method, showing close agreement with breast parenchyma measures.

Model observers have a long history of success in predicting human observer performance in clinically-relevant detection tasks. New 3D image modalities provide more signal information but vastly increase the search space to be scrutinized. Here, we compared standard linear model observers (ideal observers, non-pre-whitening matched filter with eye filter, and various versions of Channelized Hotelling models) to human performance searching in 3D 1/f2.8filtered noise images and assessed its relationship to the more traditional location known exactly detection tasks and 2D search. We investigated two different signal types that vary in their detectability away from the point of fixation (visual periphery). We show that the influence of 3D search on human performance interacts with the signal's detectability in the visual periphery. Detection performance for signals difficult to detect in the visual periphery deteriorates greatly in 3D search but not in 3D location known exactly and 2D search. Standard model observers do not predict the interaction between 3D search and signal type. A proposed extension of the Channelized Hotelling model (foveated search model) that processes the image with reduced spatial detail away from the point of fixation, explores the image through eye movements, and scrolls across slices can successfully predict the interaction observed in humans and also the types of errors in 3D search. Together, the findings highlight the need for foveated model observers for image quality evaluation with 3D search.

Combined detection-estimation tasks are frequently encountered in medical imaging. Optimal methods for joint detection and estimation are of interest because they provide upper bounds on observer performance, and can potentially be utilized for imaging system optimization, evaluation of observer efficiency, and development of image formation algorithms. We present a unified Bayesian framework for decision rules that maximize receiver operating characteristic (ROC)-type summary curves, including ROC, localization ROC (LROC), estimation ROC (EROC), free-response ROC (FROC), alternative free-response ROC (AFROC), and exponentially-transformed FROC (EFROC) curves, succinctly summarizing previous results. The approach relies on an interpretation of ROC-type summary curves as plots of an expected utility versus an expected disutility (or penalty) for signal-present decisions. We propose a general utility structure that is flexible enough to encompass many ROC variants and yet sufficiently constrained to allow derivation of a linear expected utility equation that is similar to that for simple binary detection. We illustrate our theory with an example comparing decision strategies for joint detection-estimation of a known signal with unknown amplitude. In addition, building on insights from our utility framework, we propose new ROC-type summary curves and associated optimal decision rules for joint detection-estimation tasks with an unknown, potentially-multiple, number of signals in each observation.

Anthropomorphic model observers are mathe- matical algorithms which are applied to images with the ultimate goal of predicting human signal detection and classification accuracy across varieties of backgrounds, image acquisitions and display conditions. A limitation of current channelized model observers is their inability to handle irregularly-shaped signals, which are common in clinical images, without a high number of directional channels. Here, we derive a new linear model observer based on convolution channels which we refer to as the "Filtered Channel observer" (FCO), as an extension of the channelized Hotelling observer (CHO) and the nonprewhitening with an eye filter (NPWE) observer. In analogy to the CHO, this linear model observer can take the form of a single template with an external noise term. To compare with human observers, we tested signals with irregular and asymmetrical shapes spanning the size of lesions down to those of microcalfications in 4-AFC breast tomosynthesis detection tasks, with three different contrasts for each case. Whereas humans uniformly outperformed conventional CHOs, the FCO observer outperformed humans for every signal with only one exception. Additive internal noise in the models allowed us to degrade model performance and match human performance. We could not match all the human performances with a model with a single internal noise component for all signal shape, size and contrast conditions. This suggests that either the internal noise might vary across signals or that the model cannot entirely capture the human detection strategy. However, the FCO model offers an efficient way to apprehend human observer performance for a non-symmetric signal.

In this paper, we explore relationships between the performance of the ideal observer and information-based measures of class separability in the context of sonographic breast-lesion diagnosis. This investigation was motivated by a finding that, since the test statistic of the ideal observer in sonography is a quadratic function of the echo data, it is not generally normally distributed. We found for some types of boundary discrimination tasks often required for sonographic lesion diagnosis, the deviation of the test statistic from a normal distribution can be significant. Hence the usual relationships between performance and information metrics become uncertain. Using Monte Carlo studies involving five common sonographic lesion-discrimination tasks, we found in each case that the detectability index d(A)(2) from receiver operating characteristic analysis was well approximated by the Kullback-Leibler divergence J, a measure of clinical task information available from the recorded radio-frequency echo data. However, the lesion signal-to-noise ratio, SNR(I)(2), calculated from moments of the ideal observer test statistic, consistently underestimates d(A)(2) for high-contrast boundary discrimination tasks. Thus, in a companion paper, we established a relationship between image-quality properties of the imaging system and J in order to predict ideal performance. These relationships provide a rigorous basis for sonographic instrument evaluation and design.

This paper describes a task-based, information-theoretic approach to the assessment of image quality in diagnostic sonography. We expand the Kullback-Leibler divergence metric J, which quantifies the diagnostic information contained within recorded radio-frequency echo signals, into a spatial-frequency integral comprised of two spectral components: one describes patient features for low-contrast diagnostic tasks and the other describes instrumentation properties. The latter quantity is the acquisition information spectrum (AIS), which measures the density of object information that an imaging system is able to transfer to the echo data at each spatial frequency. AIS is derived based on unique properties of acoustic scattering in tissues that generate object contrast. Predictions made by the J integral expression were validated through Monte Carlo studies using echo-signal data from simulated lesions. Our analysis predicts the diagnostic performance of any sonographic system at specific diagnostic tasks based on engineering properties of the instrument that constitute image quality.

A first-principles task-based approach to the design of medical ultrasonic imaging systems for breast lesion discrimination is described. This study explores a new approximation to the ideal Bayesian observer strategy that allows for object heterogeneity. The new method, called iterative Wiener filtering, is implemented using echo data simulations and a phantom study. We studied five lesion features closely associated with visual discrimination for clinical diagnosis. A series of human observer measurements for the same image data allowed us to quantitatively compare alternative beamforming strategies through measurements of visual discrimination efficiency. Employing the Smith-Wagner model observer, we were able to breakdown efficiency estimates and identify the processing stage at which performance losses occur. The methods were implemented using a commercial scanner and a cyst phantom to explore development of spatial filters for systems with shift-variant impulse response functions. Overall we found that significant improvements were realized over standard B-mode images using a delay-and-sum beamformer but at the cost of higher complexity and computational load.

We investigate and extend the ideal observer methodology developed by Smith and Wagner to detection and discrimination tasks related to breast sonography. We provide a numerical approach for evaluating the ideal observer acting on radio frequency (RF) frame data, which involves inversion of large nonstationary covariance matrices, and we describe a power-series approach to computing this inverse. Considering a truncated power series suggests that the RF data be Wiener-filtered before forming the final envelope image. We have compared human performance for Wiener-filtered and conventional B-mode envelope images using psychophysical studies for 5 tasks related to breast cancer classification. We find significant improvements in visual detection and discrimination efficiency in four of these five tasks. We also use the Smith-Wagner approach to distinguish between human and processing inefficiencies, and find that generally the principle limitation comes from the information lost in computing the final envelope image.

A rigorous statistical theory for characterizing the performance of medical ultrasound systems for lesion detection tasks is developed. A design strategy for optimizing ultrasound systems should be to adjust parameters for maximum information content, which is obtained by maximizing the ideal observer performance. Then, given the radio-frequency data, image and signal processing algorithms are designed to extract as much diagnostically relevant information as possible. In this paper, closed-form and low-contrast approximations of ideal observer performance are derived for signal known statistically detection tasks. The accuracy of the approximations are tested by comparing with Monte Carlo techniques. A metric borrowed and modified from photon imaging, Generalized Noise Equivalent Quanta, is shown to be a useful and measurable target-independent figure of merit when adapted for ultrasound systems. This theory provides the potential to optimize design tradeoffs for detection tasks. For example it may help us understand how to push the limits of specific features, such as spatial resolution, without significantly compromising overall detection performance.

For performing simple detection and discrimination tasks in image noise, human observers are often modeled by a cross-correlation between the image and an observer template followed by the injection of the observer's internal noise. This paper is concerned with estimating this template using the two-alternative forced-choice (2AFC) experimental paradigm. The basic idea behind the estimation procedure is to average the noise fields of the images used in a 2AFC experiment with a weight that depends on whether the observer got the trial correct or incorrect. We describe a method that produces unbiased estimates of the observer template up to a constant of proportionality under the linear cross-correlation model. The method proposed here is different from some previous methods in the way it assigns weights to the noise fields and we show that the resulting errors in the estimated template are minimized. We also propose and validate a formula for approximating the error covariance associated with the template estimates.

Layer decomposition is a promising method for obtaining accurate densitometric profiles of diseased coronary artery segments. This method decomposes coronary angiographic image sequences into moving densitometric layers undergoing translation, rotation, and scaling. In order to evaluate the accuracy of this technique, we have developed a technique for embedding realistic simulated moving stenotic arteries in real clinical coronary angiograms. We evaluate the accuracy of layer decomposition in two ways. First, we compute tracking errors as the distance between the true and estimated motion of a reference point in the arterial lesion. We find that noise-weighted phase correlation and layered background subtraction are superior to cross correlation and fixed mask subtraction, respectively. Second, we compute the correlation coefficient between the true vessel profile and the raw and processed images in the region of the stenosis. We find that layer decomposition significantly improves the correlation coefficient.