Photon-counting detector based computed tomography (PCCT) has greatly advanced in recent years. However, spectral inconsistency, referring to inter-pixel variations in detected counts per energy bin, can easily leads to ring or band artifacts and inaccuracies in CT reconstructed images. This work proposes a novel physics-model based method to correct for spectral inconsistency by modeling it through two terms: (1) a fixed spectral skew term (energy threshold-independent filtration function) determined at a given energy threshold, and (2) a variable energy-threshold bias term that can be directly calculated by using our spectral model as the threshold changes. After the two terms being computed out in the calibration stage, they will be incorporated into our spectral model to adaptively generate the spectral correction vectors as well as the material decomposition vectors if needed, pixel-by-pixel for PCCT projection data. Using a minimum set of parameters with explicit physics meaning, such an energy-threshold bias calculator (ETB-Cal) has advantages of computational efficiency, robustness in implementation, and convenience with no need of X-ray fluorescence materials in calibration. To validate our method, both numerical simulations and physical experiments using multiple phantoms were carried out on a tabletop PCCT system, with preliminary results showing a significant reduction in non‑uniformity, from 29.3 to 5.8 HU for Gammex multi-energy phantom versus no correction (comparatively, 8.3 HU was achieved by a polynomial-involving model‑based approach with no explicit modeling and calculating of energy threshold bias but more calibration data required), and from 27.9 to 3.2 HU for the Kyoto head phantom.

Grating-based X-ray dark-field imaging leverages the small-angle scattering from porous structures, providing enhanced sensitivity to alveoli in lung parenchyma. It shows the potential of clinical application for lung disease diagnosis, and has been implemented in human-scale dark-field computed tomography (CT). One challenge in the dark-field CT is the positional dependence of the dark-field signal, which varies with rotation during a CT scan. This rotational variance limits the accuracy of conventional reconstruction methods, particularly in large field-of-view as for humans. While calibration methods have been proposed to address this issue, they are either computationally intensive or impose constraints on the scanning trajectory. In this work, we model the dark-field CT as a weighted Radon transform. By applying the analytical inversion formula to this model, we achieve the dark-field CT reconstruction without artefacts from positional dependence. This approach eliminates the requirement for conjugate ray pairs, allowing extensions from fan-beam to cone-beam geometry through coordinate transform. Simulations and experiments were conducted to validate this method using an anthropomorphic chest phantom.

CT metal artefact reduction (MAR) methods based on supervised deep learning are often troubled by domain gap between simulated training dataset and real-application dataset, i.e., methods trained on simulation cannot generalize well to practical data. Unsupervised MAR methods can be trained directly on practical data, but they learn MAR with indirect metrics and often perform unsatisfactorily. To tackle the domain gap problem, we propose a novel MAR method called UDAMAR based on unsupervised domain adaptation (UDA). Specifically, we introduce a UDA regularization loss into a typical image-domain supervised MAR method, which mitigates the domain discrepancy between simulated and practical artefacts by feature-space alignment. Our adversarial-based UDA focuses on a low-level feature space where the domain difference of metal artefacts mainly lies. UDAMAR can simultaneously learn MAR from simulated data with known labels and extract critical information from unlabeled practical data. Experiments on both clinical dental and torso datasets show the superiority of UDAMAR by outperforming its supervised backbone and two state-of-the-art unsupervised methods. We carefully analyze UDAMAR by both experiments on simulated metal artefacts and various ablation studies. On simulation, its close performance to the supervised methods and advantages over the unsupervised methods justify its efficacy. Ablation studies on the influence from the weight of UDA regularization loss, UDA feature layers, and the amount of practical data used for training further demonstrate the robustness of UDAMAR. UDAMAR provides a simple and clean design and is easy to implement. These advantages make it a very feasible solution for practical CT MAR.

Photon-counting detector CT (PCD-CT) is a revolutionary technology in decades in the field of CT. Its potential benefits in lowering noise, dose reduction, and material-specific imaging enable completely new clinical applications. Spectral reconstruction of basis material maps requires knowledge of the x-ray spectrum and the spectral response calibration of the detector. However, spectrum estimation errors caused by inaccurate energy threshold calibration will degrade the accuracy of the reconstructions. Existing spectrum estimation methods are not adequately modeled for bias in energy threshold position. Besides, directly solving a big number of variables of the pixel-wise effective spectra for PCD is an ill-conditioned problem so that stable solution is hardly achievable. In this paper, we assumed the effective spectra variation across the detector mainly comes from the calibration error in the energy threshold positions as well as the intrinsic threshold distribution. We propose a joint reconstruction and spectrum refinement algorithm (JoSR) that introduces an innovative spectrum model based on non-negative matrix factorization (NMF) to significantly reduce the dimension of unknowns so that makes the problem well-conditioned. The polychromatic spectral imaging model and the basis material decomposition method together form an optimization objective. The proximal regularized block coordinate descent algorithm is adopted to deal with the non-convex optimization problem to ensure convergence. Simulation studies and experiments on a laboratory PCD-CT system validated the proposed JoSR method. The results demonstrate its advantages on image quality and quantitative accuracy over other state-of-the-art methods in the field.

Skeleton-based action recognition has attracted considerable attention since the skeleton data is more robust to the dynamic circumstances and complicated backgrounds than other modalities. Recently, many researchers have used the Graph Convolutional Network (GCN) to model spatial-temporal features of skeleton sequences by an end-to-end optimization. However, conventional GCNs are feedforward networks for which it is impossible for the shallower layers to access semantic information in the high-level layers. In this paper, we propose a novel network, named Feedback Graph Convolutional Network (FGCN). This is the first work that introduces a feedback mechanism into GCNs for action recognition. Compared with conventional GCNs, FGCN has the following advantages: (1) A multi-stage temporal sampling strategy is designed to extract spatial-temporal features for action recognition in a coarse to fine process; (2) A Feedback Graph Convolutional Block (FGCB) is proposed to introduce dense feedback connections into the GCNs. It transmits the high-level semantic features to the shallower layers and conveys temporal information stage by stage to model video level spatial-temporal features for action recognition; (3) The FGCN model provides predictions on-the-fly. In the early stages, its predictions are relatively coarse. These coarse predictions are treated as priors to guide the feature learning in later stages, to obtain more accurate predictions. Extensive experiments on three datasets, NTU-RGB+D, NTU-RGB+D120 and Northwestern-UCLA, demonstrate that the proposed FGCN is effective for action recognition. It achieves the state-of-the-art performance on all three datasets.

Limited angle reconstruction is a typical ill-posed problem in computed tomography (CT). Given incomplete projection data, images reconstructed by conventional analytical algorithms and iterative methods suffer from severe structural distortions and artifacts. In this paper, we proposed a self-augmented multi-stage deep-learning network (Sam's Net) for end-to-end reconstruction of limited angle CT. With the merit of the alternating minimization technique, Sam's Net integrates multi-stage self-constraints into cross-domain optimization to provide additional constraints on the manifold of neural networks. In practice, a sinogram completion network (SCNet) and artifact suppression network (ASNet), together with domain transformation layers constitute the backbone for cross-domain optimization. An online self-augmentation module was designed following the manner defined by alternating minimization, which enables a self-augmented learning procedure and multi-stage inference manner. Besides, a substitution operation was applied as a hard constraint for the solution space based on the data fidelity and a learnable weighting layer was constructed for data consistency refinement. Sam's Net forms a new framework for ill-posed reconstruction problems. In the training phase, the self-augmented procedure guides the optimization into a tightened solution space with enriched diverse data distribution and enhanced data consistency. In the inference phase, multi-stage prediction can improve performance progressively. Extensive experiments with both simulated and practical projections under 90-degree and 120-degree fan-beam configurations validate that Sam's Net can significantly improve the reconstruction quality with high stability and robustness.

Convolutional Neural Networks have achieved excellent successes for object recognition in still images. However, the improvement of Convolutional Neural Networks over the traditional methods for recognizing actions in videos is not so significant, because the raw videos usually have much more redundant or irrelevant information than still images. In this paper, we propose a Spatial-Temporal Attentive Convolutional Neural Network (STA-CNN) which selects the discriminative temporal segments and focuses on the informative spatial regions automatically. The STA-CNN model incorporates a Temporal Attention Mechanism and a Spatial Attention Mechanism into a unified convolutional network to recognize actions in videos. The novel Temporal Attention Mechanism automatically mines the discriminative temporal segments from long and noisy videos. The Spatial Attention Mechanism firstly exploits the instantaneous motion information in optical flow features to locate the motion salient regions and it is then trained by an auxiliary classification loss with a Global Average Pooling layer to focus on the discriminative non-motion regions in the video frame. The STA-CNN model achieves the state-of-the-art performance on two of the most challenging datasets, UCF-101 (95.8%) and HMDB-51 (71.5%).

In this work, we investigate the Fourier properties of a symmetric-geometry computed tomography (SGCT) with linearly distributed source and detector in a stationary configuration. A linkage between the 1D Fourier Transform of a weighted projection from SGCT and the 2D Fourier Transform of a deformed object is established in a simple mathematical form (i.e., the Fourier slice theorem for SGCT). Based on its Fourier slice theorem and its unique data sampling in the Fourier space, a Linogram-based Fourier reconstruction method is derived for SGCT. We demonstrate that the entire Linogram reconstruction process can be embedded as known operators into an end-to-end neural network. As a learning-based approach, the proposed Linogram-Net has capability of improving CT image quality for non-ideal imaging scenarios, a limited-angle SGCT for instance, through combining weights learning in the projection domain and loss minimization in the image domain. Numerical simulations and physical experiments on an SGCT prototype platform showed that our proposed Linogram-based method can achieve accurate reconstruction from a dual-SGCT scan and can greatly reduce computational complexity when compared with the filtered backprojection type reconstruction. The Linogram-Net achieved accurate reconstruction when projection data are complete and significantly suppressed image artifacts from a limited-angle SGCT scan mimicked by using a clinical CT dataset, with the average CT number error in the selected regions of interest reduced from 67.7 Hounsfield Units (HU) to 28.7 HU, and the average normalized mean square error of overall images reduced from 4.21e-3 to 2.65e-3.