Optical coherence tomography (OCT), as a non-destructive and high-resolution imaging technique, has been used to collect 3D fingertip data, which contains surface and internal fingerprints. Methods have been proposed for OCT fingerprint reconstruction. However, these methods have complex processing flow and are time consuming. In this paper, an end-to-end convolutional neural network based surface and internal fingerprint reconstruction method is proposed. A simple yet effective contour regression module is proposed and integrated in the network for direct estimation of contours of stratum corneum and viable epidermis junction from noisy OCT volume data, thus greatly simplify the processing flow. The proposed network further integrates multi-task learning with conventional segmentation task as auxiliary task and contour regression task as main task to facilitate the feature extraction and improve the robustness of the network. Depthwise separable convolution is adapted to a light-weight network for network computation complexity reduction. To the best of our knowledge, it is the first time that an end-to-end method is proposed for surface and internal fingerprint extraction from noisy OCT volume data. Experiments and comparisons are carried out in terms of contour estimation accuracy, fingerprint quality, fingerprint matching performance and computation efficiency. Compared with conventional method, the proposed method utilizes only 6% of original network parameters and 0.7% of original computation time, but achieves comparably results. Fingerprint by depth proves the accuracy and robustness of contour regression than pixel-wise layer segmentation. The proposed method is noise-insensitive, process-simple and time-efficient for OCT fingerprint reconstruction, which is significant for real time application in Automated Fingerprint Recognition Systems.

Abstract Abstract Sweat pore, one of the level 3 features of fingerprint, has attracted much attention in fingerprint recognition. Traditional sweat pores on surface fingerprint are unclear or blurred when fingers are stained or damaged. Subcutaneous sweat pores, as cross section of the sweat glands, are resistant to external interferences. With 3D fingertip information measured by optical coherence tomography (OCT), the subcutaneous sweat pore estimation from OCT volume data is investigated. First, an adaptive subcutaneous pore image reconstruction method is proposed. It utilizes the skin surface and viable epidermis junction as reference and realizes depth‐adaptive pore image reconstruction. Second, a dilated U‐Net combining the U‐Net with dilated convolution is proposed for subcutaneous sweat pore extraction, which can prevent information loss of sweat pores caused by downsampling. To the best knowledge, it is the first time that subcutaneous sweat pore extraction is investigated and proposed. Experiments on subcutaneous pore image reconstruction and sweat pore extraction are both conducted. The qualitative and quantitative results show that the proposed adaptive method performs better in subcutaneous pore image reconstruction compared with the fix‐depth method, and the dilated U‐Net outperforms other methods on subcutaneous sweat pore extraction.

Optical coherence tomography (OCT), as a non-destructive and high-resolution fingerprint acquisition technology, is robust against poor skin conditions and resistant to spoof attacks. It measures fingertip information on and beneath skin as 3D volume data, containing the surface fingerprint, internal fingerprint and sweat glands. Various methods have been proposed to extract internal fingerprints, which ignore the inter-slice dependence and often require manually selected parameters. In this article, a modified U-Net that combines residual learning, bidirectional convolutional long short-term memory and hybrid dilated convolution (denoted as BCL-U Net) for OCT volume data segmentation and two fingerprint reconstruction approaches are proposed. To the best of our knowledge, it is the first time that simultaneous and automatic extraction is performed for surface fingerprint, internal fingerprint and sweat gland. The proposed BCL-U Net utilizes the spatial dependence in OCT volume data and deals with segmentation of objects with diverse sizes to achieve accurate extraction. Comparisons have been performed to demonstrate the advantages of the proposed method. A thorough evaluation of the recognition abilities of internal and surface fingerprints is conducted using a dataset significantly larger than previous studies. Four databases containing internal and surface fingerprints are generated from 1572 OCT volume data by the proposed method. The internal fingerprint matching experiment has achieved a lowest equal error rate (EER) of 0.95%. Mixed internal and surface fingerprint matching experiment is also performed and achieves an EER of 3.67%, verifying the consistency of the internal and surface fingerprints. The matching experiments for fingers under poor skin conditions show a 2.47% EER of internal fingerprints that is much lower than that of surface fingerprints, which proves the advantage of internal fingerprints and indicates the potential of the internal fingerprints to supplement or replace the surface fingerprints for some specific applications.