Abstract In this work, we introduce our project on Dunhuang cultural heritage protection using artificial intelligence. The Dunhuang Mogao Grottoes in China, also known as the Grottoes of the Thousand Buddhas, is a religious and cultural heritage located on the Silk Road. The grottoes were built from the 4th century to the 14th century. After thousands of years, the in grottoes decaying is serious. In addition, numerous historical records were destroyed throughout the years, making it difficult for archaeologists to reconstruct history. We aim to use modern computer vision and machine learning technologies to solve such challenges. First, we propose to use deep networks to automatically perform the restoration. Through out experiments, we find the automated restoration can provide comparable quality as those manually restored from an archaeologist. This can significantly speed up the restoration given the enormous size of the historical paintings. Second, we propose to use detection and retrieval for further analyzing the tremendously large amount of objects because it is unreasonable to manually label and analyze them. Several state-of-the-art methods are rigorously tested and quantitatively compared in different criteria and categorically. In this work, we created a new dataset, namely, AI for Dunhuang, to facilitate the research. Version v1.0 of the dataset comprises of data and label for the restoration, style transfer, detection, and retrieval. Specifically, the dataset has 10,000 images for restoration, 3455 for style transfer, and 6147 for property retrieval. Lastly, we propose to use style transfer to link and analyze the styles over time, given that the grottoes were build over 1000 years by numerous artists. This enables the possibly to analyze and study the art styles over 1000 years and further enable future researches on cross-era style analysis. We benchmark representative methods and conduct a comparative study on the results for our solution. The dataset will be publicly available along with this paper.

This paper presents a field-programmable gate array (FPGA) real-time multicamera cylindrical panorama video system. In this system, a novel simultaneous image transformation method has been studied (Chinese pattern pending No. 201310059020.1). Based on this method, perspective transformation, barrel correction, and cylindrical projection have been done at the same time for a multicamera system, resulting in an improvement of the overall performance. Using a low-cost parallel FPGA architecture, a high-speed real-time panoramic video system with low latency and high-performance has been developed. This video system can generate panoramic video of 5 × 1280(H) × 720(V)@15 frames/s or 5 × 1280(H) × 360(V)@30 frames/s in real-time on Xilinx Spartan6-150T FPGA. In order to display the panoramic video, a hardware display structure that can output the panoramic video in slide mode has also been constructed.