Chenjie Zhu

dblp:63/2809 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Generative modeling · 91% Image recognition and object detection · 9%
Computer graphics and multimedia
2 papers
Image and video processing · 100%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Computational social science and digital humanities · 100%

Topics — the 7 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
1.522024
Reproducing the Past: A Dataset for Benchmarking Inscription Restoration · ACM Multimedia 2024
Text Image Inpainting via Global Structure-Guided Diffusion Models · AAAI 2024
Machine learning › Generative modeling › diffusion model
structure-guided diffusion
0.812024
Text Image Inpainting via Global Structure-Guided Diffusion Models · AAAI 2024
Image and video processing › image restoration
image inpainting
0.812024
Text Image Inpainting via Global Structure-Guided Diffusion Models · AAAI 2024
Image and video processing
image restoration
0.812024
Reproducing the Past: A Dataset for Benchmarking Inscription Restoration · ACM Multimedia 2024
Image and video processing › image restoration › image inpainting
text-guided image inpainting
0.812024
Text Image Inpainting via Global Structure-Guided Diffusion Models · AAAI 2024
Computer vision › Image recognition and object detection
scene text recognition
0.212024
Text Image Inpainting via Global Structure-Guided Diffusion Models · AAAI 2024
Computational social science and digital humanities
cultural heritage
0.212024
Reproducing the Past: A Dataset for Benchmarking Inscription Restoration · ACM Multimedia 2024

Methods — techniques the papers use, named apart from their topics

diffusion model · 3.8domain knowledge · 2.3global structure prior · 1.5
YearPublicationVenuePosition
2024 Text Image Inpainting via Global Structure-Guided Diffusion Models
abstract
Real-world text can be damaged by corrosion issues caused by environmental or human factors, which hinder the preservation of the complete styles of texts, e.g., texture and structure. These corrosion issues, such as graffiti signs and incomplete signatures, bring difficulties in understanding the texts, thereby posing significant challenges to downstream applications, e.g., scene text recognition and signature identification. Notably, current inpainting techniques often fail to adequately address this problem and have difficulties restoring accurate text images along with reasonable and consistent styles. Formulating this as an open problem of text image inpainting, this paper aims to build a benchmark to facilitate its study. In doing so, we establish two specific text inpainting datasets which contain scene text images and handwritten text images, respectively. Each of them includes images revamped by real-life and synthetic datasets, featuring pairs of original images, corrupted images, and other assistant information. On top of the datasets, we further develop a novel neural framework, Global Structure-guided Diffusion Model (GSDM), as a potential solution. Leveraging the global structure of the text as a prior, the proposed GSDM develops an efficient diffusion model to recover clean texts. The efficacy of our approach is demonstrated by thorough empirical study, including a substantial boost in both recognition accuracy and image quality. These findings not only highlight the effectiveness of our method but also underscore its potential to enhance the broader field of text image understanding and processing. Code and datasets are available at: https://github.com/blackprotoss/GSDM.
Shipeng Zhu, Pengfei Fang, Chenjie Zhu, Zuoyan Zhao, Hui Xue 0002
AAAI3
2024 Reproducing the Past: A Dataset for Benchmarking Inscription Restoration
abstract
Inscriptions on ancient steles, as carriers of culture, encapsulate the humanistic thoughts and aesthetic values of our ancestors. However, these relics often deteriorate due to environmental and human factors, resulting in significant information loss. Since the advent of inscription rubbing technology over a millennium ago, archaeologists and epigraphers have devoted immense effort to manually restoring these cultural imprints, endeavoring to unlock the storied past within each rubbing. This paper approaches this challenge as a multi-modal task, aiming to establish a novel benchmark for the inscription restoration from rubbings. In doing so, we construct the Chinese Inscription Rubbing Image (CIRI) dataset, which includes a wide variety of real inscription rubbing images characterized by diverse calligraphy styles, intricate character structures, and complex degradation forms. Furthermore, we develop a synthesis approach to generate "intact-degraded'' paired data, mirroring real-world degradation faithfully. On top of the datasets, we propose a baseline framework that achieves visual consistency and textual integrity through global and local diffusion-based restoration processes and explicit incorporation of domain knowledge. Comprehensive evaluations confirm the effectiveness of our pipeline, demonstrating significant improvements in visual presentation and textual integrity. The project is available at: https://github.com/blackprotoss/CIRI.
Shipeng Zhu, Hui Xue 0002, Na Nie, Chenjie Zhu, Haiyue Liu, Pengfei Fang
ACM Multimedia4