Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Jindong Jiang

dblp:200/8116 · DBLP profile ↗
← Back
12ranked-venue papers
5as first author
8since 2021 · last 2026
0000-0003-3662-1784ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 9 · 4 first-author · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 2 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
8 papers
Generative modeling · 18% Video understanding and tracking · 18% Representation and self-supervised learning · 14%
Computer graphics and multimedia
1 paper
Visual content generation and editing · 100%

Topics — the 18 heaviest of 21, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
1.422024
Layout-Agnostic Scene Text Image Synthesis with Diffusion Models · CVPR 2024
Object-Centric Slot Diffusion · NeurIPS 2023
Computer vision › Video understanding and tracking
long video understanding
0.912025
Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models · NeurIPS 2025
Computer vision › Vision and language
vision-language model
0.912025
Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models · NeurIPS 2025
Machine learning › Reinforcement learning › model-based reinforcement learning
world model
0.922020
Improving Generative Imagination in Object-Centric World Models · ICML 2020
SCALOR: Generative World Models with Scalable Object Representations · ICLR 2020
Machine learning › Representation and self-supervised learning › representation learning
object-centric representation learning
0.822023
Object-Centric Slot Diffusion · NeurIPS 2023
Improving Generative Imagination in Object-Centric World Models · ICML 2020
Computer vision › Video understanding and tracking › long video understanding
long-context video understanding
0.812024
Slot State Space Models · NeurIPS 2024
Machine learning › Deep learning architectures and training
state space model
0.812024
Slot State Space Models · NeurIPS 2024
Visual content generation and editing › visual text generation
scene text synthesis
0.812024
Layout-Agnostic Scene Text Image Synthesis with Diffusion Models · CVPR 2024
Machine learning › Generative modeling › diffusion model
latent diffusion model
0.712023
Object-Centric Slot Diffusion · NeurIPS 2023
Machine learning › Probabilistic and Bayesian machine learning › structured models › latent variable model › deep latent variable model
object-centric generative model
0.412020
Generative Neurosymbolic Machines · NeurIPS 2020
Machine learning › Reinforcement learning › model-based reinforcement learning › world model
object-centric world model
0.412020
Improving Generative Imagination in Object-Centric World Models · ICML 2020
Computer vision › 3D vision
object representation
0.412020
SCALOR: Generative World Models with Scalable Object Representations · ICLR 2020
Computer vision › 3D vision › 3d scene understanding
scene decomposition
0.412020
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition · ICLR 2020
Machine learning › Deep learning architectures and training › attention mechanism › visual attention
spatial attention
0.412020
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition · ICLR 2020
Machine learning › Learning paradigms
unsupervised learning
0.412020
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition · ICLR 2020
Computer vision › Vision and language › vision-language model › multimodal large language model
high-resolution image understanding
0.312025
Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models · NeurIPS 2025
Computer vision › Vision and language › visual reasoning
3d visual reasoning
0.212024
Slot State Space Models · NeurIPS 2024
Computer vision › Segmentation and scene understanding › image segmentation
unsupervised segmentation
0.212023
Object-Centric Slot Diffusion · NeurIPS 2023

Methods — techniques the papers use, named apart from their topics

word-level spotting · 1.5instance segmentation · 1.5character-level encoder · 1.5variational inference · 0.9instruction tuning · 0.9image area preservation · 0.9automatic degrade sampling · 0.9slot attention · 0.8self-attention · 0.8compositional generation · 0.7
YearPublicationVenuePosition
2026 Fine-Grained Repair Knowledge Organization for Knowledge-Guided Automated Program Repair
Jindong Jiang, Haoxuan Cheng, Shihang Yu
ICIC (26)1
2026 IFHAGrec: Instruction-Finetuned Heterogeneous-Aware Graph Neural Network for Temporally Weighted Recommendation Model
Hongrui Wang 0004, Shanchuan Yu, Xiaoyan Zhu 0003, Guangtao Wang, Jiayin Wang 0002, Jiaxuan Li 0001, Jindong Jiang
KSEM (1)7
2025 Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models
abstract
We introduce Eagle2.5, a frontier vision-language model (VLM) for long-context multimodal learning. Our work addresses the challenges in long video comprehension and high-resolution image understanding, introducing a generalist framework for both tasks. The proposed training framework incorporates Automatic Degrade Sampling and Image Area Preservation, two techniques that preserve contextual integrity and visual details. The framework also includes numerous efficiency optimizations in the pipeline for long-context data training. Finally, we propose Eagle-Video-110K, a novel dataset that integrates both story-level and clip-level annotations, facilitating long-video understanding. Eagle2.5 demonstrates substantial improvements on long-context multimodal benchmarks, providing a robust solution to the limitations of existing VLMs. Notably, our best model Eagle2.5-8B achieves 72.4\% on Video-MME with 512 input frames, matching the results of top-tier commercial model such as GPT-4o and large-scale open-source models like Qwen2.5-VL-72B and InternVL2.5-78B.
Guo Chen 0006, Jindong Jiang, Lidong Lu, De-An Huang, Wonmin Byeon, Matthieu Le, Max Ehrlich, Tong Lu 0002, Limin Wang 0002, Bryan Catanzaro, Jan Kautz, Andrew Tao, Zhiding Yu, Guilin Liu
NeurIPS4
2025 Streamline automated biomedical discoveries with agentic bioinformatics
abstract
The emergence of artificial intelligence agents powered by large language models marks a transformative shift in computational biology. In this new paradigm, autonomous, adaptive, and intelligent agents are deployed to tackle complex biological challenges, leading to a new research field named agentic bioinformatics. Here, we explore the core principles, evolving methodologies, and diverse applications of agentic bioinformatics. We examine how agentic bioinformatics systems work synergistically to facilitate data-driven decision-making and enable self-directed exploration of biological datasets. Furthermore, we highlight the integration of agentic frameworks in key areas such as personalized medicine, drug discovery, and synthetic biology, illustrating their potential to revolutionize healthcare and biotechnology. In addition, we address the ethical, technical, and scalability challenges associated with agentic bioinformatics, identifying key opportunities for future advancements. By emphasizing the importance of interdisciplinary collaboration and innovation, we envision agentic bioinformatics as a major force in overcoming the grand challenges of modern biology, ultimately advancing both research and clinical applications.
Juexiao Zhou, Jindong Jiang, Zhongyi Han, Xin Gao 0001
Briefings Bioinform.2
2024 Layout-Agnostic Scene Text Image Synthesis with Diffusion Models
abstract
While diffusion models have significantly advanced the quality of image generation, their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene text generation are typically limited by their reliance on an intermediate layout output. This dependency often results in a constrained diversity of text styles and fonts, an inherent limitation stemming from the deterministic nature of the layout generation phase. To address these challenges, this paper introduces Scene TextGen, a novel diffusion-based model specifically designed to circumvent the need for a predefined layout stage. By doing so, Scene-TextGen facilitates a more natural and varied representation of text. The novelty of SceneTextGen lies in its integration of three key components: a character-level encoder for capturing detailed typographic properties, coupled with a character-level instance segmentation model and a word-level spotting model to address the issues of unwanted text generation and minor character inaccuracies. We validate the performance of our method by demonstrating improved character recognition rates on generated images across different public visual text datasets in comparison to both standard diffusion based methods and text specific methods.
Qilong Zhangli, Jindong Jiang, Di Liu 0003, Licheng Yu, Xiaoliang Dai, Ankit Ramchandani, Guan Pang, Dimitris N. Metaxas, Praveen Krishnan
CVPR2
2024 Slot State Space Models
abstract
Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular and it is of interest to have inductive biases that mimic this modular structure. In this paper, we introduce SlotSSMs, a novel framework for incorporating independent mechanisms into SSMs to preserve or encourage separation of information. Unlike conventional SSMs that maintain a monolithic state vector, SlotSSMs maintains the state as a collection of multiple vectors called slots. Crucially, the state transitions are performed independently per slot with sparse interactions across slots implemented via the bottleneck of self-attention. In experiments, we evaluate our model in object-centric learning, 3D visual reasoning, and long-context video understanding tasks, which involve modeling multiple objects and their long-range temporal dependencies. We find that our proposed design offers substantial performance gains over existing sequence modeling methods. Project page is available at \url{https://slotssms.github.io/}
Jindong Jiang, Fei Deng 0001, Gautam Singh, Minseung Lee, Sungjin Ahn
NeurIPS1
2024 ProxEdit: Improving Tuning-Free Real Image Editing with Proximal Guidance
abstract
DDIM inversion has revealed the remarkable potential of real image editing within diffusion-based methods. However, the accuracy of DDIM reconstruction degrades as larger classifier-free guidance (CFG) scales being used for enhanced editing. Null-text inversion (NTI) optimizes null embeddings to align the reconstruction and inversion trajectories with larger CFG scales, enabling real image editing with cross-attention control. Negative-prompt inversion (NPI) further offers a training-free closed-form solution of NTI. However, it may introduce artifacts and is still constrained by DDIM reconstruction quality. To overcome these limitations, we propose proximal guidance and incorporate it to NPI with cross-attention control. We enhance NPI with a regularization term and inversion guidance, which reduces artifacts while capitalizing on its training-free nature. Additionally, we extend the concepts to incorporate mutual self-attention control, enabling geometry and layout alterations in the editing process. Our method provides an efficient and straightforward approach, effectively addressing real image editing tasks with minimal computational overhead.
Ligong Han, Song Wen 0001, Kunpeng Song, Mengwei Ren, Ruijiang Gao, Anastasis Stathopoulos, Xiaoxiao He, Yuxiao Chen 0002, Di Liu 0003, Qilong Zhangli, Jindong Jiang, Zhaoyang Xia, Akash Srivastava, Dimitris N. Metaxas
WACV13
2023 Object-Centric Slot Diffusion
abstract
The recent success of transformer-based image generative models in object-centric learning highlights the importance of powerful image generators for handling complex scenes. However, despite the high expressiveness of diffusion models in image generation, their integration into object-centric learning remains largely unexplored in this domain. In this paper, we explore the feasibility and potential of integrating diffusion models into object-centric learning and investigate the pros and cons of this approach. We introduce Latent Slot Diffusion (LSD), a novel model that serves dual purposes: it is the first object-centric learning model to replace conventional slot decoders with a latent diffusion model conditioned on object slots, and it is also the first unsupervised compositional conditional diffusion model that operates without the need for supervised annotations like text. Through experiments on various object-centric tasks, including the first application of the FFHQ dataset in this field, we demonstrate that LSD significantly outperforms state-of-the-art transformer-based decoders, particularly in more complex scenes, and exhibits superior unsupervised compositional generation quality. In addition, we conduct a preliminary investigation into the integration of pre-trained diffusion models in LSD and demonstrate its effectiveness in real-world image segmentation and generation. Project page is available at https://latentslotdiffusion.github.io
Jindong Jiang, Fei Deng 0001, Gautam Singh, Sungjin Ahn
NeurIPS1
2020 SCALOR: Generative World Models with Scalable Object Representations
Jindong Jiang, Sepehr Janghorbani, Gerard de Melo, Sungjin Ahn
ICLR1
2020 SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
Zhixuan Lin, Yi-Fu Wu, Skand Vishwanath Peri, Weihao Sun, Gautam Singh, Fei Deng 0001, Jindong Jiang, Sungjin Ahn
ICLR7
2020 Improving Generative Imagination in Object-Centric World Models
abstract
The remarkable recent advances in object-centric generative world models raise a few questions. First, while many of the recent achievements are indispensable for making a general and versatile world model, it is quite unclear how these ingredients can be integrated into a unified framework. Second, despite using generative objectives, abilities for object detection and tracking are mainly investigated, leaving the crucial ability of temporal imagination largely under question. Third, a few key abilities for more faithful temporal imagination such as multimodal uncertainty and situation-awareness are missing. In this paper, we introduce Generative Structured World Models (G-SWM). The G-SWM achieves the versatile world modeling not only by unifying the key properties of previous models in a principled framework but also by achieving two crucial new abilities, multimodal uncertainty and situation-awareness. Our thorough investigation on the temporal generation ability in comparison to the previous models demonstrates that G-SWM achieves the versatility with the best or comparable performance for all experiment settings including a few complex settings that have not been tested before. https://sites.google.com/view/gswm
Zhixuan Lin, Yi-Fu Wu, Skand Vishwanath Peri, Bofeng Fu, Jindong Jiang, Sungjin Ahn
ICML5
2020 Generative Neurosymbolic Machines
abstract
Reconciling symbolic and distributed representations is a crucial challenge that can potentially resolve the limitations of current deep learning. Remarkable advances in this direction have been achieved recently via generative object-centric representation models. While learning a recognition model that infers object-centric symbolic representations like bounding boxes from raw images in an unsupervised way, no such model can provide another important ability of a generative model, i.e., generating (sampling) according to the structure of learned world density. In this paper, we propose Generative Neurosymbolic Machines, a generative model that combines the benefits of distributed and symbolic representations to support both structured representations of symbolic components and density-based generation. These two crucial properties are achieved by a two-layer latent hierarchy with the global distributed latent for flexible density modeling and the structured symbolic latent map. To increase the model flexibility in this hierarchical structure, we also propose the StructDRAW prior. In experiments, we show that the proposed model significantly outperforms the previous structured representation models as well as the state-of-the-art non-structured generative models in terms of both structure accuracy and image generation quality.
Jindong Jiang, Sungjin Ahn
NeurIPS1