Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Ji Xie

dblp:93/1057 · DBLP profile ↗
← Back
3ranked-venue papers
0as first author
3since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Generative modeling · 57% 3D vision · 24% Robot navigation and mapping · 19%
Computer graphics and multimedia
3 papers
Visual content generation and editing · 80% Audio and music processing · 20%

Topics — the 11 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
0.912025
Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer · NeurIPS 2025
Machine learning › Generative modeling › diffusion model
diffusion transformer
0.912025
Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer · NeurIPS 2025
Computer vision › 3D vision
multimodal perception
0.912025
Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization · NeurIPS 2025
Robotics › Robot navigation and mapping
sound source localization
0.912025
Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization · NeurIPS 2025
Machine learning › Generative modeling › diffusion model
text-to-image generation
0.912025
3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation · ICLR 2025
Visual content generation and editing › image generation
controllable image generation
0.912025
3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation · ICLR 2025
Visual content generation and editing
image editing
0.912025
Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer · NeurIPS 2025
Visual content generation and editing › image editing › text-guided image editing
instruction-based image editing
0.912025
Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer · NeurIPS 2025
Visual content generation and editing › controllable generation
layout control
0.912025
3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation · ICLR 2025
Audio and music processing
sound source localization
0.912025
Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization · NeurIPS 2025
Computer vision › 3D vision
depth estimation
0.312025
3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation · ICLR 2025

Methods — techniques the papers use, named apart from their topics

psychophysics experiment · 1.7parameter-efficient fine-tuning · 1.7inference-time scaling · 1.7in-context generation · 1.7controlnet · 1.7cochleagram representation · 1.7adapter · 1.7LDM3D · 1.7HRTF rendering · 1.7
YearPublicationVenuePosition
2025 3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation
abstract
The increasing demand for controllable outputs in text-to-image generation has spurred advancements in multi-instance generation (MIG), allowing users to define both instance layouts and attributes. However, unlike image-conditional generation methods such as ControlNet, MIG techniques have not been widely adopted in state-of-the-art models like SD2 and SDXL, primarily due to the challenge of building robust renderers that simultaneously handle instance positioning and attribute rendering. In this paper, we introduce Depth-Driven Decoupled Image Synthesis (3DIS), a novel framework that decouples the MIG process into two stages: (i) generating a coarse scene depth map for accurate instance positioning and scene composition, and (ii) rendering fine-grained attributes using pre-trained ControlNet on any foundational model, without additional training. Our 3DIS framework integrates a custom adapter into LDM3D for precise depth-based layouts and employs a finetuning-free method for enhanced instance-level attribute rendering. Extensive experiments on COCO-Position and COCO-MIG benchmarks demonstrate that 3DIS significantly outperforms existing methods in both layout precision and attribute rendering. Notably, 3DIS offers seamless compatibility with diverse foundational models, providing a robust, adaptable solution for advanced multi-instance generation. The code is available at: https://github.com/limuloo/3DIS.
Dewei Zhou, Ji Xie, Zongxin Yang, Yi Yang 0001
ICLR2
2025 Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization
abstract
Imagine hearing a dog bark and instinctively turning toward the sound—only to find a parked car, while a silent dog sits nearby. Such moments of sensory conflict challenge perception, yet humans flexibly resolve these discrepancies, prioritizing auditory cues over misleading visuals to accurately localize sounds. Despite the rapid advancement of multimodal AI models that integrate vision and sound, little is known about how these systems handle cross-modal conflicts or whether they favor one modality over another. Here, we systematically and quantitatively examine modality bias and conflict resolution in AI models for Sound Source Localization (SSL). We evaluate a wide range of state-of-the-art multimodal models and compare them against human performance in psychophysics experiments spanning six audiovisual conditions, including congruent, conflicting, and absent visual and audio cues. Our results reveal that humans consistently outperform AI in SSL and exhibit greater robustness to conflicting or absent visual information by effectively prioritizing auditory signals. In contrast, AI shows a pronounced bias toward vision, often failing to suppress irrelevant or conflicting visual input, leading to chance-level performance. To bridge this gap, we present EchoPin, a neuroscience-inspired multimodal model for SSL that emulates human auditory perception. The model is trained on our carefully curated AudioCOCO dataset, in which stereo audio signals are first rendered using a physics-based 3D simulator, then filtered with Head-Related Transfer Functions (HRTFs) to capture pinnae, head, and torso effects, and finally transformed into cochleagram representations that mimic cochlear processing. To eliminate existing biases in standard benchmark datasets, we carefully controlled the vocal object sizes, semantics, and spatial locations in the corresponding images of AudioCOCO. EchoPin outperforms existing models trained on standard audio-visual datasets. Remarkably, consistent with neuroscience findings, it exhibits a human-like localization bias, favoring horizontal (left–right) precision over vertical (up–down) precision. This asymmetry likely arises from HRTF-shaped and cochlear-modulated stereo audio and the lateral placement of human ears, highlighting how sensory input quality and physical structure jointly shape precision of multimodal representations. All code, data, and models are available \href{https://github.com/CuriseJia/SSHS}{here}.
Yanhao Jia, Ji Xie, S. Jivaganesh, Mengmi Zhang
NeurIPS2
2025 Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer
abstract
Instruction-based image editing enables precise modifications via natural language prompts, but existing methods face a precision-efficiency tradeoff: fine-tuning demands massive datasets (>10M) and computational resources, while training-free approaches suffer from weak instruction comprehension. We address this by proposing \textbf{ICEdit}, which leverages the inherent comprehension and generation abilities of large-scale Diffusion Transformers (DiTs) through three key innovations: (1) An in-context editing paradigm without architectural modifications; (2) Minimal parameter-efficient fine-tuning for quality improvement; (3) Early Filter Inference-Time Scaling, which uses VLMs to select high-quality noise samples for efficiency. Experiments show that ICEdit achieves state-of-the-art editing performance with only 0.1\% of the training data and 1\% trainable parameters compared to previous methods. Our approach establishes a new paradigm for balancing precision and efficiency in instructional image editing.
Zechuan Zhang, Ji Xie, Yu Lu 0019, Zongxin Yang, Yi Yang 0001
NeurIPS2