Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Rundong Su

dblp:402/5678 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 50% Generative modeling · 50%
Computer graphics and multimedia
1 paper
Visual content generation and editing · 100%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning › model compression › transformer compression
attention compression
0.912025
DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers · ICCV 2025
Machine learning › Generative modeling
diffusion model
0.912025
DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers · ICCV 2025
Machine learning › Generative modeling › diffusion model
diffusion transformer
0.912025
DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers · ICCV 2025
Machine learning › Efficient and distributed learning
model compression
0.912025
DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers · ICCV 2025
Visual content generation and editing › image generation
text-to-image generation
0.312025
DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers · ICCV 2025

Methods — techniques the papers use, named apart from their topics

head-wise arrow attention · 1.7attention caching · 1.7fused kernels · 0.9fused kernel · 0.9
YearPublicationVenuePosition
2025 DiTFastAttnV2: Head-Wise Attention Compression for Multi-Modality Diffusion Transformers
abstract
Text-to-image generation models, especially Multimodal Diffusion Transformers (MMDiT), have shown remarkable progress in generating high-quality images. However, these models often face significant computational bottlenecks, particularly in attention mechanisms, which hinder their scalability and efficiency. In this paper, we introduce DiTFastAttnV2, a post-training compression method designed to accelerate attention in MMDiT. Through an in-depth analysis of MMDiT's attention patterns, we identify key differences from prior DiT-based methods and propose head-wise arrow attention and caching mechanisms to dynamically adjust attention heads, effectively bridging this gap. We also design an Efficient Fused Kernel for further acceleration. By leveraging local metric methods and optimization techniques, our approach significantly reduces the search time for optimal compression schemes to just minutes while maintaining generation quality. Furthermore, with the customized kernel, DiTFastAttnV2 achieves a 68% reduction in attention FLOPs and 1.5x end-to-end speedup on 2K image generation without compromising visual fidelity.
Hanling Zhang, Rundong Su, Zhihang Yuan, Pengtao Chen, Mingzhu Shen, Yibo Fan, Shengen Yan, Guohao Dai 0001, Yu Wang 0002
ICCV2