Ze Gao 0003

dblp:228/6532-3 · DBLP profile ↗
← Back
10ranked-venue papers
2as first author
10since 2021 · last 2025
0000-0001-9347-6312ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 8 · 1 first-author · 8 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
YearPublicationVenuePosition
2025 LoRA-Based Pattern Generation for Yi Ethnic Embroidery Heritage Preservation
abstract
Alive Yi 2.0 combines cultural heritage, design innovation, and artificial intelligence (AI) to preserve and reimagine Yi minority embroidery patterns.Using a curated database of traditional Yi embroidery patterns, we implemented LoRA-based AI models to generate new designs that maintain cultural authenticity while enabling contemporary interpretations.This work transforms traditional patterns into modern variations through fine-tuned stable diffusion models, creating designs that respect cultural elements while appealing to younger generations.Our approach demonstrates the potential of AI-assisted design in cultural heritage preservation and provides a framework for using computational creativity to revitalize traditional heritage in the digital era.
Mengyao Guo 0001, Ruokun Chen, Kexin Nie, Ze Gao 0003
Creativity & Cognition4
2025 Visual Storytelling in HCI: A Workshop on Narrative Development Through Sequential Art
abstract
Visual narrative methodologies provide a more comprehensive and intuitive framework for articulating the multifaceted interactions between human users and computational systems.This workshop guides participants through five segments: image-based storytelling, figure sketching, narrative development, practical exercises, and collaborative critique.Participants learn to translate complex interactive systems into clear visual narratives using both analog and digital techniques.Through structured activities and provided C&C '25, June 23-25, 2025, Virtual, United Kingdom Guo and Gao et al.resources, they develop skills to effectively communicate user experiences, system behaviors, and design concepts across stakeholder groups.The workshop equips both new and experienced practitioners with tools to enhance design communication and cross-cultural collaboration in Human-Computer Interaction (HCI).
Mengyao Guo 0001, Kexin Nie, Jinda Han, Xin Wang 0206, zhishun Chi, Ze Gao 0003
Creativity & Cognition8
2024 The Digital Blossoming: Generative Flowers of Ethnic Wisdom
abstract
This research explores the computational empowerment of intangible cultural heritage through interactive generative platforms. Prototypes in TouchDesigner software visualize traditional Kam minority patterns by applying particle system effects to highlight symbolic meanings. Users actively transform heritage visuals through real-time interaction, fostering cultural appreciation. Technical realization involves visual programming to construct specialized generative workflows. Phases of diffusion and dissipation of culturally significant motifs are configured procedurally. Preliminary explorations will inform training generative AI models by discerning cultural logic. The goal is an adaptive living database where tradition evolves algorithmically. This pioneering approach synergizes heritage and technology to maintain intangible culture. It provides a model for participatory digital curation where communities actively shape legacies. Limitations around complexity persist. However, the research pioneers cultural resilience through computational creativity.
Ze Gao 0003, Mengyao Guo 0001, Dongliang Xu
Creativity & Cognition1
2024 A Technical Demonstration on Streamlining 3D Motion Production Workflows with a Markerless Motion Capture System
abstract
This paper presents an innovative markerless motion capture system to streamline 3D animation workflows using spatial computing and deep learning. We employ off-the-shelf cameras and neural networks to automatically reconstruct 3D joint positions from video. Our lightweight solution retargets motions onto character rigs without manual intervention. With accurate real-time tracking of up to 30 fps, our system has faster processing than the previous method. Our system contributes an easy-to-use, cost-effective motion capture solution by replacing specialized equipment with learned spatial reasoning. This work democratizes immersive content creation by streamlining motion capture based on computer vision and deep learning, helping make high-fidelity capture broadly accessible.
Mengyao Guo 0001, Yu Nie 0004, Ze Gao 0003
Creativity & Cognition3
2024 Reconstructing Identity: An Augmented Reality Exploring Self-Objectification
abstract
Reconstructing Identity harnesses Augmented Reality (AR) technology to prompt introspection and dialogue on identity and societal roles in an era of upheaval and unpredictability. It offers a space for contemplation and experimentation. The work invites audiences into a virtual overlay of reality, allowing them to engage with and reflect on the complexities of self-identity and societal expectations. By integrating AR, the artwork creates an immersive environment, enhancing the interaction between the audience and the art. This approach emphasizes the potential of AR in deepening the understanding of our place in a complex world and exploring personal identity. In this artwork, AR enables a deeper connection with the audience, encouraging them to contemplate and experiment with the deconstruction of self-objectification.
Xingzhi Shi, Mengyao Guo 0001, Ze Gao 0003
Creativity & Cognition3
2024 CharacterMeet: Supporting Creative Writers' Entire Story Character Construction Processes Through Conversation with LLM-Powered Chatbot Avatars
abstract
Support for story character construction is as essential as characters are for stories. Building upon past research on early character construction stages, we explore how conversation with chatbot avatars embodying characters powered by more recent technologies could support the entire character construction process for creative writing. Through a user study (N=14) with creative writers, we examine thinking and usage patterns of CharacterMeet, a prototype system allowing writers to progressively manifest characters through conversation while customizing context, character appearance, voice, and background image. We discover that CharacterMeet facilitates iterative character construction. Specifically, participants, including those with more linear usual approaches, alternated between writing and personalized exploration through visualization of ideas on CharacterMeet while visuals and audio enhanced immersion. Our findings support research on iterative creative processes and the growing potential of personalizable generative AI creativity support tools. We present design implications for leveraging chatbot avatars in the creative writing process.
Hua Xuan Qin, Shan Jin 0002, Ze Gao 0003, Mingming Fan 0001, Pan Hui 0001
CHI3
2024 Echoes of Heritage: Exploring the Convergence of Immersive XR and Live-Action Roleplay for Rural Revitalization
abstract
Due to dwindling populations, rural communities frequently encounter difficulties in economic growth and conserving their cultural heritage. These challenges are often the result of younger generations moving to urban areas in search of better opportunities, leaving behind an aging population that struggles to maintain traditional practices and stimulate local economies. Innovative entertainment forms such as Immersive XR and theater-style LARPing games are emerging as potential solutions to these challenges. These immersive experiences, particularly appealing to younger demographics, can attract and engage them back in rural revitalization efforts. By integrating modern entertainment with cultural preservation, they present an opportunity to bridge the gap between tradition and innovation, thus injecting life into these communities. This paper carefully evaluates the potential benefits and challenges of integrating these technologies into rural revitalization initiatives, drawing on successful case studies for support. It aims to improve our understanding of the possible impact of immersive XR and theater-style LARPing on rural revitalization efforts. Additionally, the paper strives to provide insightful recommendations to guide future research and development in this increasingly important field.
Mengyao Guo 0001, Yuanlinxi Li, Ze Gao 0003
TEI3
2023 Tangible Web: An Interactive Immersion Virtual Reality Creativity System that Travels Across Reality
abstract
With the advancement of virtual reality (VR) technology, virtual displays have become integral to how museums, galleries, and other tourist destinations present their collections to the public. However, the current lack of immersion in virtual reality displays limits the user’s ability to experience and appreciate its aesthetics. This paper presents a case study of a creative approach taken by a tourist attraction venue in developing a physical network system that allows visitors to enhance VR’s aesthetic aspects based on environmental parameters gathered by external sensors. Our system was collaboratively developed through interviews and sessions with twelve stakeholder groups interested in art and exhibitions. This paper demonstrates how our technological advancements in interaction, immersion and visual attractiveness surpass those of earlier virtual display generations. Through multimodal interaction, we aim to encourage innovation on the Web and create more visually appealing and engaging virtual displays. It is hoped that the greater online art community will gain fresh insight into how people interact with virtual worlds as a result of this work.
Simin Yang, Ze Gao 0003, Reza Hadi Mogavi, Pan Hui 0001, Tristan Braud
WWW2
2022 Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction
abstract
User Interaction for NFTs (Non-fungible Tokens) is gaining increasing attention. Although NFTs have been traditionally single-use and monolithic, recent applications aim to connect multimodal interaction with human behavior. This paper reviews the related technological approaches and business practices in NFT art. We highlight that multimodal interaction is a currently under-studied issue in mainstream NFT art, and conjecture that multimodal interaction is a crucial enabler for decentralization in the NFT community. We present a continuum theory and propose a framework combining a bottom-up approach with AI multimodal process. Through this framework, we put forward integrating human behavior data into generative NFT units, as "multimodal interactive NFT." Our work displays the possibilities of NFTs in the art world, beyond the traditional 2D and 3D static content.
Anqi Wang 0003, Ze Gao 0003, Lik-Hang Lee, Tristan Braud, Pan Hui 0001
ICMI2
2022 Meditation in Motion: Interactive Media Art Visualization Based on Ancient Tai Chi Chuan
abstract
Tai Chi is an essential concept of Chinese philosophy which refers to the universe's most primitive state of order. Tai Chi Chuan is a martial art and meditative practice that incorporates the Tai Chi philosophy. With the advent of the digital media age, this traditional martial art is falling into disuse, and most contemporary youths are losing interest. "Meditation in Motion" is an interactive media art installation inspired by the Tai Chi Chuan forms. It aims to convey the central concepts of balance, narrative, and universe of Tai Chi Chuan by breaking down its movements into overlapping circles, building a visual representation of the energy flows in the body.
Ze Gao 0003, Anqi Wang 0003, Pan Hui 0001, Tristan Braud
ACM Multimedia1