While previous research has attempted to link features of individuals’ drawings to their emotional states, it often overlooks the deeply personal and context-driven nature of visual expression. To bridge the gap, we conducted a two‑week diary study with 21 participants, who used a custom‑built app to track daily emotions through free drawings, followed by interviews reflecting on their artwork. Among the 252 drawings gathered, we found no strong correlations between reported emotions and measurable drawing behaviors; instead, participants expressed emotions through diverse approaches, from illustrations of emotion sources (e.g., events, objects) and metaphors, to emojis, literal text and spontaneous, random mark-making. Participants developed consistent personal styles and described drawing as an intuitive, playful, and safe outlet, though some faced challenges with the ambiguity of visual expressions and interpreting their creations afterwards. With the lessons learned, we discuss opportunities for designing expression-centered emotion tracking technologies that embrace individuality and creativity.

Hand gestures are widely used in daily life for expressing emotions, yet gesture input is not part of existing emotion tracking systems. To seek a practical and effortless way of using gestures to inform emotions, we explore the relationships between gestural features and commonly experienced emotions by focusing on single-hand gestures that are easy to perform and capture. First, we collected 756 gestures (in photo and video pairs) from 63 participants who expressed different emotions in a survey, and then interviewed 11 of them to understand their gesture-forming rationales. We found that the valence and arousal level of the expressed emotions significantly correlated with participants’ finger-pointing direction and their gesture strength, and synthesized four channels through which participants externalized their expressions with gestures. Reflecting on the findings, we discuss how emotions can be characterized and contextualized with gestural cues and implications for designing multimodal emotion tracking systems and beyond.