EDBT 2026 Demo / reviewers in the wild / expert
Stefanie Mueller 0001
dblp:31/7503 · also Stefanie Müller 0001
· DBLP profile ↗
75ranked-venue papers
6as first author
46since 2021 · last 2026
0000-0001-7743-7807ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Human-computer interaction and ubiquitous computing · 70 · 6 first-author · 42 since 2021Artificial intelligence and machine learning · 3 · 3 since 2021Systems, architecture and hardware · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Xspine: Integrating Motion Sensing Capability into Dynamic Structures Using Multi-material FDM 3D PrintingabstractWe present Xspine, a design and fabrication method for creating motion-capable, self-sensing structures using multi-material FDM 3D printing with conductive filaments. Our method embeds compliant mechanisms and circuits directly into geometries, enabling the detection of large deformations in a single, assembly-free print. Specifically, we design printable components and circuit layouts aligned with the layer-by-layer nature of FDM 3D printing. Furthermore, we explore physical and digital augmentation strategies to enhance the interactive potential of the structures. To simplify the workflow, we develop an interactive design tool that allows users to configure motion behaviors, preview structural responses, and generate printable circuits. Finally, we demonstrate several application examples that highlight the potential of Xspine for customizable and interactive 3D-printed devices. Dingning Cao, Xiang Chang, Karla Sahin, Stefanie Mueller 0001, Jiaji Li |
CHI | 5 |
| 2026 | Y-zipper: 3D Printing Flexible-Rigid Transition Mechanism for Rapid and Reversible AssemblyabstractWe present Y-zipper, a novel three-sided 3D-printed zipper structure that enables three flexible strips to interlock and transform into a rigid rod-like form. Building on this flex–rigid transition mechanism, we further design a specialized slider to achieve rapid and reversible zipping interactions. This slider serves as the basis for three actuation methods—manual, dynamic mechanical, and static mechanical—which enable both remote control and automated closure and release. In addition, Y-zipper provides four motion primitives: straight, bend, coil, and screw, whose combinations extend the flex–rigid transition mechanism to spatial curve structures. To support customization, we develop a computational design tool that automatically generates zipper geometry based on input primitives, unfolds the structure for 3D printing, and embeds both teeth and compliant bridges. Controlled experiments evaluate its mechanical properties, repeatability, and actuation speed, demonstrating robustness and reliability. Finally, we showcase a series of functional prototypes, including a medical wrist brace, a kinetic art installation, and a rapidly deployable tent structure. Jiaji Li, Xiang Chang, Dingning Cao, Maxine Perroni-Scharf, Jeremy Mrzyglocki, Takumi Yamamoto, William T. Freeman, Stefanie Mueller 0001 |
CHI | 9 |
| 2026 | VisiPrint: Previewing 3D-Print Appearance from Real Material SamplesabstractWe present VisiPrint, a tool for appearance-first previews of 3D-printed objects. Existing print preview slicers focus on toolpaths, not appearance, while pure rendering software is complex and cannot automatically reproduce slicing patterns. Prior work highlights persistent gaps between digital previews and printed results, such as color shifts, gloss/translucency changes, and layer-line highlights, motivating the creation of VisiPrint, an appearance-focused support tool. The VisiPrint algorithm combines slicer screenshots with filament photos via a custom diffusion-based synthesis pipeline. We present both a standalone user interface for VisiPrint compatible with any slicer and an Ultimaker Cura Plugin. We evaluate VisiPrint through a user study showing it is significantly faster, easier to use, and more faithful than alternatives: within a time-limit, participants completed 100% of preview tasks with VisiPrint, versus 63% with Cura and 13% with Blender. VisiPrint narrows the gap between design intent and printed appearance, complementing settings-centric tools with appearance-driven decision support. Maxine Perroni-Scharf, Faraz Faruqi, Sooyeon Ahn 0001, Raul Hernandez, Szymon Rusinkiewicz, William T. Freeman, Stefanie Mueller 0001 |
CHI | 7 |
| 2026 | Zip-up Print: Rapid and Assemblable 3D printing Using 2D Flattened Zipper-like StructuresabstractWe propose a method to fabricate objects composed of 3D printed flattened pieces with integrated zipper-like structures. The object is manually assembled into a 3D shape by connecting the zipper components. By employing a zipper design that allows for angle-independent connections between patches, our method enables both the surface and zipper components to be printed in the same orientation, resulting in high-quality reconstruction of the input model with a faster 3D printing process that wastes less material. We implement a fully automated pipeline that takes a 3D model as input, converts it into developable patches, generates the zipper structures, and flattens them for subsequent 3D printing. We demonstrate that our approach significantly reduces the fabrication time and support material consumption. We also present application examples that highlight the versatility of our method. Takumi Yamamoto, Jiaji Li, Akib Zaman 0002, Noah Barnes, Yuta Sugiura, Stefanie Mueller 0001, Koya Narumi |
CHI | 6 |
| 2026 | ChromoLCD: LCD-based Compact Reprogrammer for On-the-fly High-Resolution Images on Photochromic SurfacesabstractColor-changing materials, such as photochromic pigments, allow objects to have reprogrammable multicolor surface images. Existing systems that reprogram these images are based on projectors and LEDs, each with advantages and limitations in device portability and image resolution. In this paper, we present ChromoLCD, a surface reprogrammer that uses a liquid crystal display (LCD) to achieve a compact handheld device without sacrificing image resolution. ChromoLCD consists of an LCD panel with a custom backlight containing R,G,B and UV LEDs, forming high-resolution light patterns with the required wavelengths. The compact form factor of ChromoLCD enables on-the-fly reprogramming of everyday surfaces. Our technical evaluation shows that ChromoLCD achieves a resolution of 25 ppi, which is 8 times better than the prior work. We demonstrate ChromoLCD with three applications, including the stamping of reprogrammable AR markers on a kitchen counter, on-the-fly designs on personal accessories, and reference pictures on a whiteboard. Yunyi Zhu, Katherine Arianna Yan, Emily Guan, Alexandru Luchianov, Eden Hen, Stefanie Mueller 0001 |
TEI | 7 |
| 2025 | TactStyle: Generating Tactile Textures with Generative AI for Digital FabricationabstractCHI ’25, April 26–May 01, 2025, Yokohama, Japan Faraz Faruqi, Maxine Perroni-Scharf, Jaskaran Singh Walia, Yunyi Zhu, Shuyue Feng, Donald Degraen, Stefanie Mueller 0001 |
CHI | 7 |
| 2025 | Xstrings: 3D Printing Cable-Driven Mechanism for Actuation, Deformation, and ManipulationabstractCHI ’25, Yokohama, Japan Jiaji Li, Shuyue Feng, Maxine Perroni-Scharf, Yujia Liu 0004, Emily Guan, Guanyun Wang, Stefanie Mueller 0001 |
CHI | 7 |
| 2025 | InteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed RealityabstractCHI ’25, Yokohama, Japan Zisu Li, Jiawei Li 0009, Zeyu Xiong, Shumeng Zhang, Faraz Faruqi, Stefanie Mueller 0001, Xiaojuan Ma, Mingming Fan 0001 |
CHI | 6 |
| 2025 | EI-Lite: Electrical Impedance Sensing for Micro-gesture Recognition and Pinch Force Estimation
Junyi Zhu 0001, Tianyu Xu 0008, Emily Guan, JaeYoung Moon, Stiven Morvan, D. Shin, Andrea Colaco, Stefanie Mueller 0001, Karan Ahuja, Yiyue Luo, Ishan Chatterjee |
UIST | 9 |
| 2025 | Meta-antenna: Mechanically Frequency Reconfigurable Metamaterial Antennas
Marwa Alalawi, Regina Zheng, Sooyeon Ahn 0001, Katherine Yan, Ticha Sethapakdi, Junyi Zhu 0001, Stefanie Mueller 0001 |
UIST | 7 |
| 2025 | SustainaPrint: Making the Most of Eco-Friendly Filaments
Maxine Perroni-Scharf, Jennifer Xiao, Cole Paulin, Zhi Ray Wang, Ticha Sethapakdi, Muhammad Abdullah 0002, Patrick Baudisch, Stefanie Mueller 0001 |
UIST | 8 |
| 2025 | FabObscura: Computational Design and Fabrication for Interactive Barrier-Grid Animations
Ticha Sethapakdi, Maxine Perroni-Scharf, Jiaji Li, Justin Solomon 0001, Arvind Satyanarayan, Stefanie Mueller 0001 |
UIST | 7 |
| 2025 | One String to Pull Them All: Fast Assembly of Curved Structures from Flat Auxetic LinkagesabstractWe present a computational approach for designing freeform structures that can be rapidly assembled from initially flat configurations by a single string pull. The target structures are decomposed into rigid spatially varied quad tiles that are optimized to approximate the user-provided surface, forming a flat mechanical linkage. Our algorithm then uses a two-step method to find a physically realizable string path that controls only a subset of tiles to smoothly actuate the structure from flat to assembled configuration. We initially compute the minimal subset of tiles that are required to be controlled with the string considering the geometry of the structure and interaction among the tiles. We then find a valid string path through these tiles that minimizes friction, which will assemble the flat linkage into the target 3D structure upon tightening a single string. The resulting designs can be easily manufactured with computational fabrication techniques such as 3D printing, CNC milling, molding, etc. in flat configuration that, in addition to manufacturing, facilitates storage and transportation. We validate our approach by developing a series of physical prototypes and showcasing various application case studies, ranging from medical devices, space shelters, to architectural designs. Akib Zaman 0002, Jacqueline Aslarus, Jiaji Li, Stefanie Mueller 0001, Mina Konakovic-Lukovic |
ACM Trans. Graph. | 4 |
| 2024 | Liquids Identification and Manipulation via Digitally Fabricated Impedance SensorsabstractDespite recent exponential advancements in computer vision and reinforcement learning, it remains challenging for robots to interact with liquids. These challenges are particularly pronounced due to the limitations imposed by opaque containers, transparent liquids, fine-grained splashes, and visual obstructions arising from the robot’s own manipulation activities. Yet, there exists a substantial opportunity for robotics to excel in liquid identification and manipulation, given its potential role in chemical handling in laboratories and various manufacturing sectors such as pharmaceuticals or beverages. In this work, we present a novel approach for liquid class identification and state estimation leveraging electrical impedance sensing. We design and mount a digitally embroidered electrode array to a commercial robot gripper. Coupled with a customized impedance sensing board, we collect data on liquid manipulation with a swept frequency sensing mode and a frequency-specific impedance measuring mode. Our developed learning-based model achieves an accuracy of 93.33% in classifying 9 different types of liquids (8 liquids + air), and 97.65% in estimating the liquid state. We investigate the effectiveness of our system with a series of ablation studies. These findings highlight our work as a promising solution for enhancing robotic manipulation in liquid-related tasks. Junyi Zhu 0001, Young Joong Lee, Yiyue Luo, Tianyu Xu 0008, Chao Liu 0021, Daniela Rus, Stefanie Mueller 0001, Wojciech Matusik |
ICRA | 7 |
| 2024 | FabRobotics: Fusing 3D Printing with Mobile Robots to Advance Fabrication, Robotics, and InteractionabstractWe present FabRobotics, a digital fabrication pipeline that combines traditional 3D printing with mobile robots. By integrating these two technologies, we aim to create new opportunities for 3D printers to fabricate objects quickly and efficiently, and for mobile robots to enhance their adaptability and interactivity. To explore this novel research opportunity, we have developed a proof-of-concept implementation pipeline, allowing users to execute hybrid turn-taking control of a 3D printer and mobile robots to autonomously 3D print objects on/with mobile robots. The system was implemented with commercially available 3D printers (Prusa MINI) and mobile robots (toio), and we share various techniques and knowledge specific to fusing 3D printers and mobile robots (e.g. printing mobile robot docks for stable prints on robots). Based on the proof-of-concept system, we demonstrate various application usages and functionalities, showcasing how 3D printing and mobile robots can mutually advance each other for novel fabrication and interaction. Lastly, we share our further exploration of extended prototypes (e.g. fusing two printers) and discuss future technical challenges and research opportunities. Ramarko Bhattacharya, Jonathan Lindstrom, Ahmad Taka, Martin Nisser, Stefanie Mueller 0001, Ken Nakagaki |
TEI | 5 |
| 2024 | MouthIO: Fabricating Customizable Oral User Interfaces with Integrated Sensing and ActuationabstractThis paper introduces MouthIO, the first customizable intraoral user interface that can be equipped with various sensors and output components. MouthIO consists of an SLA-printed brace that houses a flexible PCB within a bite-proof enclosure positioned between the molar teeth and inner cheeks. Our MouthIO design and fabrication technique enables makers to customize the oral user interfaces in both form and function at low cost. All parts in contact with the oral cavity are made of bio-compatible materials to ensure safety, while the design takes into account both comfort and portability. We demonstrate MouthIO through three application examples ranging from beverage consumption monitoring, health monitoring, to assistive technology. Results from our full-day user study indicate high wearability and social acceptance levels, while our technical evaluation demonstrates the device’s ability to withstand adult bite forces. Yijing Jiang, Julia Kleinau, Till Max Eckroth, Eve E. Hoggan, Stefanie Mueller 0001, Michael Wessely |
UIST | 5 |
| 2024 | Speed-Modulated Ironing: High-Resolution Shade and Texture Gradients in Single-Material 3D PrintingabstractWe present Speed-Modulated Ironing, a new fabrication method for programming visual and tactile properties in single-material 3D printing. We use one nozzle to 3D print and a second nozzle to reheat printed areas at varying speeds, controlling the material’s temperature-response. The rapid adjustments of speed allow for fine-grained reheating, enabling high-resolution color and texture variations. We implemented our method in a tool that allows users to assign desired properties to 3D models and creates corresponding 3D printing instructions. We demonstrate our method with three temperature-responsive materials: a foaming filament, a filament with wood fibers, and a filament with cork particles. These filaments respond to temperature by changing color, roughness, transparency, and gloss. Our technical evaluation reveals the capabilities of our method in achieving sufficient resolution and color shade range that allows surface details such as small text, photos, and QR codes on 3D-printed objects. Finally, we provide application examples demonstrating the new design capabilities enabled by Speed-Modulated Ironing. Mehmet Özdemir, Marwa Alalawi, Mustafa Doga Dogan, Jose Francisco Martinez Castro, Stefanie Mueller 0001, Zjenja Doubrovski |
UIST | 5 |
| 2024 | WasteBanned: Supporting Zero Waste Fashion Design Through Linked EditsabstractThe commonly used cut-and-sew garment construction process, in which 2D fabric panels are cut from sheets of fabric and assembled into 3D garments, contributes to widespread textile waste in the fashion industry. There is often a significant divide between the design of the garment and the layout of the panels. One opportunity for bridging this gap is the emerging study and practice of zero waste fashion design, which involves creating clothing designs with maximum layout efficiency. Enforcing the strict constraints of zero waste sewing is challenging, as edits to one region of the garment necessarily affect neighboring panels. Based on our formative work to understand this emerging area within fashion design, we present WasteBanned, a tool that combines CAM and CAD to help users prioritize efficient material usage, work within these zero waste constraints, and edit existing zero waste garment patterns. Our user evaluation indicates that our tool helps fashion designers edit zero waste patterns to fit different bodies and add stylistic variation, while creating highly efficient fabric layouts. Ruowang Zhang, Stefanie Mueller 0001, Gilbert Louis Bernstein, Adriana Schulz, Mackenzie Leake |
UIST | 2 |
| 2024 | PortaChrome: A Portable Contact Light Source for Integrated Re-Programmable Multi-Color TexturesabstractIn this paper, we present PortaChrome, a portable light source that can be attached to everyday objects to reprogram the color and texture of surfaces that come in contact with them. When PortaChrome makes contact with objects previously coated with photochromic dye, the UV and RGB LEDs inside PortaChrome create multi-color textures on the objects. In contrast to prior work, which used projectors for the color-change, PortaChrome has a thin and flexible form factor, which allows the color-change process to be integrated into everyday user interaction. Because of the close distance between the light source and the photochromic object, PortaChrome creates color textures in less than 4 minutes on average, which is 8 times faster than prior work. We demonstrate PortaChrome with four application examples, including data visualizations on textiles and dynamic designs on wearables. Yunyi Zhu, Cédric Honnet, Yixiao Kang, Junyi Zhu 0001, Angelina J. Zheng, Kyle Heinz, Grace Tang, Luca Musk, Michael Wessely, Stefanie Mueller 0001 |
UIST | 10 |
| 2023 | MechSense: A Design and Fabrication Pipeline for Integrating Rotary Encoders into 3D Printed MechanismsabstractWe introduce MechSense, 3D-printed rotary encoders that can be fabricated in one pass alongside rotational mechanisms, and report on their angular position, direction of rotation, and speed. MechSense encoders utilize capacitive sensing by integrating a floating capacitor into the rotating element and three capacitive sensor patches in the stationary part of the mechanism. Unlike existing rotary encoders, MechSense does not require manual assembly but can be seamlessly integrated during design and fabrication. Our MechSense editor allows users to integrate the encoder with a rotating mechanism and exports files for 3D-printing. We contribute a sensor topology and a computational model that can compensate for print deviations. Our technical evaluation shows that MechSense can detect the angular position (mean error: 1.4°) across multiple prints and rotations, different spacing between sensor patches, and different sizes of sensors. We demonstrate MechSense through three application examples on 3D-printed tools, tangible UIs, and gearboxes. Marwa Alalawi, Noah Pacik-Nelson, Junyi Zhu 0001, Ben Greenspan, Andrew Doan, Brandon M. Wong, Benjamin Owen-Block, Shanti Kaylene Mickens, Wilhelm Jacobus Schoeman, Michael Wessely, Andreea Danielescu 0001, Stefanie Mueller 0001 |
CHI | 12 |
| 2023 | FlexBoard: A Flexible Breadboard for Interaction Prototyping on Curved and Deformable SurfacesabstractWe present FlexBoard, an interaction prototyping platform that enables rapid prototyping with interactive components such as sensors, actuators and displays on curved and deformable objects. FlexBoard offers the rapid prototyping capabilities of traditional breadboards but is also flexible to conform to different shapes and materials. FlexBoard’s bendability is enabled by replacing the rigid body of a breadboard with a flexible living hinge that holds the metal strips from a traditional breadboard while maintaining the standard pin spacing. In addition, FlexBoards are also shape-customizable as they can be cut to a specific length and joined together to form larger prototyping areas. We discuss FlexBoard’s mechanical design and present a technical evaluation of its bendability, adhesion to curved and deformable surfaces, and holding force of electronic components. Finally, we show the usefulness of FlexBoard through 3 application scenarios with interactive textiles, curved tangible user interfaces, and VR. Donghyeon Ko, Junyi Zhu 0001, Michael Wessely, Stefanie Mueller 0001 |
CHI | 5 |
| 2023 | InStitches: Augmenting Sewing Patterns with Personalized Material-Efficient PracticeabstractThere is a rapidly growing group of people learning to sew online. Without hands-on instruction, these learners are often left to discover the challenges and pitfalls of sewing through trial and error, which can be a frustrating and wasteful process. We present InStitches, a software tool that augments existing sewing patterns with targeted practice tasks to guide users through the skills needed to complete their chosen project. InStitches analyzes the difficulty of sewing instructions relative to a user’s reported expertise in order to determine where practice will be helpful and then solves for a new pattern layout that incorporates additional practice steps while optimizing for efficient use of available materials. Our user evaluation indicates that InStitches can successfully identify challenging sewing tasks and augment existing sewing patterns with practice tasks that users find helpful, showing promise as a tool for helping those new to the craft. Mackenzie Leake, Kathryn Jin, Abe Davis, Stefanie Mueller 0001 |
CHI | 4 |
| 2023 | Polagons: Designing and Fabricating Polarized Light Mosaics with User-Defined Color-Changing BehaviorsabstractPolarized light mosaics (PLMs) are color-changing structures that alter their appearance based on the orientation of incident polarized light. While a few artists have developed techniques for crafting PLMs by hand, the underlying material properties are difficult to reason about; there exist no tools to bridge the high-level design objectives with the low-level physics knowledge needed to create PLMs. In this paper, we introduce the first system for creating Polagons: machine-made PLMs crafted from cellophane with user-defined color changing behaviors. Our system includes an interface for designing and visualizing Polagons as well as a fabrication process based on laser cutting and welding that requires minimal assembly by the user. We define the design space for Polagons and demonstrate how formalizing the process for creating PLMs can enable new applications in fields such as education, data visualization, and fashion. Ticha Sethapakdi, Laura Huang, Vivian Hsinyueh Chan, Lung-Pan Cheng, Fernando Fuzinatto Dall'Agnol, Mackenzie Leake, Stefanie Mueller 0001 |
CHI | 7 |
| 2023 | PullupStructs: Digital Fabrication for Folding Structures via Pull-up NetsabstractIn this paper, we introduce a method to rapidly create 3D geometries by folding 2D sheets via pull-up nets. Given a 3D structure, we unfold its mesh into a planar 2D sheet using heuristic algorithms and populate these with cutlines and throughholes. We develop a web-based simulation tool that translates users’ 3D meshes into manufacturable 2D sheets. After laser-cutting the sheet and feeding thread through these throughholes to form a pull-up net, pulling the thread will fold the sheet into the 3D structure using a single degree of freedom. We introduce the fabrication process and build a variety of prototypes demonstrating the method’s ability to rapidly create a breadth of geometries suitable for low-fidelity prototyping that are both load-bearing and aesthetic across a range of scales. Future work will expand the breadth of geometries available and evaluate the ability of our prototypes to sustain structural loads. Lauren Niu, Xinyi Yang 0003, Martin Nisser, Stefanie Mueller 0001 |
TEI | 4 |
| 2023 | Azimuth Calculation and Telecommunication between VR Headset and Smartphones for Nearby InteractionabstractThis paper aims to break the boundary between VR and IoT devices by creating interactions between 2D screens and the 3D virtual environment. Since headsets are expensive and not accessible to everyone, we aim to create a lower boundary for people to take part in the VR world using their smartphones. Existing research mostly focuses on creating new haptic devices for VR, we instead leverage existing IoT devices that people already own, such as smartphones, to make VR technologies more accessible to multiple IoT users. There are two parts in our project: azimuth detection and communication between the VR environment and IoT devices. Xinyi Yang 0003, Susanna Chen, Katarina Bulovic, Junyi Zhu 0001, Stefanie Mueller 0001 |
TEI | 5 |
| 2023 | CompuMat: A Computational Composite Material for Tangible InteractionabstractThis paper introduces a computational composite material comprising layers for actuation, computation and energy storage. Key to its design is inexpensive materials assembled from traditionally available fabrication machines to support the rapid exploration of applications from computational composites. The actuation layer is a soft magnetic sheet that is programmed to either bond, repel, or remain agnostic to other areas of the sheet. The computation layer is a flexible PCB made from copper-clad kapton engraved by a fiber laser, powered by a third energy-storage layer comprised of 0.4mm-thin lithium polymer batteries. We present the material layup and an accompanying digital fabrication process enabling users to rapidly prototype their own untethered, interactive and tangible prototypes. The material is low-profile, inexpensive, and fully untethered, capable of being used for a variety of applications in HCI and robotics including structural origami and proprioception. Xinyi Yang 0003, Martin Nisser, Stefanie Mueller 0001 |
TEI | 3 |
| 2023 | BrightMarker: 3D Printed Fluorescent Markers for Object TrackingabstractExisting invisible object tagging methods are prone to low resolution, which impedes tracking performance. We present BrightMarker, a fabrication method that uses fluorescent filaments to embed easily trackable markers in 3D printed color objects. By using an infrared-fluorescent filament that "shifts" the wavelength of the incident light, our optical detection setup filters out all the noise to only have the markers present in the infrared camera image. The high contrast of the markers allows us to track them robustly regardless of the moving objects’ surface color. Mustafa Doga Dogan, Raul Garcia-Martin, Patrick William Haertel, Jamison John O'Keefe, Ahmad Taka, Akarsh Aurora, Raul Sánchez-Reillo, Stefanie Mueller 0001 |
UIST | 8 |
| 2023 | Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AIabstractWith recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce a method for automatically segmenting 3D models into functional and aesthetic elements. This method allows users to selectively modify aesthetic segments of 3D models, without affecting the functional segments. To develop this method we first create a taxonomy of functionality in 3D models by qualitatively analyzing 1000 models sourced from a popular 3D printing repository, Thingiverse. With this taxonomy, we develop a semi-automatic classification method to decompose 3D models into functional and aesthetic elements. We propose a system called Style2Fab that allows users to selectively stylize 3D models without compromising their functionality. We evaluate the effectiveness of our classification method compared to human-annotated data, and demonstrate the utility of Style2Fab with a user study to show that functionality-aware segmentation helps preserve model functionality. Faraz Faruqi, Ahmed Katary, Tarik Hasic, Amira Abdel-Rahman, Nayeemur Rahman, Leandra Tejedor, Mackenzie Leake, Megan Hofmann, Stefanie Mueller 0001 |
UIST | 9 |
| 2023 | MagKnitic: Machine-knitted Passive and Interactive Haptic Textiles with Integrated Binary SensingabstractIn this paper, we introduce MagKnitic, a novel approach to integrate passive force feedback and binary sensing into fabrics via digital machine knitting. Our approach utilizes digital fabrication technology to enable haptic interfaces that are soft, flexible, lightweight, and conform to the user’s body shape. Despite these characteristics, our interfaces provide diverse, interactive, and responsive force feedback, expanding the design space for haptic experiences.MagKnitic provides scalable and customizable passive haptic sensations by utilizing the attractive force between ferromagnetic yarns and permanent magnets, both of which are seamlessly integrated into knitted fabrics. Moreover, we present a binary sensing capability based on the resistance drop resulting from the activated electrical path between the integrated magnets and ferromagnetic yarn upon direct contact. We offer parametric design templates for users to customize MagKnitic layouts and patterns. With various design layouts and combinations, MagKnitic supports passive haptics interactions of linear, polar, angular, planar, radial, and user-defined motions. We perform a technical evaluation of the passive force feedback and the binary sensing capabilities with different machine knitting layouts and patterns, embedded magnet sizes, and interaction distances. In addition, we conduct two user studies to validate the effectiveness of MagKnitic. Finally, we demonstrate various application scenarios, including wearable input interfaces, game controllers, passive VR/AR wearables, and interactive furniture coverings. Yiyue Luo, Junyi Zhu 0001, Kui Wu 0003, Cédric Honnet, Stefanie Mueller 0001, Wojciech Matusik |
UIST | 5 |
| 2022 | SensorViz: Visualizing Sensor Data Across Different Stages of Prototyping Interactive ObjectsabstractIn this paper, we propose SensorViz, a visualization tool that supports novice makers during different stages of prototyping with sensors. SensorViz provides three modes of visualization: (1) visualizing datasheet specifications before buying sensors, (2) visualizing sensor interaction with the environment via AR before building the physical prototype, and (3) visualizing live/recorded sensor data to test the assembled prototype. SensorViz includes a library of visualization primitives for different types of sensor data and a sensor database builder, which once a new sensor is added automatically creates a matching visualization by composing visualization primitives. Our user study with 12 makers shows that users are more effective in selecting sensors and configuring sensor layouts using SensorViz compared to traditional prototyping utilizing datasheets and manual testing on the prototype. Our post hoc interviews indicate that SensorViz reduces trial and error by allowing makers to explore sensor positions on the prototype early in the design process. Junyi Zhu 0001, Mihir Trivedi, Dishita G. Turakhia, Ngai Hang Wu, Donghyeon Ko, Michael Wessely, Stefanie Mueller 0001 |
Conference on Designing Interactive Systems | 8 |
| 2022 | InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging ToolsabstractExisting approaches for embedding unobtrusive tags inside 3D objects require either complex fabrication or high-cost imaging equipment. We present InfraredTags, which are 2D markers and barcodes imperceptible to the naked eye that can be 3D printed as part of objects, and detected rapidly by low-cost near-infrared cameras. We achieve this by printing objects from an infrared-transmitting filament, which infrared cameras can see through, and by having air gaps inside for the tag’s bits, which appear at a different intensity in the infrared image. Mustafa Doga Dogan, Ahmad Taka, Michael Lu, Yunyi Zhu, Akshat Kumar, Aakar Gupta, Stefanie Mueller 0001 |
CHI | 7 |
| 2022 | Identifying Game Mechanics for Integrating Fabrication Activities within Existing Digital GamesabstractIntegrating fabrication activities into existing video games provides opportunities for players to construct objects from their gameplay and bring the digital content into the physical world. In our prior work, we outlined a framework and developed a toolkit for integrating fabrication activities within existing digital games. Insights from our prior study highlighted the challenge of aligning fabrication mechanics with the existing game mechanics in order to strengthen the player aesthetics. Dishita G. Turakhia, Stefanie Mueller 0001, Kayla DesPortes |
CHI | 2 |
| 2022 | ElectroVoxel: Electromagnetically Actuated Pivoting for Scalable Modular Self-Reconfigurable RobotsabstractThis paper introduces a cube-based reconfigurable robot that utilizes an electromagnet-based actuation framework to reconfigure in three dimensions via pivoting. While a variety of actuation mechanisms for self-reconfigurable robots have been explored, they often suffer from cost, complexity, assembly and sizing requirements that prevent scaled production of such robots. To address this challenge, we use an actuation mechanism based on electromagnets embedded into the edges of each cube to interchangeably create identically or oppositely polarized electromagnet pairs, resulting in repulsive or attractive forces, respectively. By leveraging attraction for hinge formation, and repulsion to drive pivoting maneuvers, we can reconfigure the robot by voxelizing it and actuating its constituent modules-termed Electrovoxels-via electromagnetically actuated pivoting. To demonstrate this, we develop fully untethered, three-dimensional self-reconfigurable robots and demonstrate 2D and 3D self-reconfiguration using pivot and traversal maneuvers on an air-table and in microgravity on a parabolic flight. This paper describes the hardware design of our robots, its pivoting framework, our reconfiguration planning software, and an evaluation of the dynamical and electrical characteristics of our system to inform the design of scalable self-reconfigurable robots. Martin Nisser, Leon Cheng, Yashaswini Makaram, Ryo Suzuki 0001, Stefanie Mueller 0001 |
ICRA | 5 |
| 2022 | Selective Self-Assembly using Re-Programmable Magnetic PixelsabstractThis paper introduces a method to generate highly selective encodings that can be magnetically “programmed” onto physical modules to enable them to self-assemble in chosen configurations. We generate these encodings based on Hadamard matrices, and show how to design the faces of modules to be maximally attractive to their intended mate, while remaining maximally agnostic to other faces. We derive guarantees on these bounds, and verify their attraction and agnosticism experimentally. Using cubic modules whose faces have been covered in soft magnetic material, we show how inexpensive, passive modules with planar faces can be used to selectively self-assemble into target shapes without geometric guides. We show that these modules can be easily re-programmed for new target shapes using a CNC-based magnetic plotter, and demonstrate self-assembly of 8 cubes in a water tank. Martin Nisser, Yashaswini Makaram, Faraz Faruqi, Ryo Suzuki 0001, Stefanie Mueller 0001 |
IROS | 5 |
| 2022 | Mixels: Fabricating Interfaces using Programmable Magnetic PixelsabstractIn this paper, we present Mixels, programmable magnetic pixels that can be rapidly fabricated using an electromagnetic printhead mounted on an off-the-shelve 3-axis CNC machine. The ability to program magnetic material pixel-wise with varying magnetic force enables Mixels to create new tangible, tactile, and haptic interfaces. To facilitate the creation of interactive objects with Mixels, we provide a user interface that lets users specify the high-level magnetic behavior and that then computes the underlying magnetic pixel assignments and fabrication instructions to program the magnetic surface. Our custom hardware add-on based on an electromagnetic printhead and hall effect sensor clips onto a standard 3-axis CNC machine and can both write and read magnetic pixel values from magnetic material. Our evaluation shows that our system can reliably program and read magnetic pixels of various strengths, that we can predict the behavior of two interacting magnetic surfaces before programming them, that our electromagnet is strong enough to create pixels that utilize the maximum magnetic strength of the material being programmed, and that this material remains magnetized when removed from the magnetic plotter. Martin Nisser, Yashaswini Makaram, Lucian Covarrubias, Amadou Bah, Faraz Faruqi, Ryo Suzuki 0001, Stefanie Mueller 0001 |
UIST | 7 |
| 2022 | MuscleRehab: Improving Unsupervised Physical Rehabilitation by Monitoring and Visualizing Muscle EngagementabstractUnsupervised physical rehabilitation traditionally has used motion tracking to determine correct exercise execution. However, motion tracking is not representative of the assessment of physical therapists, which focus on muscle engagement. In this paper, we investigate if monitoring and visualizing muscle engagement during unsupervised physical rehabilitation improves the execution accuracy of therapeutic exercises by showing users whether they target the right muscle groups. To accomplish this, we use wearable electrical impedance tomography (EIT) to monitor muscle engagement and visualize the current state on a virtual muscle-skeleton avatar. We use additional optical motion tracking to also monitor the user’s movement. We conducted a user study with 10 participants that compares exercise execution while seeing muscle + motion data vs. motion data only, and also presented the recorded data to a group of physical therapists for post-rehabilitation analysis. The results indicate that monitoring and visualizing muscle engagement can improve both the therapeutic exercise accuracy during rehabilitation, and post-rehabilitation evaluation for physical therapists. Junyi Zhu 0001, Yuxuan Lei, Aashini Shah, Gila Schein, Hamid Ghaednia, Joseph H. Schwab, Casper Harteveld, Stefanie Mueller 0001 |
UIST | 8 |
| 2021 | Adapt2Learn: A Toolkit for Configuring the Learning Algorithm for Adaptive Physical Tools for Motor-Skill LearningabstractA recent study on motor-skill training showed that adaptive training tools that use shape-change to adapt the training difficulty based on learners’ performance can lead to higher learning gains. However, to date, no support tools exist to help designers create adaptive learning tools. Our formative study shows that developing the adaptive learning algorithm poses a particular challenge. To address this, we built Adapt2Learn, a toolkit that auto-generates the learning algorithm for adaptive tools. Designers choose their tool’s sensors and actuators, Adapt2Learn then configures the learning algorithm and generates a microcontroller script that designers can deploy on the tool. Once uploaded, the script assesses the learner’s performance via the sensors, computes the training difficulty, and actuates the tool to adapt the difficulty. Adapt2Learn’s visualization tool then lets designers visualize their tool’s adaptation and evaluate the learning algorithm. To validate that Adapt2Learn can generate adaptation algorithms for different tools, we built several application examples that demonstrate successful deployment. Dishita G. Turakhia, Yini Qi, Lotta-Gili Blumberg, Stefanie Mueller 0001 |
Conference on Designing Interactive Systems | 6 |
| 2021 | FabO: Integrating Fabrication with a Player's Gameplay in Existing Digital GamesabstractFabricating objects from a player’s gameplay, for example, collectibles of valuable game items, or custom game controllers shaped from game objects, expands ways to engage with digital games. Researchers currently create such integrated fabrication games from scratch, which is time-consuming and misses the potential of integrating fabrication with the myriad existing games. Integrating fabrication with the real-time gameplay of existing games, however, is challenging without access to the source files. Dishita G. Turakhia, Harrison Mitchell Allen, Kayla DesPortes, Stefanie Mueller 0001 |
Creativity & Cognition | 4 |
| 2021 | LaserFactory: A Laser Cutter-based Electromechanical Assembly and Fabrication Platform to Make Functional Devices & RobotsabstractLaserFactory is an integrated fabrication process that augments a commercially available fabrication machine to support the manufacture of fully functioning devices without human intervention. In addition to creating 2D and 3D mechanical structures, LaserFactory creates conductive circuit traces with arbitrary geometries, picks-and-places electronic and electromechanical components, and solders them in place. To enable this functionality, we make four contributions. First, we build a hardware add-on to the laser cutter head that can deposit silver circuit traces and assemble components. Second, we develop a new method to cure dispensed silver using a CO2 laser. Third, we build a motion-based signaling method that allows our system to be readily integrated with commercial laser cutters. Finally, we provide a design and visualization tool for making functional devices with LaserFactory. Having described the LaserFactory system, we demonstrate how it is used to fabricate devices such as a fully functioning quadcopter and a sensor-equipped wristband. Our evaluation shows that LaserFactory can assemble a variety of differently sized components (up to 65g), that these can be connected by narrow traces (down to 0.75mm) that become highly conductive after laser soldering (3.2Ω/m), and that our acceleration-based sensing scheme works reliably (to 99.5% accuracy). Martin Nisser, Christina Chen Liao, Yuchen Chai, Aradhana Adhikari, Steve Hodges 0001, Stefanie Mueller 0001 |
CHI | 6 |
| 2021 | Fabricaide: Fabrication-Aware Design for 2D Cutting MachinesabstractDesigners of machine-cut objects must often consider whether and how their design can be fabricated with their available materials. In contrast to tools that support preparing finished designs for fabrication, we investigate shortening the feedback loop between design creation and fabrication preparation. To this end, we present Fabricaide, a fabrication-aware tool that interleaves the processes of creating and preparing designs for fabrication. By providing live feedback on how parts should be placed onto material sheets, analyzing how much material is consumed, and alerting users when designs are infeasible, Fabricaide enables users to proactively tailor their design to their available material. Fabricaide achieves this with a custom packing algorithm that arranges parts onto material sheets at interactive speeds. Our qualitative user study shows how Fabricaide can support different workflows, encourage material-conscious design practices, and provide insights on how to further improve similar interfaces in the future. Ticha Sethapakdi, Daniel Anderson, Adrian Reginald Chua Sy, Stefanie Mueller 0001 |
CHI | 4 |
| 2021 | ChromoUpdate: Fast Design Iteration of Photochromic Color Textures Using Grayscale Previews and Local Color UpdatesabstractChromoUpdate is a texture transfer system for fast design iteration. For the early stages of design, ChromoUpdate provides a fast grayscale preview that enables a texture to be transferred in under one minute. Once designers are satisfied with the grayscale texture, ChromoUpdate supports designers in coloring the texture by transitioning individual pixels directly to a desired target color. Finally, if designers need to make a change to the color texture already transferred, ChromoUpdate can quickly transition individual pixels from one color to a new target color. ChromoUpdate accomplishes this by (1) using a UV projector rather than a UV LED, which enables pixels to be saturated individually rather than resetting the entire texture to black, and (2) providing two new texture transfer algorithms that allow for fast grayscale previews and color-to-color transitions. Our evaluation shows a significant increase in texture transfer speed for both the grayscale preview (89%) and color-to-color updates (11%). Michael Wessely, Yuhua Jin, Cattalyya Nuengsigkapian, Aleksei Kashapov, Isabel P. S. Qamar, Dzmitry Tsetserukou, Stefanie Mueller 0001 |
CHI | 7 |
| 2021 | Can Physical Tools that Adapt their Shape based on a Learner's Performance Help in Motor Skill Training?abstractAdaptive tools that can change their shape to support users with motor tasks have been used in a variety of applications, such as to improve ergonomics and support muscle memory. In this paper, we investigate whether shape-adapting tools can also help in motor skill training. In contrast to static training tools that maintain task difficulty at a fixed level during training, shape-adapting tools can vary task difficulty and thus keep learners’ training at the optimal challenge point, where the task is neither too easy, nor too difficult. Dishita G. Turakhia, Yini Qi, Lotta-Gili Blumberg, Stefanie Mueller 0001 |
TEI | 5 |
| 2021 | SensiCut: Material-Aware Laser Cutting Using Speckle Sensing and Deep LearningabstractLaser cutter users face difficulties distinguishing between visually similar materials. This can lead to problems, such as using the wrong power/speed settings or accidentally cutting hazardous materials. To support users, we present SensiCut, an integrated material sensing platform for laser cutters. SensiCut enables material awareness beyond what users are able to see and reliably differentiates among similar-looking types. It achieves this by detecting materials’ surface structures using speckle sensing and deep learning. Mustafa Doga Dogan, Steven Vidal Acevedo Colon, Varnika Sinha, Kaan Aksit, Stefanie Mueller 0001 |
UIST | 5 |
| 2021 | MetaSense: Integrating Sensing Capabilities into Mechanical MetamaterialabstractIn this paper, we present a method to integrate sensing capabilities into 3D printable metamaterial structures comprised of cells, which enables the creation of monolithic input devices for HCI. We accomplish this by converting select opposing cell walls within the metamaterial device into electrodes, thereby creating capacitive sensors. When a user interacts with the object and applies a force, the distance and overlapping area between opposing cell walls change, resulting in a measurable capacitance variation. Jun Gong 0002, Olivia Seow, Cédric Honnet, Jack Forman, Stefanie Mueller 0001 |
UIST | 5 |
| 2021 | Lenticular Objects: 3D Printed Objects with Lenticular Lens Surfaces That Can Change their Appearance Depending on the ViewpointabstractIn this paper, we present a method that makes 3D objects appear differently under different viewpoints. We accomplish this by 3D printing lenticular lenses across the curved surface of objects. By calculating the lens distribution and the corresponding surface color patterns, we can determine which appearance is shown to the user at each viewpoint. Jiani Zeng, Honghao Deng, Yunyi Zhu, Michael Wessely, Axel Kilian, Stefanie Mueller 0001 |
UIST | 6 |
| 2021 | EIT-kit: An Electrical Impedance Tomography Toolkit for Health and Motion SensingabstractIn this paper, we propose EIT-kit, an electrical impedance tomography toolkit for designing and fabricating health and motion sensing devices. EIT-kit contains (1) an extension to a 3D editor for personalizing the form factor of electrode arrays and electrode distribution, (2) a customized EIT sensing motherboard for performing the measurements, (3) a microcontroller library that automates signal calibration and facilitates data collection, and (4) an image reconstruction library for mobile devices for interpolating and visualizing the measured data. Together, these EIT-kit components allow for applications that require 2- or 4-terminal setups, up to 64 electrodes, and single or multiple (up to four) electrode arrays simultaneously. Junyi Zhu 0001, Jackson C. Snowden, Joshua Verdejo, Emily Chen, Hamid Ghaednia, Joseph H. Schwab, Stefanie Mueller 0001 |
UIST | 8 |
| 2020 | G-ID: Identifying 3D Prints Using Slicing ParametersabstractWe present G-ID, a method that utilizes the subtle patterns left by the 3D printing process to distinguish and identify objects that otherwise look similar to the human eye. The key idea is to mark different instances of a 3D model by varying slicing parameters that do not change the model geometry but can be detected as machine-readable differences in the print. As a result, G-ID does not add anything to the object but exploits the patterns appearing as a by-product of slicing, an essential step of the 3D printing pipeline. Mustafa Doga Dogan, Faraz Faruqi, Andrew Day Churchill, Kenneth Friedman, Leon Cheng, Sriram Subramanian, Stefanie Mueller 0001 |
CHI | 7 |
| 2020 | ProtoSpray: Combining 3D Printing and Spraying to Create Interactive Displays with Arbitrary ShapesabstractProtoSpray is a fabrication method that combines 3D printing and spray coating, to create interactive displays of arbitrary shapes. Our approach makes novel use of 3D printed conductive channels to create base electrodes on 3D shapes. This is then combined with spraying active materials to produce illumination. We demonstrate the feasibility and benefits of this combined approach in 6 evaluations exploring different shaped topologies. We analyze factors such as spray orientations, surface topologies and printer resolutions, to discuss how spray nozzles can be integrated into traditional 3D printers. We present a series of ProtoSprayed objects demonstrating how our technique goes beyond existing fabrication techniques by allowing creation of displays on objects with curvatures as complex as a Mobius strip. Our work provides a platform to empower makers to use displays as a fabrication material. Ollie Hanton, Michael Wessely, Stefanie Mueller 0001, Mike Fraser 0001, Anne Roudaut |
CHI | 3 |
| 2020 | FoodFab: Creating Food Perception Illusions using Food 3D PrintingabstractPersonalization of eating such that everyone consumes only what they need allows improving our management of food waste. In this paper, we explore the use of food 3D printing to create perceptual illusions for controlling the level of perceived satiety given a defined amount of calories. We present FoodFab, a system that allows users to control their food intake through modifying a food's internal structure via two 3D printing parameters: infill pattern and infill density. In two experiments with a total of 30 participants, we studied the effect of these parameters on users' chewing time that is known to affect people's feeling of satiety. Our results show that we can indeed modify the chewing time by varying infill pattern and density, and thus control perceived satiety. Based on the results, we propose two computational models and integrate them into a user interface that simplifies the creation of personalized food structures. Ying-Ju Lin, Parinya Punpongsanon, Xin Wen 0025, Daisuke Iwai, Kosuke Sato, Marianna Obrist, Stefanie Mueller 0001 |
CHI | 7 |
| 2020 | Sprayable User Interfaces: Prototyping Large-Scale Interactive Surfaces with Sensors and DisplaysabstractWe present Sprayable User Interfaces: room-sized interactive surfaces that contain sensor and display elements created by airbrushing functional inks. Since airbrushing is inherently mobile, designers can create large-scale user interfaces on complex 3D geometries where existing stationary fabrication methods fail. To enable Sprayable User Interfaces, we developed a novel design and fabrication pipeline that takes a desired user interface layout as input and automatically generates stencils for airbrushing the layout onto a physical surface. After fabricating stencils from cardboard or projecting stencils digitally, designers spray each layer with an airbrush, attach a microcontroller to the user interface, and the interface is ready to be used. Our technical evaluation shows that Sprayable User Interfaces work on various geometries and surface materials, such as porous stone and rough wood. We demonstrate our system with several application examples including interactive smart home applications on a wall and a soft leather sofa, an interactive smart city application, and interactive architecture in public office spaces. Michael Wessely, Ticha Sethapakdi, Jackson C. Snowden, Ollie Hanton, Isabel P. S. Qamar, Mike Fraser 0001, Anne Roudaut, Stefanie Mueller 0001 |
CHI | 9 |
| 2020 | CurveBoards: Integrating Breadboards into Physical Objects to Prototype Function in the Context of FormabstractCurveBoards are breadboards integrated into physical objects. In contrast to traditional breadboards, CurveBoards better preserve the object's look and feel while maintaining high circuit fluidity, which enables designers to exchange and reposition components during design iteration. Since CurveBoards are fully functional, i.e., the screens are displaying content and the buttons take user input, designers can test interactive scenarios and log interaction data on the physical prototype while still being able to make changes to the component layout and circuit design as needed. We present an interactive editor that enables users to convert 3D models into CurveBoards and discuss our fabrication technique for making CurveBoard prototypes. We also provide a technical evaluation of CurveBoard's conductivity and durability and summarize informal user feedback. Junyi Zhu 0001, Lotta-Gili Blumberg, Yunyi Zhu, Martin Nisser, Ethan Levi Carlson, Xin Wen 0025, Kevin Shum, Jessica Ayeley Quaye, Stefanie Mueller 0001 |
CHI | 9 |
| 2020 | NURBSforms: A Modular Shape-Changing Interface for Prototyping Curved SurfacesabstractWe present NURBSforms: a modular shape-changing interface for prototyping curved surfaces. Each NURBSform module represents an edge of variable curvature that, when joined together with other modules, enables designers to construct surfaces and adjust their curvature interactively. NURBSform modules vary their curvature using active and passive shape memory materials: an embedded shape memory alloy (SMA) wire increases the curvature when heated, while an elastic material recovers the flat shape when the SMA wire cools down. A hall effect sensor on each module allows users to vary the curvature by adjusting the distance of their hand. In addition, NURBSforms provides functions across multiple modules, such as 'save', 'reset', and 'load', to facilitate design exploration. Since each module is self-contained and individually controllable, NURBSform modules scale well and can be connected into large networks of curves representing various geometries. By giving examples of different NURBSforms assemblies, we demonstrate how the modularity of NURBSforms, together with its integrated computational support, enables designers to quickly explore different versions of a shape in a single integrated design process. Yasaman Tahouni, Isabel P. S. Qamar, Stefanie Mueller 0001 |
TEI | 3 |
| 2020 | MorphSensor: A 3D Electronic Design Tool for Reforming Sensor ModulesabstractMorphSensor is a 3D electronic design tool that enables designers to morph existing sensor modules of pre-defined two-dimensional shape into free-form electronic component arrangements that better integrate with the three-dimensional shape of a physical prototype. MorphSensor builds onto existing sensor module schematics that already define the electronic components and the wiring required to build the sensor. Since MorphSensor maintains the wire connections throughout the editing process, the sensor remains fully functional even when designers change the electronic component layout on the prototype geometry. We detail the MorphSensor editor that supports designers in re-arranging the electronic components, and discuss a fabrication pipeline based on customized PCB footprints for making the resulting freeform sensor. We then demonstrate the capabilities of our system by morphing a range of sensor modules of different complexity and provide a technical evaluation of the quality of the resulting free-form sensors. Junyi Zhu 0001, Yunyi Zhu, Jiaming Cui, Leon Cheng, Jackson C. Snowden, Mark Chounlakone, Michael Wessely, Stefanie Mueller 0001 |
UIST | 8 |
| 2019 | FoldTronics: Creating 3D Objects with Integrated Electronics Using Foldable Honeycomb StructuresabstractWe present FoldTronics, a 2D-cutting based fabrication technique to integrate electronics into 3D folded objects. The key idea is to cut and perforate a 2D sheet to make it foldable into a honeycomb structure using a cutting plotter; before folding the sheet into a 3D structure, users place the electronic components and circuitry onto the sheet. The fabrication process only takes a few minutes allowing to rapidly prototype functional interactive devices. The resulting objects are lightweight and rigid, thus allowing for weight-sensitive and force-sensitive applications. Finally, due to the nature of the honeycomb structure, the objects can be folded flat along one axis and thus can be efficiently transported in this compact form factor. We describe the structure of the foldable sheet, and present a design tool that enables users to quickly prototype the desired objects. We showcase a range of examples made with our design tool, including objects with integrated sensors and display elements. Junichi Yamaoka, Mustafa Doga Dogan, Katarina Bulovic, Kazuya Saito, Yoshihiro Kawahara, Yasuaki Kakehi, Stefanie Mueller 0001 |
CHI | 7 |
| 2019 | FormFab: Continuous Interactive FabricationabstractSeveral systems have illustrated the concept of interactive fabrication, i.e. rather than working through a digital editor, users make edits directly on the physical workpiece. However, so far the interaction has been limited to turn-taking, i.e., users first perform a command and then the system responds with physical feedback. In this paper, we present a first step towards interactive fabrication that changes the workpiece continuously while the user is manipulating it. Stefanie Mueller 0001, Anna Seufert, Huaishu Peng, Robert Kovacs, Kevin Reuss, François Guimbretière, Patrick Baudisch |
TEI | 1 |
| 2019 | Sequential Support: 3D Printing Dissolvable Support Material for Time-Dependent MechanismsabstractIn this paper, we propose a different perspective on the use of support material: rather than printing support structures for overhangs, our idea is to make use of its transient nature, i.e. the fact that it can be dissolved when placed in a solvent, such as water. This enables a range of new use cases, such as quickly dissolving and replacing parts of a prototype during design iteration, printing temporary assembly labels directly on the object that leave no marks when dissolved, and creating time-dependent mechanisms, such as fading in parts of an image in a shadow art piece or releasing relaxing scents from a 3D printed structure sequentially overnight. Since we use regular support material (PVA), our approach works on consumer 3D printers without any modifications. To facilitate the design of objects that leverage dissolvable support, we built a custom 3D editor plugin that includes a simulation showing how support material dissolves over time. In our evaluation, our simulation predicted geometries that are statistically similar to the example shapes within 10% error across all samples. Martin Nisser, Junyi Zhu 0001, Tianye Chen, Katarina Bulovic, Parinya Punpongsanon, Stefanie Mueller 0001 |
TEI | 6 |
| 2019 | Integrating Electronic Components into Deformable Objects Based on User Interaction DataabstractWith an increased interest in Organic User Interface, it becomes more and more important to help designers create deformable devices. One current challenge is the integration of rigid and soft electronic components with the device. In this paper, we propose to place electronic components based on how the user is interacting with the device, i.e., in which way the device is being deformed. For this, we developed a prototyping tool that takes as input a set of captured user gestures and a 3D model of the deformable device, and then visualizes the stress distribution resulting from the deformation during interaction. Our tool finally suggests where not to place components because the location is highly deformed when users interact (e.g., where not to place a rigid battery that would constraint interaction); or alternatively where to place components to sense deformation more accurately and efficiently (e.g., a bend sensor to detect a specific gesture, an energy harvesting component). We evaluated our approach by collecting interaction data from 12 users across 3 deformable devices (a watch, camera, and mouse) and applied the resulting stress distributions to the placement of selected electronic components. Paul Worgan, Kevin Reuss, Stefanie Mueller 0001 |
TEI | 3 |
| 2019 | Photo-Chromeleon: Re-Programmable Multi-Color Textures Using Photochromic DyesabstractIn this paper, we present a method to create re-programmable multi-color textures that are made from a single material only. The key idea builds on the use of photochromic inks that can switch their appearance from transparent to colored when exposed to light of a certain wavelength. By mixing cyan, magenta, and yellow (CMY) photochromic dyes into a single solution and leveraging the different absorption spectra of each dye, we can control each color channel in the solution separately. Our approach can transform single-material fabrication techniques, such as coating, into high-resolution multi-color processes. We discuss the material mixing procedure, modifications to the light source, and the algorithm to control each color channel. We then show the results from an experiment in which we evaluated the available color space and the resolution of our textures. Finally, we demonstrate our user interface that allows users to transfer virtual textures onto physical objects and show a range of application examples. Yuhua Jin, Isabel P. S. Qamar, Michael Wessely, Aradhana Adhikari, Katarina Bulovic, Parinya Punpongsanon, Stefanie Mueller 0001 |
UIST | 7 |
| 2018 | RoMA: Interactive Fabrication with Augmented Reality and a Robotic 3D PrinterabstractWe present the Robotic Modeling Assistant (RoMA), an interactive fabrication system providing a fast, precise, hands-on and in-situ modeling experience. As a designer creates a new model using RoMA AR CAD editor, features are constructed concurrently by a 3D printing robotic arm sharing the same design volume. The partially printed physical model then serves as a tangible reference for the designer as she adds new elements to her design. RoMA's proxemics-inspired handshake mechanism between the designer and the 3D printing robotic arm allows the designer to quickly interrupt printing to access a printed area or to indicate that the robot can take full control of the model to finish printing. RoMA lets users integrate real-world constraints into a design rapidly, allowing them to create well-proportioned tangible artifacts or to extend existing objects. We conclude by presenting the strengths and limitations of our current design. Huaishu Peng, Jimmy Briggs, Cheng-Yao Wang, Kevin Guo, Joseph T. Kider Jr., Stefanie Mueller 0001, Patrick Baudisch, François Guimbretière |
CHI | 6 |
| 2018 | ColorMod: Recoloring 3D Printed Objects using Photochromic InksabstractRecent research has shown how to change the color of existing objects using photochromic materials. These materials can switch their appearance from transparent to colored when exposed to light of a certain wavelength. The color remains even when the object is removed from the light source. The process is fully reversible allowing users to recolor the object as many times as they want. So far, these systems have been limited to single color changes, i.e. changes from transparent to colored. In this paper, we present ColorMod, a method to extend this approach to multi-color changes (e.g., red-to-yellow). We accomplish this using a multi-color pattern with one color per voxel across the surface of the object. When recoloring the object, our system locally activates only those voxels that have the desired color and turns all other voxels off. We describe ColorMod's hardware/software system and its user interface that comes with a conversion tool for 3D printing as well as a painting tool that matches physical voxels with the desired appearance. We also contribute our own material formula for a 3D-printable photochromic ink. Parinya Punpongsanon, Xin Wen 0025, David S. Kim, Stefanie Mueller 0001 |
CHI | 4 |
| 2018 | MoSculp: Interactive Visualization of Shape and TimeabstractWe present a system that visualizes complex human motion via 3D motion sculptures-a representation that conveys the 3D structure swept by a human body as it moves through space. Our system computes a motion sculpture from an input video, and then embeds it back into the scene in a 3D-aware fashion. The user may also explore the sculpture directly in 3D or physically print it. Our interactive interface allows users to customize the sculpture design, for example, by selecting materials and lighting conditions. To provide this end-to-end workflow, we introduce an algorithm that estimates a human's 3D geometry over time from a set of 2D images, and develop a 3D-aware image-based rendering approach that inserts the sculpture back into the original video. By automating the process, our system takes motion sculpture creation out of the realm of professional artists, and makes it applicable to a wide range of existing video material. By conveying 3D information to users, motion sculptures reveal space-time motion information that is difficult to perceive with the naked eye, and allow viewers to interpret how different parts of the object interact over time. We validate the effectiveness of motion sculptures with user studies, finding that our visualizations are more informative about motion than existing stroboscopic and space-time visualization methods. Xiuming Zhang, Tali Dekel, Tianfan Xue, Andrew Owens, Qiurui He 0001, Jiajun Wu 0001, Stefanie Mueller 0001, William T. Freeman |
UIST | 7 |
| 2018 | Foreword to the Special Section on Computational Fabrication
Stelian Coros, Stefanie Mueller 0001 |
Comput. Graph. | 2 |
| 2016 | Destructive Games: Creating Value by Destroying Valuable Physical ObjectsabstractWhile personal fabrication tools, such as laser cutters and milling machines, are intended for construction, we are exploring their use for destruction. We present a series of games that result in valuable physical objects being destroyed objects owned by the players. Interestingly, we found that we can design these games to be desirable to play, despite the loss of the object, by instead producing social value. As part of a user study, twelve students played a destructive game in which a laser cutter cut up their own money bills. Surprisingly, 8 out of 12 participants would play again. They shared their post-game stories with us. David Eickhoff, Stefanie Mueller 0001, Patrick Baudisch |
CHI | 2 |
| 2016 | Linespace: A Sensemaking Platform for the BlindabstractFor visually impaired users, making sense of spatial information is difficult as they have to scan and memorize content before being able to analyze it. Even worse, any update to the displayed content invalidates their spatial memory, which can force them to manually rescan the entire display. Making display contents persist, we argue, is thus the highest priority in designing a sensemaking system for the visually impaired. We present a tactile display system designed with this goal in mind. The foundation of our system is a large tactile display (140x100cm, 23x larger than Hyperbraille), which we achieve by using a 3D printer to print raised lines of filament. The system's software then trades in this space in order to minimize screen updates. Instead of panning and zooming, for example, our system creates additional views, leaving display contents intact and thus supporting users in preserving their spatial memory. We illustrate our system and its design principles at the example of four spatial applications. We evaluated our system with six blind users. Participants responded favorably to the system and expressed, for example, that having multiple views at the same time was helpful. They also judged the increased expressiveness of lines over the more traditional dots as useful for encoding information. Sai Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller 0001, Patrick Baudisch |
CHI | 5 |
| 2015 | Platener: Low-Fidelity Fabrication of 3D Objects by Substituting 3D Print with Laser-Cut PlatesabstractThis paper presents Platener, a system that allows quickly fabricating intermediate design iterations of 3D models, a process also known as low-fidelity fabrication. Platener achieves its speed-up by extracting straight and curved plates from the 3D model and substituting them with laser cut parts of the same size and thickness. Only the regions that are of relevance to the current design iteration are executed as full-detail 3D prints. Platener connects the parts it has created by automatically inserting joints. To help fast assembly it engraves instructions. Platener allows users to customize substitution results by (1) specifying fidelity-speed tradeoffs, (2) choosing whether or not to convert curved surfaces to plates bent using heat, and (3) specifying the conversion of individual plates and joints interactively. Platener is designed to best preserve the fidelity of func-tional objects, such as casings and mechanical tools, all of which contain a large percentage of straight/rectilinear elements. Compared to other low-fab systems, such as faBrickator and WirePrint, Platener better preserves the stability and functionality of such objects: the resulting assemblies have fewer parts and the parts have the same size and thickness as in the 3D model. To validate our system, we converted 2.250 3D models downloaded from a 3D model site (Thingiverse). Platener achieves a speed-up of 10 or more for 39.5% of all objects. Dustin Beyer, Serafima Gurevich, Stefanie Mueller 0001, Hsiang-Ting Chen, Patrick Baudisch |
CHI | 3 |
| 2015 | Scotty: Relocating Physical Objects Across Distances Using Destructive Scanning, Encryption, and 3D PrintingabstractWe present a simple self-contained appliance that allows relocating inanimate physical objects across distance. Each unit consists of an off-the-shelf 3D printer that we have extended with a 3-axis milling machine, a camera, and a micro-controller for encryption/decryption and transmission. Users place an object into the sender unit, enter the address of a receiver unit, and press the relocate button. The sender unit now digitizes the original object layer-by-layer: it shaves off material using the built-in milling machine, takes a photo using the built-in camera, encrypts the layer using the public key of the receiver, and transmits it. The receiving unit decrypts the layer in real-time and starts printing right away. Users thus see the object appear layer-by-layer on the receiver side as it disappears layer-by-layer at the sender side. Scotty is different from previous systems that copy physical objects, as its destruction and encryption mechanism guarantees that only one copy of the object exists at a time. Even though our current prototype is limited to single-material plastic objects, it allows us to address two application scenarios: (1) Scotty can help preserve the uniqueness and thus the emotional value of physical objects shared between friends. (2) Scotty can address some of the licensing issues involved in fast electronic delivery of physical goods. We explore the former in an exploratory user study with three pairs of participants. Stefanie Mueller 0001, Martin Fritzsche, Jan Kossmann, Maximilian Schneider, Jonathan Striebel, Patrick Baudisch |
TEI | 1 |
| 2015 | Protopiper: Physically Sketching Room-Sized Objects at Actual ScaleabstractPhysical sketching of 3D wireframe models, using a hand-held plastic extruder, allows users to explore the design space of 3D models efficiently. Unfortunately, the scale of these devices limits users' design explorations to small-scale objects. We present protopiper, a computer aided, hand-held fabrication device, that allows users to sketch room-sized objects at actual scale. The key idea behind protopiper is that it forms adhesive tape into tubes as its main building material, rather than extruded plastic or photopolymer lines. Since the resulting tubes are hollow they offer excellent strength-to-weight ratio, thus scale well to large structures. Since the tape is pre-coated with adhesive it allows connecting tubes quickly, unlike extruded plastic that would require heating and cooling in the kilowatt range. We demonstrate protopiper's use through several demo objects, ranging from more constructive objects, such as furniture, to more decorative objects, such as statues. In our exploratory user study, 16 participants created objects based on their own ideas. They rated the device as being "useful for creative exploration", "its ability to sketch at actual scale helped judge fit", and "fun to use." Harshit Agrawal, Udayan Umapathi, Robert Kovacs, Johannes Frohnhofen, Hsiang-Ting Chen, Stefanie Mueller 0001, Patrick Baudisch |
UIST | 6 |
| 2015 | Patching Physical ObjectsabstractPersonal fabrication is currently a one-way process: Once an object has been fabricated with a 3D printer, it cannot be changed anymore; any change requires printing a new version from scratch. The problem is that this approach ignores the nature of design iteration, i.e. that in subsequent iterations large parts of an object stay the same and only small parts change. This makes fabricating from scratch feel unnecessary and wasteful. Alexander Teibrich, Stefanie Mueller 0001, François Guimbretière, Robert Kovacs, Stefan Neubert, Patrick Baudisch |
UIST | 2 |
| 2015 | LaserStacker: Fabricating 3D Objects by Laser Cutting and WeldingabstractLaser cutters are useful for rapid prototyping because they are fast. However, they only produce planar 2D geometry. One approach to creating non-planar objects is to cut the object in horizontal slices and to stack and glue them. This approach, however, requires manual effort for the assembly and time for the glue to set, defeating the purpose of using a fast fabrication tool. We propose eliminating the assembly step with our system LaserStacker. The key idea is to use the laser cutter to not only cut but also to weld. Users place not one acrylic sheet, but a stack of acrylic sheets into their cutter. In a single process, LaserStacker cuts each individual layer to shape (through all layers above it), welds layers by melting material at their interface, and heals undesired cuts in higher layers. When users take out the object from the laser cutter, it is already assembled. To allow users to model stacked objects efficiently, we built an extension to a commercial 3D editor (SketchUp) that provides tools for defining which parts should be connected and which remain loose. When users hit the export button, LaserStacker converts the 3D model into cutting, welding, and healing instructions for the laser cutter. We show how LaserStacker does not only allow making static objects, such as architectural models, but also objects with moving parts and simple mechanisms, such as scissors, a simple pinball machine, and a mechanical toy with gears. Udayan Umapathi, Hsiang-Ting Chen, Stefanie Mueller 0001, Ludwig Wall, Anna Seufert, Patrick Baudisch |
UIST | 3 |
| 2014 | faBrickation: fast 3D printing of functional objects by integrating construction kit building blocksabstractWe present a new approach to rapid prototyping of functional objects, such as the body of a head-mounted display. The key idea is to save 3D printing time by automatically substituting sub-volumes with standard building blocks'in our case Lego bricks. When making the body for a head-mounted display, for example, getting the optical path right is paramount. Users thus mark the lens mounts as "high-resolution" to indicate that these should later be 3D printed. faBrickator then 3D prints these parts. It also generates instructions that show users how to create everything else from Lego bricks. If users iterate on the design later, faBrickator offers even greater benefit as it allows re-printing only the elements that changed. We validated our system at the example of three 3D models of functional objects. On average, our system fabricates objects 2.44 times faster than traditional 3D printing while requiring only 14 minutes of manual assembly. Stefanie Mueller 0001, Tobias Mohr, Kerstin Guenther, Johannes Frohnhofen, Patrick Baudisch |
CHI | 1 |
| 2014 | WirePrint: 3D printed previews for fast prototypingabstractEven though considered a rapid prototyping tool, 3D printing is so slow that a reasonably sized object requires printing overnight. This slows designers down to a single iteration per day. In this paper, we propose to instead print low-fidelity wireframe previews in the early stages of the design process. Wireframe previews are 3D prints in which surfaces have been replaced with a wireframe mesh. Since wireframe previews are to scale and represent the overall shape of the 3D object, they allow users to quickly verify key aspects of their 3D design, such as the ergonomic fit. To maximize the speed-up, we instruct 3D printers to extrude filament not layer-by-layer, but directly in 3D-space, allowing them to create the edges of the wireframe model directly one stroke at a time. This allows us to achieve speed-ups of up to a factor of 10 compared to traditional layer-based printing. We demonstrate how to achieve wireframe previews on standard FDM 3D printers, such as the PrintrBot or the Kossel mini. Users only need to install the WirePrint software, making our approach applicable to many 3D printers already in use today. Finally, wireframe previews use only a fraction of material required for a regular print, making it even more affordable to iterate. Stefanie Mueller 0001, Sangha Im, Serafima Gurevich, Alexander Teibrich, Lisa Pfisterer, François Guimbretière, Patrick Baudisch |
UIST | 1 |
| 2013 | LaserOrigami: laser-cutting 3D objectsabstractWe present LaserOrigami, a rapid prototyping system that produces 3D objects using a laser cutter. LaserOrigami is substantially faster than traditional 3D fabrication techniques such as 3D printing and unlike traditional laser cutting the resulting 3D objects require no manual assembly. The key idea behind LaserOrigami is that it achieves three-dimensionality by folding and stretching the workpiece, rather than by placing joints, thereby eliminating the need for manual assembly. LaserOrigami achieves this by heating up selected regions of the workpiece until they become compliant and bend down under the force of gravity. LaserOrigami administers the heat by defocusing the laser, which distributes the laser's power across a larger surface. LaserOrigami implements cutting and bending in a single integrated process by automatically moving the cutting table up and down--when users take out the workpiece, it is already fully assembled. We present the three main design elements of LaserOrigami: the bend, the suspender, and the stretch, and demonstrate how to use them to fabricate a range of physical objects. Finally, we demonstrate an interactive fabrication version of LaserOrigami, a process in which user interaction and fabrication alternate step-by-step. Stefanie Mueller 0001, Bastian Kruck, Patrick Baudisch |
CHI | 1 |
| 2012 | CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screensabstractRecent research proposes augmenting capacitive touch pads with tangible objects, enabling a new generation of mobile applications enhanced with tangible objects, such as game pieces and tangible controllers. In this paper, we extend the concept to capacitive tangibles consisting of multiple parts, such as stackable gaming pieces and tangible widgets with moving parts. We achieve this using a system of wires and connectors inside each block that causes the capacitance of the bottom-most block to reflect the entire assembly. We demonstrate three types of tangibles, called CapStones, Zebra Dials and Zebra Sliders that work with current consumer hardware and investigate what designs may become possible as touchscreen hardware evolves. Li-Wei Chan 0001, Stefanie Mueller 0001, Anne Roudaut, Patrick Baudisch |
CHI | 2 |
| 2012 | Interactive construction: interactive fabrication of functional mechanical devicesabstractPersonal fabrication tools, such as laser cutters and 3D printers allow users to create precise objects quickly. However, working through a CAD system removes users from the workpiece. Recent interactive fabrication tools reintroduce this directness, but at the expense of precision. Stefanie Mueller 0001, Pedro Lopes 0001, Patrick Baudisch |
UIST | 1 |
| 2011 | An End-to-End Framework for Multi-view Video Content: Creating Multiple-Perspective Hypervideo to View on Mobile Platforms
Gregor Miller, Sidney S. Fels, Michael Ilich, Matthias Finke, Kelvie Wong, Stefanie Mueller 0001 |
ICEC | 7 |