Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.

Patrick Chiu

dblp:47/3816 · DBLP profile ↗
← Back
41ranked-venue papers
12as first author
2since 2021 · last 2022
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 19 · 4 first-authorGraphics, computer vision, multimedia, augmented reality and games · 15 · 5 first-author · 2 since 2021Databases, data management, data science and information retrieval · 6 · 2 first-authorArtificial intelligence and machine learning · 2 · 1 first-authorApplied, interdisciplinary, general and emerging computing · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
9 papers
Visualization and visual analytics · 93% Multimedia analysis and retrieval · 3% Visual content generation and editing · 2%
Human-computer interaction and pervasive computing
17 papers
Interaction techniques and input · 41% Health and well-being technologies · 24% Collaborative and social computing · 24%
Databases, data mining, and information retrieval
3 papers
Data mining · 66% Information retrieval · 34%

Topics — the 30 heaviest of 44, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Visualization and visual analytics › graph visualization
bipartite graph visualization
0.612022
Understanding Missing Links in Bipartite Networks With MissBiN · IEEE Trans. Vis. Comput. Graph. 2022
Visualization and visual analytics › visual analytics
visual analytics for machine learning
0.612022
Understanding Missing Links in Bipartite Networks With MissBiN · IEEE Trans. Vis. Comput. Graph. 2022
Health and well-being technologies
physical activity support
0.412020
Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity · UIST 2020
Visualization and visual analytics
high-dimensional data visualization
0.312018
BiDots: Visual Exploration of Weighted Biclusters · IEEE Trans. Vis. Comput. Graph. 2018
Visualization and visual analytics
interactive data exploration
0.312018
BiDots: Visual Exploration of Weighted Biclusters · IEEE Trans. Vis. Comput. Graph. 2018
Collaborative and social computing
remote collaboration
0.322015
Evolution of a Tabletop Telepresence System through Art and Technology · ACM Multimedia 2015
FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface · ACM Multimedia 2010
Data mining › pattern mining › matrix pattern mining
biclique mining
0.212022
Understanding Missing Links in Bipartite Networks With MissBiN · IEEE Trans. Vis. Comput. Graph. 2022
Data mining
pattern mining
0.212022
Understanding Missing Links in Bipartite Networks With MissBiN · IEEE Trans. Vis. Comput. Graph. 2022
Interaction techniques and input
gesture input
0.222011
Multi-touch document folding: gesture models, fold directions and symmetries · CHI 2011
Shared interactive video for teleconferencing · ACM Multimedia 2003
Interaction techniques and input › post-WIMP interaction › embodied interaction
movement-based interaction
0.112020
Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity · UIST 2020
Interaction techniques and input › touch interaction
multi-touch interaction
0.112011
Multi-touch document folding: gesture models, fold directions and symmetries · CHI 2011
Personal fabrication and tangible interfaces
paper-based interaction
0.112010
FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface · ACM Multimedia 2010
Interaction techniques and input › input modality › multimodal input
pen and gesture input
0.112010
FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface · ACM Multimedia 2010
Bioinformatics and computational biology
gene expression analysis
0.112018
BiDots: Visual Exploration of Weighted Biclusters · IEEE Trans. Vis. Comput. Graph. 2018
Information retrieval › image retrieval
document image retrieval
0.112008
Document finder · ACM Multimedia 2008
Information retrieval
document retrieval
0.112008
Document finder · ACM Multimedia 2008
Visualization and visual analytics › text visualization
document visualization
0.112008
Content based automatic zooming: viewing documents on small displays · ACM Multimedia 2008
Collaborative and social computing › groupware
meeting support
0.142001
NoteLook: taking notes in meetings with digital video and ink · ACM Multimedia (1) 1999
Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1998
Tailorable Domain Objects as Meeting Tools for an Electronic Whiteboard · CSCW 1998
Personal fabrication and tangible interfaces › paper-based interaction
digital desk
0.112015
Evolution of a Tabletop Telepresence System through Art and Technology · ACM Multimedia 2015
Interaction techniques and input › surface computing
electronic whiteboard
0.131998
Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1998
Tailorable Domain Objects as Meeting Tools for an Electronic Whiteboard · CSCW 1998
Pen-Based Interaction Techniques for Organizing Material on an Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1997
Interaction techniques and input
pen input
0.131998
Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1998
Pen-Based Interaction Techniques for Organizing Material on an Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1997
Implicit Structures for Pen-Based Systems within a Freeform Interaction Paradigm · CHI 1995
Collaborative and social computing › computer-mediated communication
teleconferencing
0.012003
Shared interactive video for teleconferencing · ACM Multimedia 2003
Collaborative and social computing
computer-supported cooperative work
0.021998
Tailorable Domain Objects as Meeting Tools for an Electronic Whiteboard · CSCW 1998
Evolutionary Engagement in an Ongoing Collaborative Work Process: A Case Study · CSCW 1996
Wireless sensing and localization
indoor localization
0.012001
A Probabilistic Room Location Service for Wireless Networked Environments · UbiComp 2001
Image and video processing › motion analysis
camera motion analysis
0.012000
A semi-automatic approach to home video editing · UIST 2000
Multimedia analysis and retrieval
video analysis
0.012000
A semi-automatic approach to home video editing · UIST 2000
Visual content generation and editing
video editing
0.012000
A semi-automatic approach to home video editing · UIST 2000
Interaction techniques and input
direct manipulation
0.022000
Pen-Based Interaction Techniques for Organizing Material on an Electronic Whiteboard · ACM Symposium on User Interface Software and Technology 1997
A semi-automatic approach to home video editing · UIST 2000
Multimedia analysis and retrieval
object recognition
0.012008
Document finder · ACM Multimedia 2008
Interaction techniques and input
mobile interaction
0.012008
Content based automatic zooming: viewing documents on small displays · ACM Multimedia 2008

Methods — techniques the papers use, named apart from their topics

quantitative evaluation · 1.1link prediction · 1.1biclique analysis · 1.1visual encoding · 0.7interaction design · 0.7biclustering · 0.7particle filter · 0.4discrete bayes filter · 0.4computer vision · 0.4desktop videoconferencing · 0.2camera-projector interaction · 0.2scale-distortion optimization · 0.2image analysis · 0.2camera capture · 0.23d cityscape metaphor · 0.2user study · 0.1camera-projector interface · 0.1image matching · 0.1
YearPublicationVenuePosition
2022 Understanding Missing Links in Bipartite Networks With MissBiN
abstract
The analysis of bipartite networks is critical in a variety of application domains, such as exploring entity co-occurrences in intelligence analysis and investigating gene expression in bio-informatics. One important task is missing link prediction, which infers the existence of unseen links based on currently observed ones. In this article, we propose a visual analysis system, MissBiN, to involve analysts in the loop for making sense of link prediction results. MissBiN equips a novel method for link prediction in a bipartite network by leveraging the information of bi-cliques in the network. It also provides an interactive visualization for understanding the algorithm outputs. The design of MissBiN is based on three high-level analysis questions (what, why, and how) regarding missing links, which are distilled from the literature and expert interviews. We conducted quantitative experiments to assess the performance of the proposed link prediction algorithm, and interviewed two experts from different domains to demonstrate the effectiveness of MissBiN as a whole. We also provide a comprehensive usage scenario to illustrate the usefulness of the tool in an application of intelligence analysis.
Jian Zhao 0010, Maoyuan Sun, Francine Chen 0001, Patrick Chiu
IEEE Trans. Vis. Comput. Graph.4
2021 Know-What and Know-Who: Document Searching and Exploration using Topic-Based Two-Mode Networks
abstract
This paper proposes a novel approach for analyzing search results of a document collection, which can help support know-what and know-who information seeking questions. Search results are grouped by topics, and each topic is represented by a two-mode network composed of related documents and authors (i.e., biclusters). We visualize these biclusters in a 2D layout to support interactive visual exploration of the analyzed search results, which highlights a novel way of organizing entities of biclusters. We evaluated our approach using a large academic publication corpus, by testing the distribution of the relevant documents and of lead and prolific authors. The results indicate the effectiveness of our approach compared to traditional 1D ranked lists. Moreover, a user study with 12 participants was conducted to compare our proposed visualization, a simplified variation without topics, and a text-based interface. We report on participants' task performance, their preference of the three interfaces, and the different strategies used in information seeking.
Jian Zhao 0010, Maoyuan Sun, Patrick Chiu, Francine Chen 0001, Bee Liew
PacificVis3
2020 Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity
abstract
Videos are a convenient platform to begin, maintain, or improve a fitness program or physical activity. Traditional video systems allow users to manipulate videos through specific user interface actions such as button clicks or mouse drags, but have no model of what the user is doing and are unable to adapt in useful ways. We present adaptive video playback, which seamlessly synchronises video playback with the user's movements, building upon the principle of direct manipulation video navigation. We implement adaptive video playback in Reactive Video, a vision-based system which supports users learning or practising a physical skill. The use of pre-existing videos removes the need to create bespoke content or specially authored videos, and the system can provide real-time guidance and feedback to better support users when learning new movements. Adaptive video playback using a discrete Bayes and particle filter are evaluated on a data set collected of participants performing tai chi and radio exercises. Results show that both approaches can accurately adapt to the user's movements, however reversing playback can be problematic.
Christopher Clarke, Doga Buse Cavdir, Patrick Chiu, Laurent Denoue, Don Kimber
UIST3
2019 Use Your Head! Exploring Interaction Modalities for Hat Technologies
abstract
As our landscape of wearable technologies proliferates, we find more devices situated on our heads. However, many challenges hinder them from widespread adoption - from their awkward, bulky form factor (today's AR and VR goggles) to their socially stigmatized designs (Google Glass) and a lack of a well-developed head-based interaction design language. In this paper, we explore a socially acceptable, large, head-worn interactive wearable - a hat. We report results from a gesture elicitation study with 17 participants, extract a taxonomy of gestures, and define a set of design concerns for interactive hats. Through this lens, we detail the design and fabrication of three hat prototypes capable of sensing touch, head movements, and gestures, and including ambient displays of several types. Finally, we report an evaluation of our hat prototype and insights to inform the design of future hat technologies.
Christine Dierk, Scott A. Carter, Patrick Chiu, Anthony Dunnigan, Don Kimber
Conference on Designing Interactive Systems3
2019 Toward Long Distance Tabletop Hand-Document Telepresence
abstract
In a telepresence scenario with remote users discussing a document, it can be difficult to follow which parts are being discussed. One way to address this is by showing the user's hand position on the document, which also enables expressive gestural communication. An important practical problem is how to capture and transmit the hand movements efficiently with high resolution document images. We propose a tabletop system with two channels that integrates document capture with a 4K video camera and hand tracking with a webcam, in which the document image and hand skeleton data are transmitted at different rates and handled by a lightweight Web browser client at remote sites. To enhance the rendering, we employ velocity based smoothing and ephemeral motion traces. We tested our prototype over long distances from USA to Japan and to Italy, and report on latency and jitter performance. Our system achieves relatively low latency over a long distance in comparison with a tele-immersive system that transmits mesh data over much shorter distances.
Chelhwon Kim, Patrick Chiu, Joseph de la Pena, Laurent Denoue, Jun Shingu, Yulius Tjahjadi
ISS2
2019 A Web-Based Remote Assistance System with Gravity-Aware 3D Hand Gesture Visualization
abstract
We present a remote assistance system that enables a remotely located expert to provide guidance using hand gestures to a customer who performs a physical task in a different location. The system is built on top of a web-based real-time media communication framework which allows the customer to use a commodity smartphone to send a live video feed to the expert, from which the expert can see the view of the customer's workspace and can show his/her hand gestures over the video in real-time. The expert's hand gesture is captured with a hand tracking device and visualized with a rigged 3D hand model on the live video feed. The system can be accessed via a web browser, and it does not require any app software to be installed on the customer's device. Our system supports various types of devices including smartphone, tablet, desktop PC, and smart glass. To improve the collaboration experience, the system provides a novel gravity-aware hand visualization technique.
Chelhwon Kim, Patrick Chiu, Yulius Tjahjadi
ISS2
2018 Recognizing Gestures on Projected Button Widgets with an RGB-D Camera Using a CNN
abstract
Projector-camera systems can turn any surface such as tabletops and walls into an interactive display. A basic problem is to recognize the gesture actions on the projected UI widgets. Previous approaches using finger template matching or occlusion patterns have issues with environmental lighting conditions, artifacts and noise in the video images of a projection, and inaccuracies of depth cameras. In this work, we propose a new recognizer that employs a deep neural net with an RGB-D camera; specifically, we use a CNN (Convolutional Neural Network) with optical flow computed from the color and depth channels. We evaluated our method on a new dataset of RGB-D videos of 12 users interacting with buttons projected on a tabletop surface.
Patrick Chiu, Chelhwon Kim, Hideto Oda
ISS1
2018 BiDots: Visual Exploration of Weighted Biclusters
abstract
Discovering and analyzing biclusters, i.e., two sets of related entities with close relationships, is a critical task in many real-world applications, such as exploring entity co-occurrences in intelligence analysis, and studying gene expression in bio-informatics. While the output of biclustering techniques can offer some initial low-level insights, visual approaches are required on top of that due to the algorithmic output complexity. This paper proposes a visualization technique, called BiDots, that allows analysts to interactively explore biclusters over multiple domains. BiDots overcomes several limitations of existing bicluster visualizations by encoding biclusters in a more compact and cluster-driven manner. A set of handy interactions is incorporated to support flexible analysis of biclustering results. More importantly, BiDots addresses the cases of weighted biclusters, which has been underexploited in the literature. The design of BiDots is grounded by a set of analytical tasks derived from previous work. We demonstrate its usefulness and effectiveness for exploring computed biclusters with an investigative document analysis task, in which suspicious people and activities are identified from a text corpus.
Jian Zhao 0010, Maoyuan Sun, Francine Chen 0001, Patrick Chiu
IEEE Trans. Vis. Comput. Graph.4
2017 Capturing Handwritten Ink Strokes with a Fast Video Camera
abstract
We present a system for capturing ink strokes written with ordinary pen and paper using a fast camera with a frame rate comparable to a stylus digitizer. From the video frames, ink strokes are extracted and used as input to an online handwriting recognition engine. A key component in our system is a pen up/down detection model for detecting the contact of the pen-tip with the paper in the video frames. The proposed model consists of feature representation with convolutional neural networks and classification with a recurrent neural network. We also use a high speed tracker with kernelized correlation filters to track the pen-tip. For training and evaluation, we collected labeled video data of users writing English and Japanese phrases from public datasets, and we report on character accuracy scores for different frame rates in the two languages.
Chelhwon Kim, Patrick Chiu, Hideto Oda
ICDAR2
2016 Topic Modeling of Document Metadata for Visualizing Collaborations over Time
abstract
We describe methods for analyzing and visualizing document metadata to provide insights about collaborations over time. We investigate the use of Latent Dirichlet Allocation (LDA) based topic modeling to compute areas of interest on which people collaborate. The topics are represented in a node-link force directed graph by persistent fixed nodes laid out with multidimensional scaling (MDS), and the people by transient movable nodes. The topics are also analyzed to detect bursts to highlight "hot" topics during a time interval. As the user manipulates a time interval slider, the people nodes and links are dynamically updated. We evaluate the results of LDA topic modeling for the visualization by comparing topic keywords against the submitted keywords from the InfoVis 2004 Contest, and we found that the additional terms provided by LDA-based keyword sets result in improved similarity between a topic keyword set and the documents in a corpus. We extended the InfoVis dataset from 8 to 20 years and collected publication metadata from our lab over a period of 21 years, and created interactive visualizations for exploring these larger datasets.
Francine Chen 0001, Patrick Chiu, Seongtaek Lim
IUI2
2015 High-Quality Capture of Documents on a Cluttered Tabletop with a 4K Video Camera
abstract
We present a novel system for detecting and capturing paper documents on a tabletop using a 4K video camera mounted overhead on pan-tilt servos. Our automated system first finds paper documents on a cluttered tabletop based on a text probability map, and then takes a sequence of high-resolution frames of the located document to reconstruct a high quality and fronto-parallel document page image. The quality of the resulting images enables OCR processing on the whole page. We performed a preliminary evaluation on a small set of 10 document pages and our proposed system achieved 98% accuracy with the open source Tesseract OCR engine.
Chelhwon Kim, Patrick Chiu, Henry Tang
DocEng2
2015 Smart Toy Car Localization and Navigation Using Projected Light
abstract
In this paper, we present the design and implementation of toy car localization and navigation system, which enables toy cars and "passengers" to learn and exchange their fine-grained locations in an indoor environment with the help of the projected light based localization technique. The projected light consists of a sequence of gray code images which assigns each pixel in the projection area a unique gray code to distinguish their coordination. The light sensors installed on a toy cars and a potential "passenger" receive the light streams from the projected light, based on which their locations are inferred. The toy car then utilizes A* algorithm to plan a route based on its location, its orientation, the target's location and the map of "roads". The fast speed of projected light based localization technique enables the toy car to adjust its own orientation while "driving" and keep itself on "roads". The toy car system demonstrates that the localization technique and the client-server architecture can benefit similar applications that require fine-grained location information of multiple objects simultaneously.
Mingming Fan 0001, Qiong Liu 0003, Shang Ma, Patrick Chiu
ISM4
2015 Evolution of a Tabletop Telepresence System through Art and Technology
abstract
New technologies arise in a number of ways. They may come from advances in scientific research, through new combinations of existing technologies, or by simply imagining what might be possible in the future. This video describes the evolution of Tabletop Telepresence, a system for remote collaboration through desktop videoconferencing combined with a digital desk. Tabletop Telepresence began as a collection of camera, projector, videoconferencing and user interaction technologies. Working together; artists and research scientists combined these technologies into a means of sharing paper documents between remote desktops, interacting with those documents, requesting services (such as translation), and communicating through a videoconference.
Anthony Dunnigan, John Doherty, Daniel Avrahami, Jacob T. Biehl, Patrick Chiu, Chelhwon Kim, Qiong Liu 0003, Henry Tang, Lynn Wilcox
ACM Multimedia5
2013 Towards Portable Multi-camera High Definition Video Capture Using Smartphones
abstract
Real-time tele-immersion requires low latency and synchronized multi-camera capture. Prior high definition (HD) capture systems were bulky. We investigate the suitability of using flocks of smartphone cameras for tele-immersion. Smartphones integrate capture and streaming into a single portable package. However, they archive the captured video into a movie. Hence, we create a sequence of H.264 movies and stream them. Capture delay is reduced by minimizing the number of frames in each movie segment. However, fewer frames reduces compression efficiency. Also, smartphone video encoders do not sacrifice video quality to lower the compression latency or the stream size. On an iPhone 4S, our application that uses published APIs streams 1920×1080 videos at 16.5 fps with a delay of 712 ms between a real-life event and displaying an uncompressed bitmap of this event on a local laptop. Note that the bulky Cisco Tandberg required 300 ms delay. Stereoscopic video from two unsynchronized smartphones also showed minimal visual artifacts in an indoor setting.
Surendar Chandra, Patrick Chiu, Maribeth Back
ISM2
2012 Capture and Dewarping of Page Spreads with a Handheld Compact 3D Camera
abstract
This paper describes a system for capturing images of books with a handheld 3D stereo camera, which performs dewarping to produce images that are flattened. A Fuji film consumer grade 3D camera provides a highly mobile and low-cost 3D capture device. Applying standard computer vision algorithms, camera calibration is performed, the captured images are stereo rectified, and the depth information is computed by block matching. Due to technical limitations, the resulting point cloud has defects such as splotches and noise, which make it hard to recover the precise 3D locations of the points on the book pages. We address this problem by computing curve profiles of the depth map and using them to build a cylinder model of the pages. We then employ meshes to facilitate the flattening and rendering of the cylinder model in virtual space. We have implemented a prototype of the system and report on a preliminary evaluation based on measuring the straightness of resulting text lines.
Michael Patrick Cutter, Patrick Chiu
Document Analysis Systems2
2011 Multi-touch document folding: gesture models, fold directions and symmetries
abstract
For document visualization, folding techniques provide a focus-plus-context approach with fairly high legibility on flat sections. To enable richer interaction, we explore the design space of multi-touch document folding. We discuss several design considerations for simple modeless gesturing and compatibility with standard Drag and Pinch gestures. We categorize gesture models along the characteristics of Symmetric/Asymmetric and Serial/Parallel, which yields three gesture models. We built a prototype document workspace application that integrates folding and standard gestures, and a system for testing the gesture models. A user study was conducted to compare the three models and to analyze the factors of fold direction, target symmetry, and target tolerance in user performance when folding a document to a specific shape. Our results indicate that all three factors were significant for task times, and parallelism was greater for symmetric targets.
Patrick Chiu, Chunyuan Liao, Francine Chen 0001
CHI1
2010 Picture detection in document page images
abstract
We present a method for picture detection in document page images, which can come from scanned or camera images, or rendered from electronic file formats. Our method uses OCR to separate out the text and applies the Normalized Cuts algorithm to cluster the non-text pixels into picture regions. A refinement step uses the captions found in the OCR text to deduce how many pictures are in a picture region, thereby correcting for under- and over-segmentation. A performance evaluation scheme is applied which takes into account the detection quality and fragmentation quality. We benchmark our method against the ABBYY application on page images from conference papers.
Patrick Chiu, Francine Chen 0001, Laurent Denoue
ACM Symposium on Document Engineering1
2010 FormCracker: interactive web-based form filling
abstract
Filling out document forms distributed by email or hosted on the Web is still problematic and usually requires a printer and scanner. Users commonly download and print forms, fill them out by hand, scan and email them. Even if the document is form-enabled (PDFs with FDF information), to read the file users still have to launch a separate application which may not be available, especially on mobile devices.
Laurent Denoue, John Adcock, Scott A. Carter, Patrick Chiu, Francine Chen 0001
ACM Symposium on Document Engineering4
2010 FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface
abstract
FACT is an interactive paper system for fine-grained interaction with documents across the boundary between paper and computers. It consists of a small camera-projector unit, a laptop, and ordinary paper documents. With the camera-projector unit pointing to a paper document, the system allows a user to issue pen gestures on the paper document for selecting fine-grained content and applying various digital functions. For example, the user can choose individual words, symbols, figures, and arbitrary regions for keyword search, copy and paste, web search, and remote sharing. FACT thus enables a computer-like user experience on paper. This paper interaction can be integrated with laptop interaction for cross-media manipulations on multiple documents and views. We present the infrastructure, supporting techniques and interaction design, and demonstrate the feasibility via a quantitative experiment. We also propose applications such as document manipulation, map navigation and remote collaboration.
Chunyuan Liao, Qiong Liu 0003, Patrick Chiu, Francine Chen 0001
ACM Multimedia4
2008 Content based automatic zooming: viewing documents on small displays
abstract
We present an automatic zooming technique that leverages content analysis for viewing a document page on a small display such as a mobile phone or PDA. The page can come from a scanned document (bitmap image) or an electronic document (text and graphics data plus metadata). The page with text and graphics is segmented into regions. For each region, a scale-distortion function is constructed based on image analysis of the signal distortion that occurs at different scales. During interactive viewing of the document, as the user navigates by moving the viewport around the page, the zoom factor is automatically adjusted by optimizing the scale-distortion functions of the regions visible in the viewport.
Patrick Chiu, Koichi Fujii, Qiong Liu 0003
ACM Multimedia1
2008 mTable: browsing photos and videos on a tabletop system
abstract
In this video demo, we present mTable, a multimedia tabletop system for browsing photo and video collections. We have developed a set of applications for visualizing and exploring photos, a board game for labeling photos, and a 3D cityscape metaphor for browsing videos. The system is suitable for use in a living room or office lounge, and can support multiple displays by visualizing the collections on the tabletop and showing full-size images and videos on another flat panel display in the room.
Patrick Chiu, Jeffrey Huang, Maribeth Back, Nicholas Diakopoulos, John Doherty, Wolfgang Polak
ACM Multimedia1
2008 Document finder
abstract
This demo introduces a tool for accessing an e-document by capturing one or more images of a real object or document hardcopy. This tool is useful when a file name or location of the file is unknown or unclear. It can save field workers and office workers from remembering/exploring numerous directories and file names. Frequently, it can convert tedious keyboard typing in a search box to a simple camera click. Additionally, when a remote collaborator cannot clearly see an object or a document hardcopy through remote collaboration cameras, this tool can be used to automatically retrieve and send the original e-document to a remote screen or printer.
Qiong Liu 0003, Patrick Chiu, Lynn Wilcox
ACM Multimedia2
2006 Implicit brushing and target snapping: data exploration and sense-making on large displays
abstract
During grouping tasks for data exploration and sense-making, the criteria are normally not well-defined. When users are bringing together data objects thought to be similar in some way, implicit brushing continually detects for groups on the freeform workspace, analyzes the groups' text content or metadata, and draws attention to related data by displaying visual hints and animation. This provides helpful tips for further grouping, group meaning refinement and structure discovery. The sense-making process is further enhanced by retrieving relevant information from a database or network during the brushing. Closely related to implicit brushing, target snapping provides a useful means to move a data object to one of its related groups on a large display. Natural dynamics and smooth animations also help to prevent distractions and allow users to concentrate on the grouping and thinking tasks. Two different prototype applications, note grouping for brainstorming and photo browsing, demonstrate the general applicability of the technique.
Patrick Chiu, Jeffrey Huang, Maribeth Back, Wolfgang Polak
AVI2
2006 On Redirecting Documents with a Mobile Camera
abstract
This paper presents a method for facilitating document redirection in a physical environment via a mobile camera. With this method, a user is able to move documents among electronic devices, post a paper document to a selected public display, or make a printout of a white board with simple point-and-capture operations. More specifically, the user can move a document from its source to a destination by capturing a source image and a destination image in a consecutive order. The system uses SIFT (scale invariant feature transform) features of captured images to identify the devices a user is pointing to, and issues corresponding commands associated with the identified devices. Unlike RF/IR based remote controls, this method uses the visual features of an object as an always available identifier for many tasks, and therefore is easy to deploy. We present experiments on identifying three public displays and a document scanner in a conference room for evaluation
Qiong Liu 0003, Paul McEvoy, Don Kimber, Patrick Chiu, Hanning Zhou
MMSP4
2005 3D Syllabus: Interactive Visualization of Indexes to Multimedia Training Content
Kyuman Song, Surapong Lertsithichai, Patrick Chiu
INTERACT3
2005 MediaMetro: browsing multimedia document collections with a 3D city metaphor
abstract
The MediaMetro application provides an interactive 3D visualization of multimedia document collections using a city metaphor. The directories are mapped to city layouts using algorithms similar to treemaps. Each multimedia document is represented by a building and visual summaries of the different constituent media types are rendered onto the sides of the building. From videos, Manga storyboards with keyframe images are created and shown on the fatade; from slides and text, thumbnail images are produced and subsampled for display on the building sides. The images resemble windows on a building and can be selected for media playback. To support more facile navigation between high overviews and low detail views, a novel swooping technique was developed that combines altitude and tilt changes with zeroing in on a target.
Patrick Chiu, Andreas Girgensohn, Surapong Lertsithichai, Wolfgang Polak, Frank M. Shipman III
ACM Multimedia1
2004 Stained-glass visualization for highly condensed video summaries
abstract
This work presents a method for creating highly condensed video summaries called stained-glass visualizations. These are especially suitable for small displays on mobile devices. A morphological grouping technique is described for finding 3D regions of high activity or motion from a video embedded in x-y-t space. These regions determine areas in the keyframes, which can be subsumed in a more general geometric framework of germs and supports: germs are the areas of interest, and supports give the context. Algorithms for packing and laying out the germs are provided. Gaps between the germs are filled using a Voronoi-based method. Irregular shapes emerge, and the result looks like stained glass.
Patrick Chiu, Andreas Girgensohn, Qiong Liu 0003
ICME1
2003 Manipulating and Annotating Slides in a Multi-Display Environment
Patrick Chiu, Qiong Liu 0003, John S. Boreczky, Jonathan Foote, Don Kimber, Surapong Lertsithichai, Chunyuan Liao
INTERACT1
2003 Shared interactive video for teleconferencing
abstract
We present a system that allows remote and local participants to control devices in a meeting environment using mouse or pen based gestures "through" video windows. Unlike state-of-the-art device control interfaces that require interaction with text commands, buttons, or other artificial symbols, our approach allows users to interact with devices through live video of the environment. This naturally extends our video supported pan/tilt/zoom (PTZ) camera control system, by allowing gestures in video windows to control not only PTZ cameras, but also other devices visible in video images. For example, an authorized meeting participant can show a presentation on a screen by dragging the file on a personal laptop and dropping it on the video image of the presentation screen. This paper presents the system architecture, implementation tradeoffs, and various meeting control scenarios.
Chunyuan Liao, Qiong Liu 0003, Don Kimber, Patrick Chiu, Jonathan Foote, Lynn Wilcox
ACM Multimedia4
2001 A Probabilistic Room Location Service for Wireless Networked Environments
Paul C. Castro, Patrick Chiu, Ted Kremenek, Richard R. Muntz
UbiComp2
2001 LiteMinutes: an Internet-based system for multimedia meeting minutes
abstract
Article Share on LiteMinutes: an Internet-based system for multimedia meeting minutes Authors: Patrick Chiu FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CA FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CAView Profile , John Boreczky FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CA FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CAView Profile , Andreas Girgensohn FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CA FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CAView Profile , Don Kimber FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CA FX Palo Alto Laboratory, 3400 Hillview Avenue, Bldg. 4, Palo Alto, CAView Profile Authors Info & Claims WWW '01: Proceedings of the 10th international conference on World Wide WebMay 2001 Pages 140–149https://doi.org/10.1145/371920.371971Online:01 April 2001Publication History 40citation1,043DownloadsMetricsTotal Citations40Total Downloads1,043Last 12 Months45Last 6 weeks6 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access
Patrick Chiu, John S. Boreczky, Andreas Girgensohn, Don Kimber
WWW1
2000 A Genetic Segmentation Algorithm for Image Data Streams and Video
Patrick Chiu, Andreas Girgensohn, Wolfgang Polak, Eleanor Gilbert Rieffel, Lynn Wilcox, Forrest H. Bennett III
GECCO1
2000 A semi-automatic approach to home video editing
abstract
Hitchcock is a system that allows users to easily create custom videos from raw video shot with a standard video camera.In contrast to other video editing systems, Hitchcock uses automatic analysis to determine the suitability of portions of the raw video.Unsuitable video typically has fast or erratic camera motion.Hitchcock first analyzes video to identify the type and amount of camera motion: fast pan, slow zoom, etc.Based on this analysis, a numerical "unsuitability" score is computed for each frame of the video.Combined with standard editing rules, this score is used to identify clips for inclusion in the final video and to select their start and end points.To create a custom video, the user drags keyframes corresponding to the desired clips into a storyboard.Users can lengthen or shorten the clip without specifying the start and end frames explicitly.Clip lengths are balanced automatically using a spring-based algorithm.
Andreas Girgensohn, John S. Boreczky, Patrick Chiu, John Doherty, Jonathan Foote, Gene Golovchinsky, Shingo Uchihashi, Lynn Wilcox
UIST3
1999 NoteLook: taking notes in meetings with digital video and ink
abstract
NoteLook is a client-server system designed and built to support multimedia note taking in meetings with digital video and ink. It is integrated into a conference room equipped with computer controllable video cameras, video conference camera, and a large display rear video projector. The NoteLook client application runs on wireless pen-based notebook computers. Video channels containing images of the room activity and presentation material are transmitted by the NoteLook servers to the clients, and the images can be interactively and automatically incorporated into the note pages. Users can select channels, snap in large background images and sequences of thumbnails, and write freeform ink notes. A smart video source management component enables the capture of high quality images of the presentation material from a variety of sources. For accessing and browsing the notes and recorded video, NoteLook generates Web pages with links from the images and ink strokes correlated to the video.
Patrick Chiu, Ashutosh Kapuskar, Sarah Reitmeier, Lynn Wilcox
ACM Multimedia (1)1
1998 Tailorable Domain Objects as Meeting Tools for an Electronic Whiteboard
abstract
Our god is to pro~ide took to support wortig meetings On an electronic w'hitebom& c~ed TivoE This paper describes how we have inte~akd strucmd "dofi obj~~"into the whitebonrd environrnen~Domain objects represent the subject matter of meedngs and can be exchanged between Tivofi and group databases.Domain objects can be tailored to produce m=ting tools that ~e fiely tuned to mmting practims.We destibe the fac~ty for tiering and mana=tig domain objects and tie user intetiace techniques for blending these into tie whiteboard environrnen~We show examples of both spmtic and generic meeting took crafted horn domain objects, and we describe a long-term we study in m'%chthese took support an ongoing work process.
Thomas P. Moran, William van Melle, Patrick Chiu
CSCW3
1998 A Dynamic Grouping Technique for Ink and Audio Notes
abstract
In this paper, we describe a technique for dynamically grouping digital ink and audio to support user interaction in freeform note-taking systems.For ink, groups of strokes might correspond to words, lines, or paragraphs of handwritten text.For audio, groups might be a complete spoken phrase or a speaker turn in a conversation.Ink and audio grouping is important for editing operations such as deleting or moving chunks of ink and audio notes.The grouping technique is based on hierarchical agglomerative clustering.This clustering algorithm yields groups of ink or audio in a range of sizes, depending on the level in the hierarchy, and thus provides structure for simple interactive selection and rapid non-linear expansion of a selection.Ink and audio grouping is also important for marking portions of notes for subsequent browsing and retrieval.Integration of the ink and audio clusters provides a flexible way to browse the notes by selecting the ink cluster and playing the corresponding audio cluster.
Patrick Chiu, Lynn Wilcox
ACM Symposium on User Interface Software and Technology1
1998 Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard
abstract
Our goal is to provide tools to support working meetings on an electronic whiteboard, called Tivoli.This paper describes how we have integrated structured domain objects, which represent the subject matter of meetings, into the freeform whiteboard environment.Domain objects can be tailored to produce meeting tools that are finely tuned to meeting practices.We describe the language for defining domain objects and show examples of meeting tools that have been built with the language.We show that the system can interpret the spatial relationships of domain objects on the whiteboard to encode the meanings of the spatial arrangements, and we describe the computational mechanisms.We discuss some of the design principles for tailoring gestures for domain objects.Finally, we enumerate the techniques we have used to integrate the structured objects into the freeform whiteboard environment.
Thomas P. Moran, William van Melle, Patrick Chiu
ACM Symposium on User Interface Software and Technology3
1997 "I'll Get That Off the Audio": A Case Study of Salvaging Multimedia Meeting Records
abstract
Article "I'll get that off the audio": a case study of salvaging multimedia meeting records Share on Authors: Thomas P. Moran Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Leysia Palen Department of Information and Computer Science, University of California, Irvine, CA Department of Information and Computer Science, University of California, Irvine, CAView Profile , Steve Harrison Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Patrick Chiu Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Don Kimber Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Scott Minneman Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , William van Melle Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Polle Zellweger Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile Authors Info & Claims CHI '97: Proceedings of the ACM SIGCHI Conference on Human factors in computing systemsMarch 1997 Pages 202–209https://doi.org/10.1145/258549.258704Online:27 March 1997Publication History 89citation868DownloadsMetricsTotal Citations89Total Downloads868Last 12 Months22Last 6 weeks0 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access
Thomas P. Moran, Leysia Palen, Steve Harrison 0001, Patrick Chiu, Don Kimber, Scott Minneman, William van Melle, Polle Zellweger
CHI4
1997 Pen-Based Interaction Techniques for Organizing Material on an Electronic Whiteboard
abstract
This paper presents a scheme for extending an informal, penbased whiteboard system (the Tivoli application on-the Xerox LiveBoard) to provide interaction techniques that enable groups of users in informal meetings to easily organize and.rearrange material and to manage the space on the board.The techniques are based on the direct manipulation of boundaries and the implicit recognition of regions.The techniques include operations for shrinking and rearranging, structured borders that tessellate the board, freeform enclosures that can be split, fused, and linked, and collapsible annotations.Experience with using these techniques, the results of a user test, some design trade-offs and lessons, and future directions are discussed.
Thomas P. Moran, Patrick Chiu, William van Melle
ACM Symposium on User Interface Software and Technology2
1996 Evolutionary Engagement in an Ongoing Collaborative Work Process: A Case Study
abstract
Article Evolutionary engagement in an ongoing collaborative work process: a case study Share on Authors: Thomas P. Moran Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Patrick Chiu Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Steve Harrison Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Gordon Kurtenbach Alias Research, 110 Richmond, Street East, Toronto, Canada M5C 1P1 and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Alias Research, 110 Richmond, Street East, Toronto, Canada M5C 1P1 and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Scott Minneman Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , William van Melle Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile Authors Info & Claims CSCW '96: Proceedings of the 1996 ACM conference on Computer supported cooperative workNovember 1996 Pages 150–159https://doi.org/10.1145/240080.240243Published:16 November 1996 40citation654DownloadsMetricsTotal Citations40Total Downloads654Last 12 Months11Last 6 weeks1 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access
Thomas P. Moran, Patrick Chiu, Steve Harrison 0001, Gordon Kurtenbach, Scott Minneman, William van Melle
CSCW2
1995 Implicit Structures for Pen-Based Systems within a Freeform Interaction Paradigm
abstract
Article Free Access Share on Implicit structure for pen-based systems within a freeform interaction paradigm Authors: Thomas P. Moran Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Patrick Chiu Live Works, Inc., A Xerox Company, 2040 Fortune Drive, San Jose, CA and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Live Works, Inc., A Xerox Company, 2040 Fortune Drive, San Jose, CA and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , William van Melle Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile , Gordon Kurtenbach Alias Research Inc., 110 Richmond Street East, Toronto, Canada M5C 1P1 and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CA Alias Research Inc., 110 Richmond Street East, Toronto, Canada M5C 1P1 and Xerox Palo Alto Research Center, 3333 Coyote Hill Road, Palo Alto, CAView Profile Authors Info & Claims CHI '95: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMay 1995 Pages 487–494https://doi.org/10.1145/223904.223970Published:01 May 1995Publication History 51citation715DownloadsMetricsTotal Citations51Total Downloads715Last 12 Months44Last 6 weeks7 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteView all FormatsPDF
Thomas P. Moran, Patrick Chiu, William van Melle, Gordon Kurtenbach
CHI2