We present a browser for endoscopic videos that is designed to easily navigate and compare scenes on a tablet. It utilizes frame stripes of different levels of detail to quickly switch between fast and detailed navigation. Moreover, it uses saliency methods to determine which areas of a given keyframe contain the most information to further improve the visualization of the frame stripes. As scenes with much movement can be non-relevant out-of-patient scenes, the tool supports filtering for scenes of low, medium and high motion. The tool can be especially useful for patient debriefings as well as for educational purposes.

We present a tool for mobile browsing and annotation tailored for endoscopic videos. Professional users can utilize this tablet app for patients debriefings or educational purposes. It supports text input, free-hand and shape drawing as well as angle measurements, e.g. for comparing instrument orientation. It is possible to annotate single frames as well as user-defined video sections. Moreover, it provides easy and efficient navigation via a zoom-able navigation bar that is based on frame stripes. Frame stripes are created by extracting a single, one pixel wide vertical stripe from every keyframe. The stripes are then arranged next to each other to form a uniform bar. This gives users great overview of the content of a given video. Furthermore, the app supports creation of custom reports based on the entered annotations that can be directly mailed or printed for further usage.

We present a new approach for collaborative video search and video browsing relying on a combination of traditional, index-based video retrieval complemented with large-scale human-based visual inspection. In particular, a traditional PC interface is used for query-based search using advanced indexing and querying methods (e.g., concept search), whereas a visualization of the database on a tablet is used for pure human-based browsing. Both parts are coupled to compensate for mutual disadvantages; human visual inspection allows for a better, more detailed analysis of the data - also bridging the semantic gap - but comes at the price of an unfiltered database - a disadvantage that is resolved by using the results from the query engine to change visualization order.

We present a novel content-based video retrieval tool that facilitates interactive search in large video archives by focusing on the factors content context and content dynamics. It incorporates query-by-concept and query-by-sketch functionality. For the latter we introduce temporal feature signatures - an extension to color feature signatures by adding the dimension of content dynamics over time. Moreover, temporal feature signatures are also used for performing segment similarity searches for improved matching performance in contrast to static solutions. Because of intelligent caching this process is performed in just a couple of seconds, which improves the overall user experience greatly. Found segments can also be easily displayed in their chronological context for refining the search. To better visualize the content dynamics of a video segment users just need to move their mouse cursor across a segments thumbnail to peek into its content.

Mobile devices like smartphones and tablets are becoming increasingly capable in terms of processing power. Although they are already used in computer vision, no comparable measurement experiments of the popular OpenCV framework have been made yet. We try to fill this gap by evaluating the performance of a set of typical OpenCV operations, on mobile devices like the iPad Air and iPhone 5S. We compare those results with the performance of a consumer grade laptop PC (MacBook Pro). Our tests span from simple image manipulation methods to keypoint detection and descriptor extraction as well as descriptor matching. Results show that the top performing device can match the performance of the PC up to 80 percent in specific operations.

Most interfaces in the field of image and video search use a two-dimensional grid interface, which presents image thumbnails in a left-to-right arrangement that can be browsed from top to bottom. This grid interface, however, has several drawbacks that become particularly apparent when performing interactive search tasks for target items in large collections of images or videos. Therefore, we propose to use 3-D interfaces as an alternative to the grid interface for interactive known-item search in visual data as they can partially overcome these drawbacks. In this paper, we first summarize our ideas and discuss design aspects of a 3-D ring and a 3-D globe interface. Next, we present results from four different user studies, where we evaluated the performance of these interfaces for known-item search tasks in image collections. Our results from these studies show that the proposed 3-D interfaces allow for significantly faster visual target search on desktop computers with mouse interaction as well as on tablet devices. The interfaces also achieve better subjective ratings. However, our evaluation also shows that on smartphones with 3.5-in screens an improvement over the grid interface in terms of visual search time is only possible in collections with more than 200 images.

Smartphones and tablets are popular devices. As lightweight, compact devices with built-in high-quality cameras, they are ideal to carry around and to use for snapshot photography. As the number of photos accumulate on the device quickly finding a particular photo can be tedious using the default grid-based photo browser installed on the device. In this paper we investigate user performance in a photo browsing task on an iPad and an iPod Touch device. We present results from two user experiments comparing the standard grid interface to a pan-and-zoom able grid, a 3D-globe and a 3D-ring. In particular we are interested in how the interfaces perform with large photo collections (100 to 400 photos). The results show most promise for the pan-and-zoom grid and that the performance with the standard grid interface quickly deteriorates with large collections.

Mobile multimedia devices, such as smart phones and tablet PCs, are gaining increased popularity for the purpose of image and video recording. For many users, these ubiquitous devices are a good replacement of traditional and usually heavyweight cameras. However, while content creation is very simple on such mobile devices, browsing and searching still lacks of appropriate interaction means that are specifically designed for multi-touch-based interaction on small displays. In this work, we present our initial concepts and ideas to improve image and video browsing on smart phones and tablet PCs with touchscreen interaction.

As mobile devices become more and more pervasive, they are increasingly used to record and watch personal and professional videos. Common video browsers on smart phones and tablets, however, fail to provide users an efficient and engaging experience to browse through video content. In this demo paper, we present an early prototype for browsing videos on tablets: browsing video with a 3D filmstrip. A video is split up into equidistant, uniformly sampled time segments. The segments are represented by key-frames shown on the surface of a filmstrip, allowing an immediate overview of great parts of the video. Further, a user can scroll through the filmstrip, start playback for any segment and refine the preview of segments by simple touch gestures.

In this work we propose an early prototype of a video browser for mobile devices with touchscreens. We concentrate on utilizing the thumbs because of the natural posture used with the devices when watching videos in landscape mode. The controls are only displayed when the user touches the screen and automatically rearrange themselves depending on the position of the thumbs. A combination of a radial menu and an extended seeker control with hierarchical browsing and bookmarking features enables the user to navigate quickly through videos.

With users increasingly using their mobile devices such as smartphones as digital photo albums, effective methods for managing these collections are becoming increasingly important. Standard solutions provide only limited facilities for organising, browsing and searching image collections on mobile devices, making it challenging and time-consuming to locate images of interest.

Default image browsing interfaces on touch-based mobile devices provide limited support for image search tasks. To facilitate fast and convenient searches we propose an alternative interface that takes advantage of 3D graphics and arranges images on a rotatable globe according to color similarity. In a user study we compare the new design to the iPad's image browser. Results collected from 24 participants show that for color-sorted image collections the globe can reduce search time by 23% without causing more errors and that it is perceived as being fun to use and preferred over the standard browsing interface by 70% of the participants.