Evaluation methodologies in visualization have mostly focused on how well the tools and techniques cater to the analytical needs of the user. While this is important in determining the effectiveness of the tools and advancing the state-of-the-art in visualization research, a key area that has mostly been overlooked is how well established visualization theories and principles are instantiated in practice. This is especially relevant when domain experts, and not visualization researchers, design visualizations for analysis of their data or for broader dissemination of scientific knowledge. There is very little research on exploring the synergistic capabilities of cross-domain collaboration between domain experts and visualization researchers. To fill this gap, in this paper we describe the results of an exploratory study of climate data visualizations conducted in tight collaboration with a pool of climate scientists. The study analyzes a large set of static climate data visualizations for identifying their shortcomings in terms of visualization design. The outcome of the study is a classification scheme that categorizes the design problems in the form of a descriptive taxonomy. The taxonomy is a first attempt for systematically categorizing the types, causes, and consequences of design problems in visualizations created by domain experts. We demonstrate the use of the taxonomy for a number of purposes, such as, improving the existing climate data visualizations, reflecting on the impact of the problems for enabling domain experts in designing better visualizations, and also learning about the gaps and opportunities for future visualization research. We demonstrate the applicability of our taxonomy through a number of examples and discuss the lessons learnt and implications of our findings.

The next-generation On-line Metadata Editor (OME) is an easy-to-use tool to help document scientific data in a well-structured popular metadata format. In this paper, we discuss the newest tool that Oak Ridge National Laboratory has developed to input, edit, and manage metadata and how it is helping data intensive science centers across many federal agencies to prepare metadata and to make their BigData discoverable.

Conventional wisdom suggests that there are benefits to the creation of shared repositories of scientific data. Funding agencies require that the data from sponsored projects be shared publicly, but individual researchers often see little personal benefit to offset the work of creating easily sharable data. These conflicting forces have led to the emergence of a new role to support researchers: data managers. This paper identifies key differences between the socio-technical context of data managers and other "human infrastructure" roles articulated previously in Computer Supported Cooperative Work (CSCW) literature and summarizes the challenges that data managers face when accepting data for archival and reuse. While data managers' work is critical for advancing science and science policy, their work is often invisible and under-appreciated since it takes place behind the scenes.

Abstract Inter‐comparison and similarity analysis to gauge consensus among multiple simulation models is a critical visualization problem for understanding climate change patterns. Climate models, specifically, Terrestrial Biosphere Models (TBM) represent time and space variable ecosystem processes, like, simulations of photosynthesis and respiration, using algorithms and driving variables such as climate and land use. While it is widely accepted that interactive visualization can enable scientists to better explore model similarity from different perspectives and different granularity of space and time, currently there is a lack of such visualization tools. In this paper we present three main contributions. First, we propose a domain characterization for the TBM community by systematically defining the domain‐specific intents for analyzing model similarity and characterizing the different facets of the data. Second, we define a classification scheme for combining visualization tasks and multiple facets of climate model data in one integrated framework, which can be leveraged for translating the tasks into the visualization design. Finally, we present SimilarityExplorer, an exploratory visualization tool that facilitates similarity comparison tasks across both space and time through a set of coordinated multiple views. We present two case studies from three climate scientists, who used our tool for a month for gaining scientific insights into model similarity. Their experience and results validate the effectiveness of our tool.

Visual data analysis often requires grouping of data objects based on their similarity. In many application domains researchers use algorithms and techniques like clustering and multidimensional scaling to extract groupings from data. While extracting these groups using a single similarity criteria is relatively straightforward, comparing alternative criteria poses additional challenges. In this paper we define visual reconciliation as the problem of reconciling multiple alternative similarity spaces through visualization and interaction. We derive this problem from our work on model comparison in climate science where climate modelers are faced with the challenge of making sense of alternative ways to describe their models: one through the output they generate, another through the large set of properties that describe them. Ideally, they want to understand whether groups of models with similar spatio-temporal behaviors share similar sets of criteria or, conversely, whether similar criteria lead to similar behaviors. We propose a visual analytics solution based on linked views, that addresses this problem by allowing the user to dynamically create, modify and observe the interaction among groupings, thereby making the potential explanations apparent. We present case studies that demonstrate the usefulness of our technique in the area of climate science.

We find that software frameworks for digital content management and access may be used for capturing certain data provenance information, particularly for data that has already been created and archived at a repository center. One of the key enabling factors is the abstraction concept of a digital object augmented with semantic relationships. One set of frameworks, Fedora Repository and Drupal CMS with the Islandora connector hold great promise for provenance applications as well as long-term curation of Geoscience datasets.

Initiated in 1984, the Committee Earth Observing Satellites' Working Group on Calibration and Validation (CEOS WGCV) pursues activities to coordinate, standardize and advance calibration and validation of civilian satellites and their data. One subgroup of CEOS WGCV, Land Product Validation (LPV), was established in 2000 to define standard validation guidelines and protocols and to foster data and information exchange relevant to the validation of land products. Since then, a number of leaf area index (LAI) products have become available to the science community at both global and regional extents. Having multiple global LAI products and multiple, disparate validation activities related to these products presents the opportunity to realize efficiency through international collaboration. So the LPV subgroup established an international LAI intercomparison validation activity. This paper describes the main components of this international validation effort. The paper documents the current participants, their ground LAI measurements and scaling techniques, and the metadata and infrastructure established to share data. The paper concludes by describing plans for sharing both field data and high-resolution LAI products from each site. Many considerations of this global LAI intercomparison can apply to other products, and this paper presents a framework for such collaboration