Social issues, AI, and climate change are just a few of the disruptive focuses impacting science. The field of GIScience is well positioned to respond to accelerating disruptions due to the interdisciplinary nature of the field and the ability of GIScience approaches to be used in support of decision-making. This manuscript aims to start a conversation that will establish a research agenda for GIScience in an age of disruptions. We outline three guiding principles: (1) focusing on the relevance and real-world impact of research, (2) adopting systems-based thinking and contextual approaches and (3) emphasizing inclusive practices. We then outline prioritized research areas organized by what topics are important focal areas (Data and Infrastructure, Artificial Intelligence, and Causality and Generalizability), and what approaches to science we should be attentive to (Impactful Open Science, Collaborative and Convergent Science, and through Diverse Participation and Partnerships). We conclude with a call to increase impact by balancing slow science with practical and policy-oriented research. We also recognize that while broad adoption of spatial approaches is a signal of GIScience's success, we should continue to work together to advance core knowledge centered on spatial thinking and approaches.

Information retrieval (IR) has a large literature on evaluation, dating back decades and forming a central part of the research culture. The largest proportion of this literature discusses techniques to turn a sequence of relevance labels into a single number, reflecting the system's performance: precision or cumulative gain, for example, or dozens of alternatives. Those techniques-metrics-are themselves evaluated, commonly by reference to sensitivity and validity.

Much of the evaluation and tuning of a search system relies on relevance labels---annotations that say whether a document is useful for a given search and searcher. Ideally these come from real searchers, but it is hard to collect this data at scale, so typical experiments rely on third-party labellers who may or may not produce accurate annotations. Label quality is managed with ongoing auditing, training, and monitoring. We discuss an alternative approach. We take careful feedback from real searchers and use this to select a large language model (LLM), and prompt, that agrees with this feedback; the LLM can then produce labels at scale. Our experiments show LLMs are as accurate as human labellers and as useful for finding the best systems and hardest queries. LLM performance varies with prompt features, but also varies unpredictably with simple paraphrases. This unpredictability reinforces the need for high-quality "gold" labels.

When conducting research within a framework of Geographic Information Science (GISc), the scientific validity of this work can be argued as highly dependent upon the extent to which the methods employed are reproducible, and that, in the strictest sense, can only be fully achieved by implementing transparent workflows that utilize both open source software and openly available data. After considering the scientific implications of non-reproducible methods, we provide a review of both open source Geographic Information Systems (GIS) and openly available data, before describing an integrated model for Open GISc. We conclude with a critical review of this embryonic paradigm, with directions for future development in supporting spatial data infrastructure.

The identification of regions is both a computational and conceptual challenge. Even with growing computational power, regionalization algorithms must rely on heuristic approaches in order to find solutions. Therefore, the constraints and evaluation criteria that define a region must be translated into an algorithm that can efficiently and effectively navigate the solution space to find the best solution. One limitation of many existing regionalization algorithms is a requirement that the number of regions be selected a priori. The recently introduced max-p algorithm does not have this requirement, and thus the number of regions is an output of, not an input to, the algorithm. In this paper, we extend the max-p algorithm to allow for greater flexibility in the constraints available to define a feasible region, placing the focus squarely on the multidimensional characteristics of the region. We also modify technical aspects of the algorithm to provide greater flexibility in its ability to search the solution space. Using synthetic spatial and attribute data, we are able to show the algorithm’s broad ability to identify regions in maps of varying complexity. We also conduct a large-scale computational experiment to identify parameter settings that result in the greatest solution accuracy under various scenarios. The rules of thumb identified from the experiment produce maps that correctly assign areas to their ‘true’ region with 94% average accuracy, with nearly 50% of the simulations reaching 100% accuracy.