A key strategy in societal adaptation to climate change is using alert systems to prompt preventative action and reduce the adverse health impacts of extreme heat events. This paper implements and evaluates reinforcement learning (RL) as a tool to optimize the effectiveness of such systems. Our contributions are threefold. First, we introduce a new publicly available RL environment enabling the evaluation of the effectiveness of heat alert policies to reduce heat-related hospitalizations. The rewards model is trained from a comprehensive dataset of historical weather, Medicare health records, and socioeconomic/geographic features. We use scalable Bayesian techniques tailored to the low-signal effects and spatial heterogeneity present in the data. The transition model uses real historical weather patterns enriched by a data augmentation mechanism based on climate region similarity. Second, we use this environment to evaluate standard RL algorithms in the context of heat alert issuance. Our analysis shows that policy constraints are needed to improve RL's initially poor performance. Third, a post-hoc contrastive analysis provides insight into scenarios where our modified heat alert-RL policies yield significant gains/losses over the current National Weather Service alert policy in the United States.

SUMMARY: Genomics has dramatically improved our understanding of the molecular origins of certain human diseases. Nonetheless, our health is also influenced by the cumulative impact of exposures experienced across the life course (termed 'exposome'). The study of the high-dimensional exposome offers a new paradigm for investigating environmental contributions to disease etiology. However, there is a lack of bioinformatics tools for managing, visualizing and analyzing the exposome. The analysis data should include both association with health outcomes and integration with omic layers. We provide a generic framework called rexposome project, developed in the R/Bioconductor architecture that includes object-oriented classes and methods to leverage high-dimensional exposome data in disease association studies including its integration with a variety of high-throughput data types. The usefulness of the package is illustrated by analyzing a real dataset including exposome data, three health outcomes related to respiratory diseases and its integration with the transcriptome and methylome. AVAILABILITY AND IMPLEMENTATION: rexposome project is available at https://isglobal-brge.github.io/rexposome/. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.