Hiyam Debary

dblp:386/1160 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2025
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Vision and language · 100%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Environmental and earth informatics · 100%

Topics — the 3 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Vision and language › vision-language model › domain-specific vision-language model
remote sensing vision-language model
0.912025
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues · CVPR 2025
Computer vision › Vision and language
vision-language model
0.912025
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues · CVPR 2025
Environmental and earth informatics
remote sensing
0.912025
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues · CVPR 2025

Methods — techniques the papers use, named apart from their topics

multimodal learning · 1.7instruction tuning · 1.7
YearPublicationVenuePosition
2025 EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues
abstract
Automated analysis of vast Earth observation data via interactive Vision-Language Models (VLMs) can unlock new opportunities for environmental monitoring, disaster response, and resource management. Existing generic VLMs do not perform well on Remote Sensing data, while the recent Geo-spatial VLMs remain restricted to a fixed resolution and few sensor modalities. In this paper, we introduce EarthDial, a conversational assistant specifically designed for Earth Observation (EO) data, transforming complex, multi-sensory Earth observations into interactive, natural language dialogues. EarthDial supports multi- spectral, multi-temporal, and multi-resolution imagery, enabling a wide range of remote sensing tasks, including classification, detection, captioning, question answering, visual reasoning, and visual grounding. To achieve this, we introduce an extensive instruction tuning dataset comprising over 11.11M instruction pairs covering RGB, Synthetic Aperture Radar (SAR), and multispectral modalities such as Near-Infrared (NIR) and infrared. Furthermore, EarthDial handles bi-temporal and multi-temporal sequence analysis for applications like change detection. Our extensive experimental results on 44 downstream datasets demonstrate that EarthDial outperforms existing generic and domain-specific models, achieving better generalization across various EO tasks. Our source codes and pre-trained models are at https://github.com/hiyamdebary/EarthDial.
Sagar Soni, Akshay Dudhane, Hiyam Debary, Mustansar Fiaz, Muhammad Akhtar Munir, Muhammad Sohail Danish, Paolo Fraccaro, Campbell D. Watson, Levente J. Klein, Fahad Shahbaz Khan, Salman Khan 0001
CVPR3
2024 Detection and Characterization of Urban Heat Islands with Machine Learning
abstract
Assessing and understanding the urban scale impacts of extreme climate events is a global necessity. Risks associated with heat, where intra-urban dynamics and rural/urban boundary conditions greatly impact its distribution, are of particular interest as the evolution of climate change and ur-banization persists. Characterizing Urban Heat Island (UHI) effects is dependent on the availability of high-resolution near-surface air temperature maps and a description of the Local Climate Zones (LCZs). This study assesses the applicability of state-of-the-art (SOTA) Artificial Intelligence (AI) techniques for UHI detection and characterization. A Geospatial Foundation Model (GFM) is fine-tuned to predict 2 m air temperature at a 1 km resolution for the urban areas of Johannesburg, South Africa, with mean absolute error measures less than 1.5 °C. UHI characterization is further enabled through a Fully Connected Network (FCN) model for LCZs classification for the same region of interest.
Muaaz Bhamjee, Hiyam Debary, Zaheed Gaffoor, Tamara Govindasamy, Craig Mahlasi, Mustansar Fiaz, Etienne Eben Vos, Levente J. Klein, Sibusisiwe Makhanya, Campbell D. Watson, Julian Kuehnert
IGARSS2