Miquel Ramírez

dblp:36/6034 · DBLP profile ↗
← Back
16ranked-venue papers
5as first author
4since 2021 · last 2025
0000-0002-1838-7982ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 16 · 5 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 10 · 4 first-author · 1 since 2021Software engineering, systems software and programming languages · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
10 papers
Planning, search and constraint satisfaction · 82% Reinforcement learning · 12% Legged, aerial and field robots · 5%
Theoretical computer science
1 paper
Automated reasoning and model checking · 87% Automata and formal languages · 13%

Topics — the 18 heaviest of 20, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › search-based planning
width-based planning
0.922021
Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark · NeurIPS 2021
Boundary Extension Features for Width-Based Planning with Simulators on Continuous-State Domains · IJCAI 2020
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › plan representation › planning languages
PDDL+ planning
0.612022
Explaining the Behaviour of Hybrid Systems with PDDL+ Planning · IJCAI 2022
Automated reasoning and model checking
model checking
0.612022
Explaining the Behaviour of Hybrid Systems with PDDL+ Planning · IJCAI 2022
Automated reasoning and model checking
reachability
0.612022
Explaining the Behaviour of Hybrid Systems with PDDL+ Planning · IJCAI 2022
Knowledge, reasoning and agents › Planning, search and constraint satisfaction
classical planning
0.532017
Purely Declarative Action Descriptions are Overrated: Classical Planning with Simulators · IJCAI 2017
Classical Planning with Simulators: Results on the Atari Video Games · IJCAI 2015
Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners · AAAI 2010
Machine learning › Reinforcement learning › model-based reinforcement learning › model-based planning
simulator-based planning
0.522017
Purely Declarative Action Descriptions are Overrated: Classical Planning with Simulators · IJCAI 2017
Classical Planning with Simulators: Results on the Atari Video Games · IJCAI 2015
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › plan recognition
goal recognition
0.522019
Online Probabilistic Goal Recognition over Nominal Models · IJCAI 2019
Goal Recognition over POMDPs: Inferring the Intention of a POMDP Agent · IJCAI 2011
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › search-based planning
lookahead planning
0.512021
Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark · NeurIPS 2021
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning
continuous-space planning
0.412020
Boundary Extension Features for Width-Based Planning with Simulators on Continuous-State Domains · IJCAI 2020
Knowledge, reasoning and agents › Planning, search and constraint satisfaction
plan recognition
0.332011
Goal Recognition over POMDPs: Inferring the Intention of a POMDP Agent · IJCAI 2011
Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners · AAAI 2010
Plan Recognition as Planning · IJCAI 2009
Robotics › Legged, aerial and field robots
aerial robots
0.312017
Real-Time UAV Maneuvering via Automated Planning in Simulations · IJCAI 2017
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning under uncertainty
black-box planning
0.312017
Purely Declarative Action Descriptions are Overrated: Classical Planning with Simulators · IJCAI 2017
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning › online planning
real-time planning
0.312017
Real-Time UAV Maneuvering via Automated Planning in Simulations · IJCAI 2017
Automata and formal languages › infinite-state systems
hybrid automata
0.212022
Explaining the Behaviour of Hybrid Systems with PDDL+ Planning · IJCAI 2022
Machine learning › Reinforcement learning
deep reinforcement learning
0.112020
Boundary Extension Features for Width-Based Planning with Simulators on Continuous-State Domains · IJCAI 2020
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning under uncertainty
partially observable markov decision process
0.112011
Goal Recognition over POMDPs: Inferring the Intention of a POMDP Agent · IJCAI 2011
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › plan recognition
probabilistic plan recognition
0.112010
Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners · AAAI 2010
Machine learning › Reinforcement learning
model-based reinforcement learning
0.112015
Classical Planning with Simulators: Results on the Atari Video Games · IJCAI 2015

Methods — techniques the papers use, named apart from their topics

model checking · 1.1automated planning · 1.1PDDL+ · 1.1width-based lookahead · 0.5critical path learning · 0.5boundary extension features · 0.4black-box simulator · 0.4hybrid planning · 0.4simulation · 0.3domain-independent planning · 0.3
YearPublicationVenuePosition
2025 Frontmatter
abstract
This volume contains the papers accepted for presentation at ICAPS 2025, the Thirty-Fifth International Conference on Automated Planning and Scheduling, to be held in Melbourne, Australia, November 9-14, 2025. The annual ICAPS conference series was formed in 2003 through the merger of two pre-existing biennial conferences, the International Conference on Artificial Intelligence Planning and Scheduling (AIPS) and the European Conference on Planning (ECP). ICAPS continues the traditional high standards of AIPS and ECP as an archival forum for new research in the field of automated planning and scheduling. ICAPS 2025 was co-located with two other events: The International Conference on the Integration of Constraint Programming, Artificial Intelligence, and Operations Research (CPAIOR), and The International Conference on the Principles of Knowledge Representation and Reasoning (KR). Existing research into methods and representations for Automated Planning and Scheduling has drawn heavily from the research conducted by these communities. We believe that the co-location of these conferences with ICAPS can only boost these beneficial relationships.The frontmatter contains a Preface and lists both the ICAPS 2025 Organising Committee and the ICAPS 2025 Program Committee.
Daniel Harabor, Nir Lipovetzky, Miquel Ramírez, Sebastian Sardiña
ICAPS3
2022 Explaining the Behaviour of Hybrid Systems with PDDL+ Planning
abstract
The aim of this work is to explain the observed behaviour of a hybrid system (HS). The explanation problem is cast as finding a trajectory of the HS that matches some observations. By using the formalism of hybrid automata (HA), we characterize the explanations as the language of a network of HA that comprises one automaton for the HS and another one for the observations, thus restricting the behaviour of the HS exclusively to trajectories that explain the observations. We observe that this problem corresponds to a reachability problem in model-checking, but that state-of-the-art model checkers struggle to find concrete trajectories. To overcome this issue we provide a formal mapping from HA to PDDL+ and show how to use an off-the-shelf automated planner. An experimental analysis over domains with piece-wise constant, linear and nonlinear dynamics reveals that the proposed PDDL+ approach is much more efficient than solving directly the explanation problem with model-checking solvers.
Diego Aineto, Eva Onaindia, Miquel Ramírez, Enrico Scala, Ivan Serina
IJCAI3
2022 Sampling from Pre-Images to Learn Heuristic Functions for Classical Planning (Extended Abstract)
abstract
We introduce a new algorithm, Regression based Supervised Learning (RSL), for learning per instance Neural Network (NN) defined heuristic functions for classical planning problems. RSL uses regression to select relevant sets of states at a range of different distances from the goal. RSL then formulates a Supervised Learning problem to obtain the parameters that define the NN heuristic, using the selected states labeled with exact or estimated distances to goal states. Our experimental study shows that RSL outperforms, in terms of coverage, previous classical planning NN heuristics functions while requiring a fraction of the training time.
Stefan O'Toole, Miquel Ramírez, Nir Lipovetzky, Adrian R. Pearce
SOCS2
2021 Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark
abstract
We propose new width-based planning and learning algorithms inspired from a careful analysis of the design decisions made by previous width-based planners. The algorithms are applied over the Atari-2600 games and our best performing algorithm, Novelty guided Critical Path Learning (N-CPL), outperforms the previously introduced width-based planning and learning algorithms $\pi$-IW(1), $\pi$-IW(1)+ and $\pi$-HIW(n, 1). Furthermore, we present a taxonomy of the Atari-2600 games according to some of their defining characteristics. This analysis of the games provides further insight into the behaviour and performance of the algorithms introduced. Namely, for games with large branching factors, and games with sparse meaningful rewards, N-CPL outperforms $\pi$-IW, $\pi$-IW(1)+ and $\pi$-HIW(n, 1).
Stefan O'Toole, Nir Lipovetzky, Miquel Ramírez, Adrian R. Pearce
NeurIPS3
2020 Boundary Extension Features for Width-Based Planning with Simulators on Continuous-State Domains
abstract
Width-based planning algorithms have been demonstrated to be competitive with state-of-the-art heuristic search and SAT-based approaches, without requiring access to a model of action effects and preconditions, just access to a black-box simulator. Width-based planners search is guided by a measure of the novelty of states, that requires observations on simulator states to be given as a set of features. This paper proposes agnostic feature mapping mechanisms that define the features online, as exploration progresses and the domain of continuous state variables is revealed. We demonstrate the effectiveness of these features on the OpenAI gym "classical control" suite of benchmarks. We compare our online planners with state-of-the-art deep reinforcement learning algorithms, and show that width-based planners using our features can find policies of the same quality with significantly less computational resources.
Florent Teichteil-Königsbuch, Miquel Ramírez, Nir Lipovetzky
IJCAI2
2020 Subgoaling Techniques for Satisficing and Optimal Numeric Planning
abstract
This paper studies novel subgoaling relaxations for automated planning with propositional and numeric state variables. Subgoaling relaxations address one source of complexity of the planning problem: the requirement to satisfy conditions simultaneously. The core idea is to relax this requirement by recursively decomposing conditions into atomic subgoals that are considered in isolation. Such relaxations are typically used for pruning, or as the basis for computing admissible or inadmissible heuristic estimates to guide optimal or satis_cing heuristic search planners. In the last decade or so, the subgoaling principle has underpinned the design of an abundance of relaxation-based heuristics whose formulations have greatly extended the reach of classical planning. This paper extends subgoaling relaxations to support numeric state variables and numeric conditions. We provide both theoretical and practical results, with the aim of reaching a good trade-o_ between accuracy and computation costs within a heuristic state-space search planner. Our experimental results validate the theoretical assumptions, and indicate that subgoaling substantially improves on the state of the art in optimal and satisficing numeric planning via forward state-space search.
Enrico Scala, Patrik Haslum, Sylvie Thiébaux, Miquel Ramírez
J. Artif. Intell. Res.4
2019 Online Probabilistic Goal Recognition over Nominal Models
abstract
This paper revisits probabilistic, model-based goal recognition to study the implications of the use of nominal models to estimate the posterior probability distribution over a finite set of hypothetical goals. Existing model-based approaches rely on expert knowledge to produce symbolic descriptions of the dynamic constraints domain objects are subject to, and these are assumed to produce correct predictions. We abandon this assumption to consider the use of nominal models that are learnt from observations on transitions of systems with unknown dynamics. Leveraging existing work on the acquisition of domain models via learning for Hybrid Planning we adapt and evaluate existing goal recognition approaches to analyze how prediction errors, inherent to system dynamics identification and model learning techniques have an impact over recognition error rates.
Ramon Fraga Pereira, Mor Vered, Felipe Meneguzzi, Miquel Ramírez
IJCAI4
2018 Extending Classical Planning with State Constraints: Heuristics and Search for Optimal Planning
abstract
We present a principled way of extending a classical AI planning formalism with systems of state constraints, which relate - sometimes determine - the values of variables in each state traversed by the plan. This extension occupies an attractive middle ground between expressivity and complexity. It enables modelling a new range of problems, as well as formulating more efficient models of classical planning problems. An example of the former is planning-based control of networked physical systems - power networks, for example - in which a local, discrete control action can have global effects on continuous quantities, such as altering flows across the entire network. At the same time, our extension remains decidable as long as the satisfiability of sets of state constraints is decidable, including in the presence of numeric state variables, and we demonstrate that effective techniques for cost-optimal planning known in the classical setting - in particular, relaxation-based admissible heuristics - can be adapted to the extended formalism. In this paper, we apply our approach to constraints in the form of linear or non-linear equations over numeric state variables, but the approach is independent of the type of state constraints, as long as there exists a procedure that decides their consistency. The planner and the constraint solver interact through a well-defined, narrow interface, in which the solver requires no specialisation to the planning context.
Patrik Haslum, Franc Ivankovic, Miquel Ramírez, Dan Gordon 0002, Sylvie Thiébaux, Vikas Shivashankar, Dana S. Nau
J. Artif. Intell. Res.3
2017 Purely Declarative Action Descriptions are Overrated: Classical Planning with Simulators
abstract
Classical planning is concerned with problems where a goal needs to be reached from a known initial state by doing actions with deterministic, known effects. Classical planners, however, deal only with classical problems that can be expressed in declarative planning languages such as STRIPS or PDDL. This prevents their use on problems that are not easy to model declaratively or whose dynamics are given via simulations. Simulators do not provide a declarative representation of actions, but simply return successor states. The question we address in this paper is: can a planner that has access to the structure of states and goals only, approach the performance of planners that also have access to the structure of actions expressed in PDDL? To answer this, we develop domain-independent, black box planning algorithms that completely ignore action structure, and show that they match the performance of state-of-the-art classical planners on the standard planning benchmarks. Effective black box algorithms open up new possibilities for modeling and for expressing control knowledge, which we also illustrate.
Guillem Francès, Miquel Ramírez, Nir Lipovetzky, Hector Geffner
IJCAI2
2017 Real-Time UAV Maneuvering via Automated Planning in Simulations
abstract
The automatic generation of realistic behavior such as tactical intercepts for Unmanned Aerial Vehicles (UAV) in air combat is a challenging problem. State-of-the-art solutions propose hand-crafted algorithms and heuristics whose performance depends heavily on the initial conditions and specific aerodynamic characteristics of the UAVs involved. This demo shows the ability of domain-independent planners, embedded into simulators, to generate on-line, feed-forward, control signals that steer simulated aircraft as best suits the situation.
Miquel Ramírez, Michael Papasimeon, Lyndon Benke, Nir Lipovetzky, Tim Miller 0001, Adrian R. Pearce
IJCAI1
2016 Interval-Based Relaxation for General Numeric Planning
abstract
We generalise the interval-based relaxation to sequential numeric planning problems with non-linear conditions and effects, and cyclic dependencies. This effectively removes all the limitations on the problem placed in previous work on numeric planning heuristics, and even allows us to extend the planning language with a wider set of mathematical functions. Heuristics obtained from the generalised relaxation are pruning-safe. We derive one such heuristic and use it to solve discrete-time control-like planning problems with autonomous processes. Few planners can solve such problems, and search with our new heuristic compares favourably with them.
Enrico Scala, Patrik Haslum, Sylvie Thiébaux, Miquel Ramírez
ECAI4
2015 Classical Planning with Simulators: Results on the Atari Video Games
Nir Lipovetzky, Miquel Ramírez, Hector Geffner
IJCAI2
2011 Goal Recognition over POMDPs: Inferring the Intention of a POMDP Agent
abstract
Plan recognition is the problem of inferring the goals and plans of an agent from partial observations of her behavior. Recently, it has been shown that the problem can be formulated and solved using/nplanners, reducing plan recognition to plan generation./nIn this work, we extend this model-based/napproach to plan recognition to the POMDP setting, where actions are stochastic and states are partially observable. The task is to infer a probability distribution over the possible goals of an agent whose behavior results from a POMDP model. The POMDP model is shared between agent and observer except for the true goal of the agent that is hidden to the observer. The observations are action sequences O that may contain gaps as some or even most of the actions done by the agent may not be observed. We show that the posterior goal distribution P(GjO) can be computed from the value function VG(b) over beliefs b generated by the POMDP/nplanner for each possible goal G. Some extensions/nof the basic framework are discussed, and a number/nof experiments are reported.
Miquel Ramírez, Hector Geffner
IJCAI1
2010 Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners
abstract
Plan recognition is the problem of inferring the goals and plans of an agent after observing its behavior. Recently, it has been shown that this problem can be solved efficiently, without the need of a plan library, using slightly modified planning algorithms. In this work, we extend this approach to the more general problem of probabilistic plan recognition where a probability distribution over the set of goals is sought under the assumptions that actions have deterministic effects and both agent and observer have complete information about the initial state. We show that this problem can be solved efficiently using classical planners provided that the probability of a partially observed execution given a goal is defined in terms of the cost difference of achieving the goal under two conditions: complying with the observations, and not complying with them. This cost, and hence the posterior goal probabilities, are computed by means of two calls to a classical planner that no longer has to be modified in any way. A number of examples is considered to illustrate the quality, flexibility, and scalability of the approach.
Miquel Ramírez, Hector Geffner
AAAI1
2009 Plan Recognition as Planning
Miquel Ramírez, Hector Geffner
IJCAI1
2007 Structural Relaxations by Variable Renaming and Their Compilation for Solving MinCostSAT
Miquel Ramírez, Hector Geffner
CP1