With the rapid development of autonomous machines such as selfdriving vehicles and social robots, there is increasing realisation that machine ethics is important for widespread acceptance of autonomous machines. Our objective is to encode ethical reasoning into autonomous machines following well-defined ethical principles and behavioural norms. We provide an approach to reasoning about actions that incorporates ethical considerations. It builds on Scherl and Levesque's [29, 30] approach to knowledge in the situation calculus. We show how reasoning about knowledge in a dynamic setting can be used to guide ethical and moral choices, aligned with consequentialist and deontological approaches to ethics. We apply our approach to autonomous driving and social robot scenarios, and provide an implementation framework.

The standard representation formalism for multi-agent epistemic planning has one central disadvantage: When you use event models in dynamic epistemic logic (DEL) to describe the action of one agent, the model must specify not only the actual change and the change of that agent's knowledge. Also required is the epistemic change of any agents that may be observing the first agent performing the action, plus the epistemic change for any further agents that failed to observe that anything had taken place. To overcome the gap between this complex DEL notion of events and a more commonsense notion of actions, we propose a simple high-level action description language for multi-agent epistemic planning domains with just one type of effect laws: a causes x if y. Effect x can either be a physical effect, or an observation from an independent set that is specific to individual agents. We formally prove that any DEL event model can be described in this way. We show how this language provides a framework for expressing a variety of executability and action models; such as describing actions that are both ontic and epistemic, partially observable, or nondeterministic. We further combine our representation of event models with a description language for finitary initial epistemic theories, and we show how this allows us to reason about the effects of a sequence of actions in a multi-agent epistemic domain by updating a single multi-pointed epistemic model.

General game players can drastically reduce the cost of search if they are able to solve smaller subproblems individually and synthesise the resulting solutions. To provide a systematic solution to this (de-)composition problem, we start off with generalising the standard decomposition problem in planning by allowing the composition of individual solutions to be further constrained by domain-dependent requirements of the global planning problem. We solve this generalised problem based on a systematic analysis of composition operators for transition systems, and we demonstrate how this solution can be further generalised to general game playing.