Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Afonso Marques

dblp:331/6190 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Reinforcement learning · 100%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › robust reinforcement learning
adversarial reinforcement learning
0.812024
Adversarially Robust Decision Transformer · NeurIPS 2024
Machine learning › Reinforcement learning
offline reinforcement learning
0.812024
Adversarially Robust Decision Transformer · NeurIPS 2024
Machine learning › Reinforcement learning › offline reinforcement learning
return-conditioned supervised learning
0.812024
Adversarially Robust Decision Transformer · NeurIPS 2024
Machine learning › Reinforcement learning
multi-agent reinforcement learning
0.212024
Adversarially Robust Decision Transformer · NeurIPS 2024
Machine learning › Reinforcement learning › multi-agent reinforcement learning
sequential games
0.212024
Adversarially Robust Decision Transformer · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

transformer · 0.8minimax expectile regression · 0.8
YearPublicationVenuePosition
2024 Adversarially Robust Decision Transformer
abstract
Decision Transformer (DT), as one of the representative Reinforcement Learning via Supervised Learning (RvS) methods, has achieved strong performance in offline learning tasks by leveraging the powerful Transformer architecture for sequential decision-making. However, in adversarial environments, these methods can be non-robust, since the return is dependent on the strategies of both the decision-maker and adversary. Training a probabilistic model conditioned on observed return to predict action can fail to generalize, as the trajectories that achieve a return in the dataset might have done so due to a suboptimal behavior adversary. To address this, we propose a worst-case-aware RvS algorithm, the Adversarially Robust Decision Transformer (ARDT), which learns and conditions the policy on in-sample minimax returns-to-go. ARDT aligns the target return with the worst-case return learned through minimax expectile regression, thereby enhancing robustness against powerful test-time adversaries. In experiments conducted on sequential games with full data coverage, ARDT can generate a maximin (Nash Equilibrium) strategy, the solution with the largest adversarial robustness. In large-scale sequential games and continuous adversarial RL environments with partial data coverage, ARDT demonstrates significantly superior robustness to powerful test-time adversaries and attains higher worst-case returns compared to contemporary DT methods.
Xiaohang Tang, Afonso Marques, Parameswaran Kamalaruban, Ilija Bogunovic
NeurIPS2
2022 Co-designing a Bespoken Wearable Display for People with Dissociative Identity Disorder
abstract
Dissociative Identity Disorder (DID) is characterized by the presence of at least two distinct identities in the same individual. This paper describes a co-design process with a person living with DID. We first aimed to uncover the main challenges experienced by the co-designer as well as design opportunities for novel technologies. We then engaged in a prototyping stage to design a wearable display (WhoDID) to facilitate in-person social interactions. The prototype aims to be used as a necklace and enable the user to make their fronting personality visible to others. Thus, facilitating social encounters or sudden changes of identity. We reflect on the design features of WhoDID in the broader context of supporting people with DID. Moreover, we provide insights on co-designing with someone with multiple (sometimes conflicting) personalities regarding requirement elicitation, decision-making, prototyping, and ethics. To our knowledge, we report the first design process with a DID user within the ASSETS and CHI communities. We aim to encourage other assistive technology researchers to design with DID users.
Patricia Piedade, Nikoletta Matsur, Catarina Alexandra Rebelo Rodrigues, Francisco Cecilio, Afonso Marques, Rings Of Saturn, Isabel Neto, Hugo Nicolau
ASSETS5