Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Sahil Badyal

dblp:258/3208 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
0000-0002-3781-0192ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Reinforcement learning · 87% Planning, search and constraint satisfaction · 6% Multi-agent systems · 6%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › dynamic programming › policy iteration
approximate policy iteration
0.812024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024
Machine learning › Reinforcement learning
multi-agent reinforcement learning
0.812024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024
Machine learning › Reinforcement learning › multi-agent reinforcement learning
multi-agent rollout
0.812024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024
Machine learning › Reinforcement learning › dynamic programming
policy iteration
0.812024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024
Knowledge, reasoning and agents › Multi-agent systems
multi-robot coordination
0.212024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning under uncertainty
partially observable markov decision process
0.212024
Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems · IEEE Trans. Robotics 2024

Methods — techniques the papers use, named apart from their topics

truncated lookahead · 0.8terminal cost approximation · 0.8rollout · 0.8
YearPublicationVenuePosition
2024 Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP With Application to Multirobot Problems
abstract
In this article, we consider the computational and communication challenges of partially observable multiagent sequential decision-making problems. We present algorithms that simultaneously or sequentially optimize the agents' controls by using multistep lookahead, truncated rollout with a known base policy, and a terminal cost function approximation. In particular: 1) we consider multiagent rollout algorithms that dramatically reduce required computation while preserving the key policy improvement property of the standard rollout method. We improve our multiagent rollout policy by incorporating it in an offline approximate policy iteration scheme, and we apply an additional “online play” scheme enhancing offline approximation architectures; 2) we consider the imperfect communication case and provide various extensions to our rollout methods to deal with this case; and 3) we demonstrate the performance of our methods in extensive simulations by applying our method to a challenging partially observable multiagent sequential repair problem (state space size$10^{37}$and control space size$10^{7}$). Our extensive simulations demonstrate that our methods produce better policies for large and complex multiagent problems in comparison with existing methods, including POMCP, MADDPG, and work well where other methods fail to scale up.
Sushmita Bhattacharya, Siva Kailas, Sahil Badyal, Stephanie Gil, Dimitri P. Bertsekas
IEEE Trans. Robotics3
2022 Unsupervised Data Augmentation for Aspect Based Sentiment Analysis
abstract
Recent approaches to Aspect-based Sentiment Analysis (ABSA) take a co-extraction approach to this span-level classification task, performing the subtasks of aspect term extraction (ATE) and aspect sentiment classification (ASC) simultaneously. In this work, we build on recent progress in applying pre-training to this co-extraction task with the introduction of an adaptation of Unsupervised Data Augmentation in semi-supervised learning. As originally implemented, UDA cannot accommodate span-level classification since it relies on advanced data augmentation techniques, such as back-translation, that alter the sequence lengths of the original data and cause index mismatches. We introduce an adaptation of UDA using Masked Language Model (MLM) unmasking that accommodates this index-match constraint and test the approach on standard ABSA benchmark datasets. We show that simple augmentations applied to modest-sized datasets along with consistency training lead to competitive performance with the current ABSA state-of-the-art in the restaurant and laptop domains using only 75% of the training data.
David Z. Chen, Adam Faulkner, Sahil Badyal
COLING3