Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Qiaojie Zheng

dblp:342/7918 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Systems, architecture and hardware · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Robot manipulation · 33% Transfer learning and domain adaptation · 33% Reinforcement learning · 33%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › actor-critic methods
asymmetric actor-critic
0.812024
Curriculum-based Sensing Reduction in Simulation to Real-World Transfer for In-hand Manipulation · ICRA 2024
Robotics › Robot manipulation
dexterous manipulation
0.812024
Curriculum-based Sensing Reduction in Simulation to Real-World Transfer for In-hand Manipulation · ICRA 2024
Machine learning › Transfer learning and domain adaptation
sim-to-real transfer
0.812024
Curriculum-based Sensing Reduction in Simulation to Real-World Transfer for In-hand Manipulation · ICRA 2024

Methods — techniques the papers use, named apart from their topics

deep random generator · 0.8curriculum learning · 0.8asymmetric actor-critic · 0.8
YearPublicationVenuePosition
2024 Curriculum-based Sensing Reduction in Simulation to Real-World Transfer for In-hand Manipulation
abstract
Simulation to Real-World Transfer allows affordable and fast training of learning-based robots for manipulation tasks using Deep Reinforcement Learning methods. Currently, Asymmetric Actor-Critic approaches are used for Sim2Real to reduce the rich idealized features in simulation to the accessible ones in the real world. However, the feature reduction from the simulation to the real world is conducted through an empirically defined one-step curtail. Small feature reduction does not sufficiently remove the actor’s features, which may still cause difficulty setting up the physical system, while large feature reduction may cause difficulty and inefficiency in training. To address this issue, we proposed Curriculum-based Sensing Reduction to enable the actor to start with the same rich feature space as the critic and then get rid of the hard-to-extract features step-by-step for higher training performance and better adaptation for real-world feature space. The reduced features are replaced with random signals from a Deep Random Generator to remove the dependency between the output and the removed features and avoid creating new dependencies. The methods are evaluated on the Allegro robot hand in a real-world in-hand manipulation task. The results show that our methods have faster training and higher task performance than baselines and can solve real-world tasks when selected tactile features are reduced.
Lingfeng Tao, Jiucai Zhang, Qiaojie Zheng, Xiaoli Zhang 0002
ICRA3