Demo Data from EDBT 2026 / reviewers in the wild / expert
Minhao Shi
dblp:215/3713
· DBLP profile ↗
2ranked-venue papers
0as first author
0since 2021 · last 2020
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1Systems, architecture and hardware · 1Graphics, computer vision, multimedia, augmented reality and games · 1
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Reinforcement learning · 88% Optimization for machine learning · 12% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Reinforcement learning › temporal difference learning
eligibility traces |
0.3 | 1 | 2018 | A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning · IJCAI 2018 |
Machine learning › Reinforcement learning
temporal difference learning |
0.3 | 1 | 2018 | A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning · IJCAI 2018 |
Machine learning › Optimization for machine learning
convergence analysis |
0.1 | 1 | 2018 | A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning · IJCAI 2018 |
Machine learning › Reinforcement learning
value function approximation |
0.1 | 1 | 2018 | A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning · IJCAI 2018 |
Methods — techniques the papers use, named apart from their topics
q(σ) · 0.3eligibility traces · 0.3SARSA(λ) · 0.3
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2020 | Perception-enhancement based task learning and action scheduling for robotic limb in CPS environment
Shijian Li, Minhao Shi, Runhe Huang, Gang Pan 0001 |
Future Gener. Comput. Syst. | 2 |
| 2018 | A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement LearningabstractRecently, a new multi-step temporal learning algorithm Q(σ) unifies n-step Tree-Backup (when σ = 0) and n-step Sarsa (when σ = 1) by introducing a sampling parameter σ. However, similar to other multi-step temporal-difference learning algorithms, Q(σ) needs much memory consumption and computation time. Eligibility trace is an important mechanism to transform the off-line updates into efficient on-line ones which consume less memory and computation time. In this paper, we combine the original Q(σ) with eligibility traces and propose a new algorithm, called Qπ(σ,λ), where λ is trace-decay parameter. This new algorithm unifies Sarsa(λ) (when σ = 1) and Qπ (λ) (when σ = 0). Furthermore, we give an upper error bound of Qπ(σ,λ) policy evaluation algorithm. We prove that Qπ (σ, λ) control algorithm converges to the optimal value function exponentially. We also empirically compare it with conventional temporal-difference learning methods. Results show that, with an intermediate value of σ, Qπ(σ,λ) creates a mixture of the existing algorithms which learn the optimal value significantly faster than the extreme end (σ = 0, or 1). Long Yang 0004, Minhao Shi, Wenjia Meng, Gang Pan 0001 |
IJCAI | 2 |