Mengshi Zhao

dblp:294/3326 · DBLP profile ↗
← Back
6ranked-venue papers
0as first author
6since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021Theory of computation · 2 · 2 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
YearPublicationVenuePosition
2026 DEPO: Dual-Efficiency Preference Optimization for LLM Agents
abstract
Recent advances in large language models (LLMs) have greatly improved their reasoning and decision-making abilities when deployed as agents. Richer reasoning, however, often comes at the cost of longer chain of thought (CoT), hampering interaction efficiency in real-world scenarios. Nevertheless, there still lacks systematic definition of LLM‑Agent efficiency, hindering targeted improvements. To this end, we introduce dual‑efficiency, comprising (i) step-level efficiency, which minimizes tokens per step, and (ii) trajectory-level efficiency, which minimizes the number of steps to complete a task. Building on this definition, we propose DEPO, a dual-efficiency preference‑based optimization method that jointly rewards succinct responses and fewer action steps. Experiments on WebShop and BabyAI show that DEPO cuts token usage by up to 60.9% and steps by up to 26.9%, while achieving up to a 29.3% improvement in task performance. DEPO also generalizes to three out-of-domain math benchmarks and retains its efficiency gains when trained on only 25% of the data.
Mengshi Zhao, Yuying Zhao, Beier Zhu, Hanwang Zhang, Shengjie Zhao 0001, Chaochao Lu
AAAI2
2025 Online Clustering with Nearly Optimal Consistency
abstract
We give online algorithms for $k$-Means(more generally, $(k, z)$-Clustering) with nearly optimal consistency (a notion suggested by Lattanzi & Vassilvitskii (2017)). Our result turns any $\alpha$-approximate offline algorithm for clustering into an $(1+\epsilon)\alpha^2$-competitive online algorithm for clustering with $O(k \text{poly} \log n)$ consistency. This consistency bound is optimal up to $\text{poly} \log(n)$ factors. Plugging in the offline algorithm that returns the exact optimal solution, we obtain the first $(1 + \epsilon)$-competitive online algorithm for clustering that achieves a linear in $k$ consistency. This simultaneously improves several previous results (Lattanzi & Vassilvitskii, 2017; Fichtenberger et al., 2021). We validate the performance of our algorithm on real datasets by plugging in the practically efficient $k$-Means++ algorithm. Our online algorithm makes $k$-Means++ achieve good consistency with little overhead to the quality of solutions.
T.-H. Hubert Chan, Shaofeng H.-C. Jiang, Mengshi Zhao
ICLR4
2024 Privacy Amplification by Iteration for ADMM with (Strongly) Convex Objective Functions
abstract
We examine a private ADMM variant for (strongly) convex objectives which is a primal-dual iterative method. Each iteration has a user with a private function used to update the primal variable, masked by Gaussian noise for local privacy, without directly adding noise to the dual variable. Privacy amplification by iteration explores if noises from later iterations can enhance the privacy guarantee when releasing final variables after the last iteration. Cyffers et al. explored privacy amplification by iteration for the proximal ADMM variant, where a user's entire private function is accessed and noise is added to the primal variable. In contrast, we examine a private ADMM variant requiring just one gradient access to a user's function, but both primal and dual variables must be passed between successive iterations. To apply Balle et al.'s coupling framework to the gradient ADMM variant, we tackle technical challenges with novel ideas. First, we address the non-expansive mapping issue in ADMM iterations by using a customized norm. Second, because the dual variables are not masked with any noise directly, their privacy guarantees are achieved by treating two consecutive noisy ADMM iterations as a Markov operator. Our main result is that the privacy guarantee for the gradient ADMM variant can be amplified proportionally to the number of iterations. For strongly convex objective functions, this amplification exponentially increases with the number of iterations. These amplification results align with the previously studied special case of stochastic gradient descent.
T.-H. Hubert Chan, Mengshi Zhao
AAAI3
2024 MPMD on Two Sources with Lookahead
Enze Sun 0001, Bo Wang 0156, Quan Xue, Mengshi Zhao, Zixuan Zhu 0007
COCOON (1)4
2024 Advanced Composition Theorems for Differential Obliviousness
abstract
Differential obliviousness (DO) is a privacy notion which mandates that the access patterns of a program satisfy differential privacy. Earlier works have shown that in numerous applications, differential obliviousness allows us to circumvent fundamental barriers pertaining to fully oblivious algorithms, resulting in asymptotical (and sometimes even polynomial) performance improvements. Although DO has been applied to various contexts, including the design of algorithms, data structures, and protocols, its compositional properties are not explored until the recent work of Zhou et al. (Eurocrypt'23). Specifically, Zhou et al. showed that the original DO notion is not composable. They then proposed a refinement of DO called neighbor-preserving differential obliviousness (NPDO), and proved a basic composition for NPDO. In Zhou et al.'s basic composition theorem for NPDO, the privacy loss is linear in k for k-fold composition. In comparison, for standard differential privacy, we can enjoy roughly √k loss for k-fold composition by applying the well-known advanced composition theorem given an appropriate parameter range. Therefore, a natural question left open by their work is whether we can also prove an analogous advanced composition for NPDO. In this paper, we answer this question affirmatively. As a key step in proving an advanced composition theorem for NPDO, we define a more operational notion called symmetric NPDO which we prove to be equivalent to NPDO. Using symmetric NPDO as a stepping stone, we also show how to generalize NPDO to more general notions of divergence, resulting in Rényi-NPDO, zeroconcentrated-NPDO, Gassian-NPDO, and g-NPDO notions. We also prove composition theorems for these generalized notions of NPDO.
Mingxun Zhou, Mengshi Zhao, T.-H. Hubert Chan, Elaine Shi
ITCS2
2023 Using Tabu Search to Avoid Concave Obstacles for Source Location
abstract
Recently, using a particle swarm optimizer (PSO) to guide robots in a source location problem has attracted widespread interest. While being navigated by PSO, robots are easily trapped into U-shape-like concave obstacles such that they move back and forth cyclically and fail to locate a correct source. Existing obstacle avoidance strategies perform well when robots have information about all obstacles. Yet in many real scenes, robots have no prior information. This work proposes a novel PSO based on Tabu Search (PSO-TS) for robots to locate multiple sources. Instead of traditionally setting obstacles as tabu objects, PSO-TS innovatively sets trapping areas as tabu objects such that robots do not need prior knowledge or expensive hardware and much time to obtain obstacle information. The weighted average velocity of a robot is employed to determine if it is stuck inside an obstacle-induced area. If so, a rectangular tabu area is set to push robots out of the area and prevents robots from searching the same area again. The proposed method can be embedded into various source location algorithms to improve their performance. Its obstacle avoidance capability is proved. Finally, experimental results show the algorithmic compatibility, environmental adaptability and obstacle avoidance performance of the proposed method.
Huan Liu 0019, Peng Zu, Mengshi Zhao, Cheng Wang 0001, Aiiad Albeshri, Abdullah Abusorrah, MengChu Zhou
IEEE Trans. Intell. Transp. Syst.4