Kewei Sun

dblp:24/1230 · DBLP profile ↗
← Back
10ranked-venue papers
2as first author
2since 2021 · last 2022
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 since 2021Systems, architecture and hardware · 2 · 1 first-authorSoftware engineering, systems software and programming languages · 1Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Efficient and distributed learning · 79% Probabilistic and Bayesian machine learning · 21%
Software engineering, system software, and programming languages
1 paper
Requirements engineering and software design · 50% Services computing and microservices · 50%
Computer architecture, parallel and distributed computing, and storage systems
1 paper
Cloud and datacenter computing · 100%

Topics — the 6 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning › automated machine learning
neural architecture search
0.922021
Rethinking Bi-Level Optimization in Neural Architecture Search: A Gibbs Sampling Perspective · AAAI 2021
MergeNAS: Merge Operations into One for Differentiable Architecture Search · IJCAI 2020
Machine learning › Probabilistic and Bayesian machine learning › monte carlo methods › markov chain monte carlo
gibbs sampling
0.512021
Rethinking Bi-Level Optimization in Neural Architecture Search: A Gibbs Sampling Perspective · AAAI 2021
Machine learning › Efficient and distributed learning › automated machine learning › neural architecture search
one-shot neural architecture search
0.512021
Rethinking Bi-Level Optimization in Neural Architecture Search: A Gibbs Sampling Perspective · AAAI 2021
Machine learning › Efficient and distributed learning › automated machine learning › neural architecture search › one-shot neural architecture search
differentiable architecture search
0.412020
MergeNAS: Merge Operations into One for Differentiable Architecture Search · IJCAI 2020
Services computing and microservices
internetware
0.212013
Model-based system configuration approach for Internetware · Sci. China Inf. Sci. 2013
Cloud and datacenter computing › virtualization › virtual machine management
virtual machine consolidation
0.112010
Brief announcement: network traffic can optimize consolidation during transformation to virtualization · PODC 2010

Methods — techniques the papers use, named apart from their topics

gibbs sampling · 0.5directed probabilistic graphical model · 0.5one-shot architecture search · 0.4merge-based operation · 0.4model-based configuration · 0.2
YearPublicationVenuePosition
2022 Entity Difference Modeling Based Entity Linking for Question Answering over Knowledge Graphs
Kewei Sun, Zhirong Hou
NLPCC (1)3
2021 Rethinking Bi-Level Optimization in Neural Architecture Search: A Gibbs Sampling Perspective
abstract
One-Shot architecture search, which aims to explore all possible operations jointly based on a single model, has been an active direction of Neural Architecture Search (NAS). As a well-known one-shot solution, Differentiable Architecture Search (DARTS) performs continuous relaxation on the architecture's importance and results in a bi-level optimization problem. However, as many recent studies have shown, DARTS cannot always work robustly for new tasks, which is mainly due to the approximate solution of the bi-level optimization. In this paper, one-shot neural architecture search is addressed by adopting a directed probabilistic graphical model to represent the joint probability distribution over data and model. Then, neural architectures are searched for and optimized by Gibbs sampling. We rethink the bi-level optimization problem as the task of Gibbs sampling from the posterior distribution, which expresses the preferences for different models given the observed dataset. We evaluate our proposed NAS method -- GibbsNAS on the search space used in DARTS/ENAS and the search space of NAS-Bench-201. Experimental results on multiple search space show the efficacy and stability of our approach.
Chao Xue 0003, Xiaoxing Wang, Junchi Yan, Yonggang Hu, Xiaokang Yang 0001, Kewei Sun
AAAI6
2020 MergeNAS: Merge Operations into One for Differentiable Architecture Search
abstract
Differentiable architecture search (DARTS) has been a promising one-shot architecture search approach for its mathematical formulation and competitive results. However, besides its caused high memory utilization and a large computation requirement, many research works have shown that DARTS also often suffers notable over-fitting and thus does not work robustly for some new tasks. In this paper, we propose a one-shot neural architecture search method referred to as MergeNAS by merging different types of operations e.g. convolutions into one operation. This merge-based approach not only reduces the search cost (about half a GPU day), but also alleviates over-fitting by reducing the redundant parameters. Extensive experiments on different search space and various datasets have been conducted to verify our approach, showing that MergeNAS can converge to a stable architecture and achieve better performance with fewer parameters and search cost. For test accuracy and its stability, MergeNAS outperforms all NAS baseline methods implemented on NAS-Bench-201, including DARTS, ENAS, RS, BOHB, GDAS and hand-crafted ResNet.
Xiaoxing Wang, Chao Xue 0003, Junchi Yan, Xiaokang Yang 0001, Yonggang Hu, Kewei Sun
IJCAI6
2019 Few-Shot Audio Classification with Attentional Graph Neural Networks
Shilei Zhang, Yong Qin 0001, Kewei Sun, Yonghua Lin
INTERSPEECH3
2014 Scheduling Cloud Platform Managed Live-Migration Operations to Minimize the Makespan
Xiaoyong Yuan, Ying Li 0012, Kewei Sun
NPC4
2013 Model-based system configuration approach for Internetware
Ying Li 0012, Kewei Sun, Liangzhao Zeng
Sci. China Inf. Sci.2
2010 Brief announcement: network traffic can optimize consolidation during transformation to virtualization
abstract
Under the consolidation scenario in Clouds, the network dimension should be considered as important as the computing power of machines. Traditional consolidation procedure is usually made according to the experience, which mainly focused on the hardware capability of the target system, like CPU, Memory and etc. Along with the consolidation of the computing power, the network communication among machines is also consolidated. The consolidation procedure needs to cover this change and avoid network problems after moving the applications into target virtualized system. This paper presents a novel approach to provide optimization taking network traffic into account during consolidation.
Kewei Sun, Ying Li 0012
PODC1
2008 Automatic model-based service hosting environment migration
abstract
The proper operation of Service-Oriented Architecture (SOA) depends on underlying system services of operating systems, so efficient and effective migration of Service Hosting Environment is critical to cope with intrinsic-changed nature of SOA. However, due to the large amount of configuration items, complicated mapping and complex dependency relationship among system services, migrating into a new Service Hosting Environment satisfying the operation requirement of SOA becomes an error-prone and time-consuming task. The SCM project in IBM develops a novel approach to migrate Service Hosting Environment shaped in Unix-like systems. Firstly, this approach builds a set of configuration models to describe various system services. Then based on models, it presents knowledge based mapping to translate system service configurations between Service Hosting Environments. Finally, it designs a dependency hierarchy deducting algorithm to compute the dependency relationship among system services for migration traceability and error determination. A SCM prototype has performed well on largely reducing time, labor and errors in real migration cases.
Liang Liu 0010, Ying Li 0012, Qian Ma 0010, Kewei Sun, Ying Chen 0004, Hao Wang 0208
NOMS4
2008 A state machine approach for problem detection in large-scale distributed system
abstract
Efficient problem detection methods play an important role in system management. In this paper, a formal method is described for problem detection in large scale and distributed enterprise IT environment. Events from distributed system components are collected, filtered and correlated. Leveraging these correlated events, the behavior of a distributed system is presented as a problem detection state machine (PDSM). PDSM is built up automatically from system logs without any specification of the target system. This approach combines logs from multi-sources and does not require any human involved or experimental instructions. It is generally applicable to a large class of distributed systems. Experimental results show that the implementation of PDSM performs problem detection efficiently in typical distributed enterprise systems.
Kewei Sun, Jie Qiu 0001, Ying Li 0012, Ying Chen 0004, Weixing Ji
NOMS1
2005 Self-Reconfiguration of Service-Based Systems: A Case Study for Service Level Agreements and Resource Optimization
abstract
The configuration of a service-based system has a significant impact on the nonfunctional requirements of the system as a whole. However, finding the best configuration is very challenging and sometimes impossible for administrators because so many factors have to be considered. More importantly, a service based system has to be frequently reconfigured to adapt to rapid and continuous changes in user requirements and runtime environments. In this paper we propose an autonomic computing approach to the problem of reconfiguration, that is, enabling the service based system to configure itself by means of a loop of monitoring, analyzing, planning and executing actions. We begin by formalizing the definition of configuration and reconfiguration. Then, we describe how we implemented the autonomic computing mechanisms for reconfiguring service-based systems to satisfy service level agreements with minimal resource consumption. The approach is demonstrated on a resilient service provisioning environment. Finally, the preliminary experiments are evaluated to determine the effectiveness of proposed approach.
Ying Li 0012, Kewei Sun, Jie Qiu 0001, Ying Chen 0004
ICWS2