Shan Yu 0001

dblp:70/80-1 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
0009-0009-1705-8616ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Software engineering, systems software and programming languages · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 100%
Computer architecture, parallel and distributed computing, and storage systems
2 papers
Memory systems · 82% Cloud and datacenter computing · 18%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Memory systems › shared memory
distributed shared memory
0.812024
DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency · OSDI 2024
Machine learning › Efficient and distributed learning
distributed training
0.612022
BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster · CVPR 2022
Machine learning › Efficient and distributed learning
model compression
0.612022
BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster · CVPR 2022
Machine learning › Efficient and distributed learning › model compression
quantization
0.612022
BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster · CVPR 2022
Cloud and datacenter computing
cluster resource management and scheduling
0.212022
BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster · CVPR 2022

Methods — techniques the papers use, named apart from their topics

data partitioning · 1.1SIMD optimization · 1.1AutoML · 1.1
YearPublicationVenuePosition
2024 DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency
Yifan Qiao 0002, Shan Yu 0001, Yuanjiang Ni, Qingda Lu, Jiesheng Wu, Yiying Zhang 0005, Miryung Kim, Guoqing Harry Xu
OSDI4
2022 BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster
abstract
Most AI projects start with a Python notebook running on a single laptop; however, one usually needs to go through a mountain of pains to scale it to handle larger dataset (for both experimentation and production deployment). These usually entail many manual and error-prone steps for the data scientists to fully take advantage of the available hardware resources (e.g., SIMD instructions, multi-processing, quantization, memory allocation optimization, data partitioning, distributed computing, etc.). To address this challenge, we have open sourced BigDL 2.0 at https://github.com/intel-analytics/BigDL/ under Apache 2.0 license (combining the original BigDL [19] and Analytics Zoo [18] projects); using BigDL 2.0, users can simply build conventional Python notebooks on their laptops (with possible AutoML support), which can then be transparently accelerated on a single node (with up-to 9.6x speedup in our experiments), and seamlessly scaled out to a large cluster (across several hundreds servers in real-world use cases). BigDL 2.0 has already been adopted by many real-world users (such as Mastercard, Burger King, Inspur, etc.) in production.
Jason Jinquan Dai, Dongjie Shi, Shengsheng Huang, Xin Qiu 0006, Guoqiong Song, Yang Wang 0009, Qiyuan Gong, Jiaming Song, Shan Yu 0001, Le Zheng, Yina Chen, Junwei Deng
CVPR12