Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Khalid Ashraf

dblp:42/9586 · DBLP profile ↗
← Back
4ranked-venue papers
3as first author
0since 2021 · last 2017
0000-0003-2247-5333ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 1 first-authorGraphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-authorDatabases, data management, data science and information retrieval · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 87% Deep learning architectures and training · 13%
Computer architecture, parallel and distributed computing, and storage systems
1 paper
High-performance computing · 50% GPUs and heterogeneous computing · 50%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning › distributed training
communication-efficient training
0.212016
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters · CVPR 2016
Machine learning › Efficient and distributed learning
distributed training
0.212016
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters · CVPR 2016
High-performance computing
cluster computing
0.212016
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters · CVPR 2016
GPUs and heterogeneous computing › multi-GPU computing
GPU cluster training
0.212016
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters · CVPR 2016
Machine learning › Deep learning architectures and training › training optimization
large-batch training
0.112016
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters · CVPR 2016

Methods — techniques the papers use, named apart from their topics

parameter server · 0.5large batch size · 0.5infiniband · 0.5reduction trees · 0.2reduction tree · 0.2
YearPublicationVenuePosition
2017 Shallow Networks for High-accuracy Road Object-detection
abstract
The ability to automatically detect other vehicles on the road is vital to the safety of partially-autonomous and fully-autonomous vehicles. Most of the high-accuracy techniques for this task are based on R-CNN or one of its faster variants. In the research community, much emphasis has been applied to using 3D vision or complex R-CNN variants to achieve higher accuracy. However, are there more straightforward modifications that could deliver higher accuracy? Yes. We show that increasing input image resolution (i.e. upsampling) offers up to 12 percentage-points higher accuracy compared to an off-the-shelf baseline. We also find situations where earlier/shallower layers of CNN provide higher accuracy than later/deeper layers. We further show that shallow models and upsampled images yield competitive accuracy. Our findings contrast with the current trend towards deeper and larger models to achieve high accuracy in domain specific detection tasks.
Khalid Ashraf, Bichen Wu, Forrest N. Iandola, Matthew W. Moskewicz, Kurt Keutzer
VEHITS1
2016 FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters
abstract
Long training times for high-accuracy deep neural networks (DNNs) impede research into new DNN architectures and slow the development of high-accuracy DNNs. In this paper we present FireCaffe, which successfully scales deep neural network training across a cluster of GPUs. We also present a number of best practices to aid in comparing advancements in methods for scaling and accelerating the training of deep neural networks. The speed and scalability of distributed algorithms is almost always limited by the overhead of communicating between servers, DNN training is not an exception to this rule. Therefore, the key consideration here is to reduce communication overhead wherever possible, while not degrading the accuracy of the DNN models that we train. Our approach has three key pillars. First, we select network hardware that achieves high bandwidth between GPU servers - Infiniband or Cray interconnects are ideal for this. Second, we consider a number of communication algorithms, and we find that reduction trees are more efficient and scalable than the traditional parameter server approach. Third, we optionally increase the batch size to reduce the total quantity of communication during DNN training, and we identify hyperparameters that allow us to reproduce the small-batch accuracy while training with large batch sizes. When training GoogLeNet and Network-in-Network on ImageNet, we achieve a 47x and 39x speedup, respectively, when training on a cluster of 128 GPUs.
Forrest N. Iandola, Matthew W. Moskewicz, Khalid Ashraf, Kurt Keutzer
CVPR3
2015 Audio-Based Multimedia Event Detection with DNNs and Sparse Sampling
abstract
This paper presents advances in analyzing audio content information to detect events in videos, such as a parade or a birthday party. We developed a set of tools for audio processing within the predominantly vision-focused deep neural network (DNN) framework Caffe. Using these tools, we show, for the first time, the potential of using only a DNN for audio-based multimedia event detection. Training DNNs for event detection using the entire audio track from each video causes a computational bottleneck. Here, we address this problem by developing a sparse audio frame-sampling method that improves event-detection speed and accuracy. We achieved a 10 percentage-point improvement in event classification accuracy, with a 200x reduction in the number of training input examples as compared to using the entire track. This reduction in input feature volume led to a 16x reduction in the size of the DNN architecture and a 300x reduction in training time. We applied our method using the recently released YLI-MED dataset and compared our results with a state-of-the-art system and with results reported in the literature for TRECVIDMED. Our results show much higher MAP scores compared to a baseline i-vector system - at a significantly reduced computational cost. The speed improvement is relevant for processing videos on a large scale, and could enable more effective deployment in mobile systems.
Khalid Ashraf, Benjamin Elizalde, Forrest N. Iandola, Matthew W. Moskewicz, Julia Bernd, Gerald Friedland, Kurt Keutzer
ICMR1
2012 File Management in a Mobile DHT-based P2P Environment
abstract
The emergence of mobile P2P systems is largely due to the evolution of mobile devices into powerful information processing units. The relatively structured context that results from the mapping of mobile patterns of behaviour onto P2P models is however constrained by the vulnerabilities of P2P networks and the inherent limitations of mobile devices. Whilst the implementation of P2P models gives rise to security and reliability issues, the deployment of mobile devices is subject to efficiency constraints. This paper presents the development and deployment of a mobile P2P system based on distributed hash tables (DHT). The secure, reliable and efficient dispersal of files is taken as an application. Reliability was addressed by providing two methods for file dispersal: replication and erasure coding. Security constraints were catered for by incorporating an authentication mechanism and three encryption schemes. Lightweight versions of various algorithms were selected in order to attend to efficiency requirements.
Khalid Ashraf, Rachid Anane, Behzad Bordbar
AINA1