Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Milad Alizadeh

dblp:119/9247 · DBLP profile ↗
← Back
6ranked-venue papers
5as first author
1since 2021 · last 2022
0000-0002-3097-0214ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 3 first-author · 1 since 2021Computer networks · 1 · 1 first-authorGraphics, computer vision, multimedia, augmented reality and games · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Efficient and distributed learning · 98% Image recognition and object detection · 2%

Topics — the 9 heaviest of 9, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning
model compression
2.052022
Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients · ICLR 2022
Gradient $\ell_1$ Regularization for Quantization Robustness · ICLR 2020
An Empirical study of Binary Neural Networks' Optimisation · ICLR (Poster) 2019
Machine learning › Efficient and distributed learning › model compression › quantization › quantized neural network
binary neural network
1.032019
An Empirical study of Binary Neural Networks' Optimisation · ICLR (Poster) 2019
Using Pre-trained Full-Precision Models to Speed Up Training Binary Networks For Mobile Devices · MobiSys 2018
Deterministic Binary Filters for Convolutional Neural Networks · IJCAI 2018
Machine learning › Efficient and distributed learning › model compression
pruning
0.612022
Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients · ICLR 2022
Machine learning › Efficient and distributed learning › model compression › pruning › DNN pruning
pruning at initialization
0.612022
Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients · ICLR 2022
Machine learning › Efficient and distributed learning › model compression
quantization
0.412020
Gradient $\ell_1$ Regularization for Quantization Robustness · ICLR 2020
Machine learning › Efficient and distributed learning › model compression › quantization
quantization robustness
0.412020
Gradient $\ell_1$ Regularization for Quantization Robustness · ICLR 2020
Machine learning › Efficient and distributed learning › efficient training
training acceleration
0.312018
Using Pre-trained Full-Precision Models to Speed Up Training Binary Networks For Mobile Devices · MobiSys 2018
Computer vision › Image recognition and object detection
image classification
0.112018
Deterministic Binary Filters for Convolutional Neural Networks · IJCAI 2018
Machine learning › Efficient and distributed learning › model compression › quantization
quantized neural network
0.112018
Using Pre-trained Full-Precision Models to Speed Up Training Binary Networks For Mobile Devices · MobiSys 2018

Methods — techniques the papers use, named apart from their topics

meta-gradient · 0.6gradient regularization · 0.4weight initialization · 0.3knowledge transfer from pre-trained models · 0.3convolutional neural network · 0.3binary filters · 0.3
YearPublicationVenuePosition
2022 Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients
Milad Alizadeh, Shyam A. Tailor, Luisa M. Zintgraf, Joost van Amersfoort, Sebastian Farquhar, Nicholas D. Lane, Yarin Gal
ICLR1
2020 Gradient $\ell_1$ Regularization for Quantization Robustness
Milad Alizadeh, Arash Behboodi, Mart van Baalen, Christos Louizos, Tijmen Blankevoort, Max Welling
ICLR1
2019 An Empirical study of Binary Neural Networks' Optimisation
Milad Alizadeh, Javier Fernández-Marqués, Nicholas D. Lane, Yarin Gal
ICLR (Poster)1
2018 Deterministic Binary Filters for Convolutional Neural Networks
abstract
We propose Deterministic Binary Filters, an approach to Convolutional Neural Networks that learns weighting coefficients of predefined orthogonal binary basis instead of the conventional approach of learning directly the convolutional filters. This approach results in model architectures with significantly fewer parameters (4x to 16x) and smaller model sizes (32x due to the use of binary rather than floating point precision). We show our deterministic filter design can be integrated into well-known network architectures (such as ResNet and SqueezeNet) with as little as 2% loss of accuracy (under datasets like CIFAR-10). Under ImageNet, they result in 3x model size reduction compared to sub-megabyte binary networks while reaching comparable accuracy levels.
Vincent W. S. Tseng, Sourav Bhattacharya, Javier Fernández-Marqués, Milad Alizadeh, Catherine Tong, Nicholas D. Lane
IJCAI4
2018 Using Pre-trained Full-Precision Models to Speed Up Training Binary Networks For Mobile Devices
abstract
Binary Neural Networks (BNNs) are well-suited for deploying Deep Neural Networks (DNNs) to small embedded devices but state-of-the-art BNNs need to be trained from scratch for a long time. We show how weights from a pre-trained full-precision model can be used to speed-up training of binary networks. We show that for CIFAR-10, accuracies within 1% of the full-precision model can be achieved in just 5 epochs.
Milad Alizadeh, Nicholas D. Lane
MobiSys1
2012 A Comparative Study of Mixed Traffic Scenarios for Different Scheduling Algorithms in WiMAX
abstract
WiMAX promises an advanced framework to support Quality-of-Service (QoS) requirements of different types of applications and scheduling is a key part in its QoS provisioning. The scheduling algorithms used in this paper are based on our proposed Greedy-Latency scheduler, a modified form of Greedy algorithm which can guarantee delay requirements of real-time applications while optimising the system throughput. Our study of TCP performance in WiMAX shows that unlike UDP traffic, there are fluctuations in TCP throughput even for low traffic loads. It is seen that employing Automatic Repeat reQuest (ARQ) and setting the right TCP window size are crucial for a stable optimal TCP performance. WiMAX QoS mechanism can successfully maintain the inter-class priority between TCP traffic in Best Effort (BE) class and UDP in higher priority Real-Time Polling Service (rtPS) class. For intra-class scenarios, it is observed that TCP flows in general need a protection mechanism as the UDP traffic tend to seize the channel. The proposed Greedy-Scheduler can provide better intra-class protection for TCP flows due to its packet dropping policy.
Milad Alizadeh, Rudzidatul Akmam Dziyauddin, Dritan Kaleshi, Angela Doufexi
VTC Spring1