ABSTRACT Federated Learning (FL) has emerged as an innovative approach for distributed neural networks, allowing multiple clients to collaboratively train a model without centralising their data, thus preserving decentralisation and data privacy. This review provides a comprehensive discussion of FL's core concepts, including its components, key challenges, and distinctions from traditional machine learning. The paper outlines the various types of FL, highlighting applications in privacy‐sensitive fields like healthcare and finance. It also addresses recent advancements in self‐supervised learning, personalisation, and multi‐modal applications within FL, as well as the integration of blockchain technology for enhanced privacy. Key advantages of FL are discussed, such as reduced communication overhead through the transmission of model parameters instead of raw data, which minimises network load and enhances privacy protection. Furthermore, the paper explores emerging questions for FL development, including scalability, fairness, and system standardisation. Real‐world examples, such as Google Gboard and brain tumour segmentation, are presented to illustrate FL's practical impact. Finally, the paper discusses future directions, including potential integration with other AI techniques like reinforcement learning and transfer learning. This review provides valuable insights for researchers and professionals who are new to FL or seek a broader understanding of its ecosystem. While there are few studies that explore limited aspect of FL, this review adopts a holistic approach and covers all aspects of FL including foundational concepts, implementation, challenges faced by FL, and real‐world implementation. The broader scope, which spans FL from concepts to practical implementation, makes it particularly distinctive and a valuable contribution.

The ubiquity of camera-enabled devices has led to large amounts of unlabeled image data being produced at the edge. The integration of self-supervised learning (SSL) and federated learning (FL) into one coherent system can potentially offer data privacy guarantees while also advancing the quality and robustness of the learned visual representations without needing to move data around. However, client bias and divergence during FL aggregation caused by data heterogeneity limits the performance of learned visual representations on downstream tasks. In this paper, we propose a new aggregation strategy termed Layer-wise Divergence Aware Weight Aggregation (L-DAWA) to mitigate the influence of client bias and divergence during FL aggregation. The proposed method aggregates weights at the layer-level according to the measure of angular divergence between the clients’ model and the global model. Extensive experiments with cross-silo and cross-device settings on CIFAR-10/100 and Tiny ImageNet datasets demonstrate that our methods are effective and obtain new SOTA performance on both contrastive and non-contrastive SSL approaches.

We propose a Video Colorization with Hybrid Generative Adversarial Network (VCGAN), an improved approach to video colorization using end-to-end learning and recurrent architecture. The VCGAN addresses two prevalent issues in the video colorization domain: Temporal consistency and the unification of colorization network and refinement network into a single architecture. To enhance colorization quality and spatiotemporal consistency, the mainstream of the generator in VCGAN is assisted by two additional networks,i.e.,global feature extractor and placeholder feature extractor, respectively. The global feature extractor encodes the global semantics of grayscale input to enhance colorization quality, whereas the placeholder feature extractor serves as a feedback connection to encode the semantics of the previous colorized frame in order to maintain spatiotemporal consistency. If changing the input for placeholder feature extractor as grayscale input, the hybrid VCGAN also has the potential to colorize single images. To improve the color consistency of far frames, we propose a dense long-term loss that minimizes the temporal disparity of every two remote frames. Trained with colorization and temporal losses jointly, VCGAN strikes a good balance between video color vividness and spatiotemporal continuity. Experimental results demonstrate that VCGAN produces higher-quality and temporally more consistent colorful videos than existing approaches.

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information is embedded, resulting in semantic confusion and color bleeding in the final colorized image. To address these issues, we propose a fully automatic Saliency Map-guided Colorization with Generative Adversarial Network (SCGAN) framework. It jointly predicts the colorization and saliency map to minimize semantic confusion and color bleeding in the colorized image. Since the global features from pre-trained VGG-16-Gray network are embedded to the colorization encoder, the proposed SCGAN can be trained with much less data than state-of-the-art methods to achieve perceptually reasonable colorization. In addition, we propose a novel saliency map-based guidance method. Branches of the colorization decoder are used to predict the saliency map as a proxy target. Moreover, two hierarchical discriminators are utilized for the generated colorization and saliency map, respectively, in order to strengthen visual perception performance. The proposed system is evaluated on ImageNet validation set. Experimental results show that SCGAN can generate more reasonable colorized images than state-of-the-art techniques.