By decoupling network functions from the underlying hardware, Network Function Virtualization (NFV) allows application components to be implemented as sets of Virtual Network Functions (VNFs) chained in a specific order, represented by VNF-Forwarding Graphs (VNF-FG). Fog computing is instrumental to tap into the full potential of NFV by deploying VNFs in close proximity to end-users, thus decreasing the latency significantly. However, the mobility of end-users and the fog nodes, and the limited fog nodes coverage results in service discontinuity and may increase application delay. Application component migration offers great potential to address this issue. In this paper, we propose a component migration strategy in an NFV-based hybrid cloud/fog system considering the mobility of both end-users and fog nodes. We use the Gauss-Markov mobility model and a random walk mobility model for fog nodes and end-user devices, respectively. We modeled the problem mathematically, which minimizes the aggregated weighted function of application delay and cost. However, considering the mobility of both end-users and fog nodes makes the problem quite complex. Hence, we propose a Deep Reinforcement Learning (DRL) approach to decide where and when to migrate application components and to achieve rapid decision-making. Simulation results demonstrate that the proposed scheme performs well. It offers favorable convergence and outperforms existing algorithms in terms of application delay and migration costs.

Network Function Virtualization (NFV) is a network service deployment technology that reduces capital and operational costs while yielding flexibility and scalability for service operators. As such, an ordered chain of Virtual Network Functions (VNFs), known as a VNF Forwarding Graph (VNF-FG), should be composed and embedded into the underlying substrate network. In the literature, the composition and embedding stages of VNF-FGs are usually targeted separately, which may result in undesired solutions. In this paper, we propose our joint VNF-FG composition and embedding solution, which considers the variations of service demands while also accounting for dynamic network conditions. Specifically, our proposed solution relies on deep reinforcement learning empowered by two components for estimating dynamic parameters: network resource utilization and service demand analyzers. Moreover, to efficiently explore the problem’s large discrete action space, we utilize a specialized branching Q-network and enhance it with an action filtering mechanism. We evaluated our proposed method against joint and disjoint composition and embedding heuristics as well as versus other deep learning-based methods. Our results show that the proposed method can achieve up to a 95% improvement of embedding cost compared to our benchmarks.

The unprecedented increase of heterogeneous devices connected to the Internet, along with tight requirements of future networks, including 5G and beyond, poses new design challenges to network infrastructures. Collaborative computing, caching and communication paradigm together with artificial intelligence have the potential to enable the Next-Generation Networking Infrastructure (NGNI) that is needed to fulfill the stringent requirements of emerging applications. In this paper, we propose the SCORING project vision for reshaping the current network infrastructure towards an NGNI acting as a truly distributed, collaborative, and pervasive system that enables the execution of application-specific tasks and the storage of the related data contents in the Cloud-Edge-Mist continuum with high QoS/QoE guarantees.

With the explosive demands for data, content delivery networks are facing ever-increasing challenges to meet end-users' quality-of-experience requirements, especially in terms of delay. Content can be migrated from surrogate servers to local caches closer to end-users to address delay challenges. Unfortunately, these local caches have limited capacities, and when they are fully occupied, it may sometimes be necessary to remove their lower-priority content to accommodate higher-priority content. At other times, it may be necessary to return previously removed content to local caches. Downloading this content from surrogate servers is costly from the perspective of network usage, and potentially detrimental to the end-user QoE in terms of delay. In this paper, we consider an edge content delivery network with vehicular nodes and propose a content migration strategy in which local caches offload their contents to neighboring edge caches whenever feasible, instead of removing their contents when they are fully occupied. This process ensures that more contents remain in the vicinity of end-users. However, selecting which contents to migrate and to which neighboring cache to migrate is a complicated problem. This paper proposes a deep reinforcement learning approach to minimize the cost. Our simulation scenarios realized up to a 70% reduction of content access delay cost compared to conventional strategies with and without content migration.

Users' viewing experience in the video delivery process is of paramount importance for Content Delivery Networks (CDNs). Throughout their operations, CDN providers target the satisfaction of users' expectations in terms of Quality of Experience (QoE). In this context, CDN providers need to acquire knowledge on users' QoE and correlate observations through different video sessions in order to identify QoE degradations and investigate their potential root cause. In the absence of users' feedback on their QoE, CDN providers can monitor and analyze Key Performance Indicators (KPIs) throughout video sessions. This allows to assess the Quality of Service (QoS) offered to users, influencing their QoE. However, due to the large number of sessions handled by CDN operators, it is not possible to conduct such an analysis manually. In this work, we introduce a framework that allows to automatically group a large set of video sessions into a small number of representative clusters, with each cluster containing video sessions with similar patterns of KPIs. The framework builds upon a set of features representing the evolution of KPIs over a session. It relies on an unsupervised machine learning algorithm to form the clusters. We evaluate the framework over a real-world dataset with traffic logs relating to thousands of sessions. The obtained results underline the capabilities of the proposed framework.

Cloud computing, the recently emerged revolution in IT industry, is empowered by virtualisation technology. In this paradigm, the user’s applications run over some virtual machines (VMs). The process of selecting proper physical machines to host these virtual machines is called virtual machine placement. It plays an important role on resource utilisation and power efficiency of cloud computing environment. In this paper, we propose an imperialist competitive-based algorithm for the virtual machine placement problem called ICA-VMPLC. The base optimisation algorithm is chosen to be ICA because of its ease in neighbourhood movement, good convergence rate and suitable terminology. The proposed algorithm investigates search space in a unique manner to efficiently obtain optimal placement solution that simultaneously minimises power consumption and total resource wastage. Its final solution performance is compared with several existing methods such as grouping genetic and ant colony-based algorithms as well as bin packing heuristic. The simulation results show that the proposed method is superior to other tested algorithms in terms of power consumption, resource wastage, CPU usage efficiency and memory usage efficiency.