The promises of multipath transport are to aggregate bandwidth, improve resource utilisation and enhance reliability. In this article, we demonstrate that the way multipath coupled congestion control is defined today leads to a suboptimal resource utilisation when network paths are disjoint, i.e., they do not share a bottleneck link. With growing interest in standardising Multipath QUIC (MPQUIC), we have implemented the practical Shared Bottleneck Detection (SBD) algorithm from RFC8382 in MPQUIC (MPQUIC-SBD). Through extensive experiments, we evaluate MPQUIC-SBD in the context of video streaming with various Adaptive Bitrate (ABR) algorithms, addressing both ABR classes of rule- and learning-based solutions. We demonstrate that MPQUIC-SBD accurately detects shared bottlenecks over 90% of the time, depending on the ABR algorithm, as the size of the video segments increases. In non-shared bottleneck scenarios, when MPQUIC-SBD detects that its QUIC subflows do not share the same network resources, it decouples their congestion windows accordingly, enabling video throughput gains of up to 37% compared to MPQUIC. These gains translate directly into improved video quality metrics, including higher bitrate, better resolution and reduced buffering, resulting in an enhanced quality of experience for users.

The rise of Microservices architectures has introduced a surge in the demand for containerized software provisioning and orchestration. Kubernetes is a leading container orchestration platform widely adopted for its efficient management of containerized applications within cloud datacenters. However, the proliferation of containerized applications, particularly in resource-constrained environments like Internet of Things (IoT) edge devices, has prompted numerous software vendors to release lightweight Kubernetes-derived platforms, tailored for streamlined deployment in such infrastructures. Despite this, selecting the most suitable distribution for edge-based IoT applications remains a challenge due to a lack of comprehensive studies in this domain. This paper presents a comprehensive model for evaluating the performance of lightweight Container Orchestration Distributions (CODs), incorporating resource usage, control-plane performance, and data-plane performance metrics. Also, we conduct a comparative empirical analysis of four prominent CODs (i.e., k0s, k3s, Microk8s, and Microshift) by focusing on their suitability for edge environments. Our findings reveal that k3s is the overall best-performant COD.

While Internet Service Providers (ISPs) have traditionally focused on marketing network throughput, it is becoming increasingly recognized that network latency also plays a significant role for the quality of experience. However, many ISPs lack the means to continuously monitor the latency of their network. In this work, we present a method to continuously monitor and aggregate network latency per subnet directly in the Linux kernel by leveraging eBPF. We deploy this solution on a middlebox in an ISP network and collect an extensive dataset of latency measurements for both the internal and external parts of the network. We find that our monitoring solution can monitor all subscriber traffic while maintaining a low overhead of only around 1% additional CPU utilization. Our analysis of the latency data reveals a wide latency tail in the last-mile access, which grows during busy periods in the evening. Furthermore, we dissect the external network latency and uncover the latency profiles for the most popular autonomous systems.

Every Web session involves a DNS resolution. While, in the last decade, we witnessed a promising trend towards an encrypted Web in general, DNS encryption has only recently gained traction with the standardisation of DNS over TLS (DoT) and DNS over HTTPS (DoH). Meanwhile, the rapid rise of QUIC deployment has now opened up an exciting opportunity to utilise the same protocol to not only encrypt Web communications, but also DNS. In this paper, we evaluate this benefit of using QUIC to coalesce name resolution via DNS over QUIC (DoQ), and Web content delivery via HTTP/3 (H3) with 0-RTT. We compare this scenario using several possible combinations where H3 is used in conjunction with DoH and DoQ, as well as the unencrypted DNS over UDP (DoUDP). We observe, that when using H3 1-RTT, page load times with DoH can get inflated by >30% over fixed-line and by >50% over mobile when compared to unencrypted DNS with DoUDP. However, this cost of encryption can be drastically reduced when encrypted connections are coalesced (DoQ + H3 0-RTT), thereby reducing the page load times by 1/3 over fixed-line and 1/2 over mobile, overall making connection coalescing with QUIC the best option for encrypted communication on the Internet.

The promises of multipath transport is to aggregate bandwidth and improve resource utilisation and reliability. We demonstrate in this paper that the way multipath coupled congestion control is defined today RFC6359 leads to a sub-optimal resource utilisation when network paths are mainly disjoint, i.e., they do not share a bottleneck. With growing interest to standardise Multipath QUIC (MPQUIC), we implement the practical shared bottleneck detection (SBD) algorithm from RFC8382 in MPQUIC, namely MPQUIC-SBD. We evaluate MPQUIC-SBD through extensive emulation experiments in the context of video streaming. We show that MPQUIC-SBD is able to correctly detect shared bottlenecks over 90% of the time as the video segments' size increase depending on the Adaptive Bitrate (ABR) algorithm. In non-shared bottleneck scenarios, MPQUIC-SBD results in video throughput gains of more than 13% compared to MPQUIC, which directly translates into better video quality metrics.

Abstract Network latency is a critical factor for the perceived quality of experience for many applications. With an increasing focus on interactive and real-time applications, which require reliable and low latency, the ability to continuously and efficiently monitor latency is becoming more important than ever. Always-on passive monitoring of latency can provide continuous latency metrics without injecting any traffic into the network. However, software-based monitoring tools often struggle to keep up with traffic as packet rates increase, especially on contemporary multi-Gbps interfaces. We investigate the feasibility of using eBPF to enable efficient passive network latency monitoring by implementing an evolved Passive Ping (ePPing). Our evaluation shows that ePPing delivers accurate RTT measurements and can handle over 1 Mpps, or correspondingly over 10 Gbps, on a single core, greatly improving on state-of-the-art software based solutions, such as PPing.

Traffic optimization and smart buffering are fundamental to achieve both great application performance and resource efficiency in data centers with heterogeneous workloads, including incast and elephant traffics. However, general performance models providing insights on how various factors affect traffic performance metrics needed by these management functions are missing. For the special case of incast, the existing models are analytical ones, either tightly coupled with a particular protocol version or specific to certain empirical data. Motivated by this observation, this paper proposes an SDN-enabled machine-learning-based performance modeling approach in data center networks that leverages random forest predictions. Evaluations based on datasets constructed through intensive NS-3 simulations show that we can achieve accurate predictions of incast and elephant performance metrics based on various features. With this performance modeling capability, smart buffering schemes or traffic optimization algorithms could anticipate and efficiently optimize system parameters adjustment to achieve optimal performance continuously in data centers.

Cellular networks are continuously evolving to allow improved throughput and low latency performance for applications. However, it has been shown that, due to buffer over-provisioning, TCP's standard loss-based congestion control algorithms (CCAs) can cause long delays in cellular networks. The QUIC transport protocol and the Bottleneck Bandwidth and Round-trip propagation time (BBR) congestion control are both proposed in response to shortcomings observed in TCP and loss-based CCAs. Despite its notable advantages, BBR can experience suboptimal delay performance in cellular networks due to one of its underlying design choices: the maximum bandwidth filter at the sender. In this work, we leverage QUIC's extensibility to enhance BBR. Instead of using the ACK rate observed at the sender side, we apply a more fitting delivery rate calculated at the receiver. Our 5G-trace-based emulation experiments in CloudLab suggest that our modified QUIC could significantly improve latency without any notable effect on the throughput: In particular, in some of our experiments, we observe up to 39% reduction of the round-trip time (RTT) with a worstcase throughput reduction of 2.7%.

Cellular networks have evolved to support high peak bitrates with low loss rates as observed by the higher layers. However, applications and services running over cellular networks are now facing other difficult congestion-related challenges, most notably a highly variable link capacity and bufferbloat. To overcome these issues and improve performance of network traffic in 4G/5G cellular networks, a number of in-network and end-to-end solutions have been proposed. Fairness between interacting congestion control algorithms (CCAs) has played an important role in the type of CCAs considered for research and deployment. The placement of content closer to the user and the allocation of per-user queues in cellular networks has increased the likelihood of a cellular access bottleneck and reduced the extent of flow interaction between multiple users. This has resulted in renewed interest in end-to-end CCAs for cellular networks by opening up room for research and exploration. In this work, we present end-to-end CCAs that target a high throughput and a low latency over highly variable network links, and classify them according to the way they address the congestion control. The work also discusses the deployability of the algorithms. In addition, we provide insights into possible future research directions, such as coping with a higher degree of variability, interaction of CCAs in a shared bottleneck, and avenues for synergized research, such as CCAs assisted by software defined networking and network function virtualization. We hope that this work will serve as a starting point for systematically navigating through the expanding number of cellular CCAs.

Fifth Generation (5G) networks provide high throughput and low delay, contributing to enhanced Quality of Experience (QoE) expectations. The exponential growth of multimedia traffic pose dichotomic challenges to simultaneously satisfy network operators, service providers, and end-user expectations. Building QoE-aware networks that provide run-time mechanisms to satisfy end-users' expectations while the end-to-end network Quality of Service (QoS) varies is challenging, and motivates many ongoing research efforts. The contribution of this work is twofold. Firstly, we present a reproducible data-driven framework with a series of pre-installed Dynamic Adaptive Streaming over HTTP (DASH) tools to analyse state-of-art Adaptive Bitrate Streaming (ABS) algorithms by varying key QoS parameters in static and mobility scenarios. Secondly, we introduce an interactive Jupyter notebook and Binder service providing a live analytical environment, which processes the output dataset of the framework and compares the relationship of five QoE models, three QoS parameters (RTT, throughput, packets), and seven different video KPIs.

Multipath transport protocols utilize multiple network paths (e.g., WiFi and cellular) to achieve improved performance and reliability, compared with their single-path counterparts. The scheduler of a multipath transport protocol determines how to distribute the data packets onto different paths. However, state-of-the-art multipath schedulers face the challenge when dealing with heterogeneous paths with dynamic path characteristics (i.e., packet loss, fluctuation of delay). In this paper, we propose Peekaboo, a novel learning-based multipath scheduler that is aware of the dynamic characteristics of the heterogeneous paths. Peekaboo is able to learn scheduling decisions to adopt over time based on the current path characteristics and dynamicity levels - from both deterministic and stochastic perspectives. We implement Peekaboo in Multipath QUIC (MPQUIC) and compare it with state-of-the-art multipath schedulers for a wide range of dynamic heterogeneous environments, upon both emulated and real networks. Our results show that Peekaboo outperforms the other schedulers by up to 31.2% in emulated networks and up to 36.3% in real network scenarios.

Most Internet hosts today support multiple access technologies and network interfaces. Multipath transport protocols, like MPTCP, are being deployed (e.g., in smartphones), allowing transparent simultaneous use of multiple links. Besides providing increased resilience to link failures, multipath transports may better exploit available (aggregate) capacity across all interfaces. The safest way to ensure fairness is to assume that any subflows of a multipath end-to-end connection may share bottleneck links, but knowledge of non-shared bottlenecks could allow multipath senders to exploit more capacity without being unfair to other flows. The problem of reliably detecting the existence of (non)-shared bottlenecks is not trivial and is compounded by the fact that bottlenecks may change due to traffic dynamics. In this paper we focus on practical methods to reliably group flows that share, possibly dynamic, bottlenecks online and in a passive manner (i.e., without injecting measurement traffic). We introduce a novel dynamic clustering algorithm that we apply to update our previous shared bottleneck flow grouping (SBFG) method standardized by the IETF, based on delay statistics. We also adapt an offline SBFG method based on wavelet filters to enable it for online operation. These SBFG methods are evaluated by a simple testbed, rigorous simulation and real-world Internet experiments in a testbed comprised of multihomed hosts. Our results suggest that there is no clear winner, and selection of the “best” SBFG method will have to consider tradeoffs regarding accuracy, lag, and application requirements.

QUIC, fostered by Google and under standardization in the IETF, integrates some of HTTP/s, TLS, and TCP functionalities over UDP. One of its main goals is to facilitate transport protocol design, with fast evolution and innovation. However, congestion control in QUIC is still severely jeopardized by packet losses, despite implemented loss recovery mechanisms, whose behavior strongly depends on the Round Trip Time. In this paper, we design and implement rQUIC, a framework that enables FEC within QUIC protocol to improve its performance over wireless networks. The main idea behind rQUIC is to reduce QUIC's loss recovery time by making it robust to erasures over wireless networks, as compared to traditional transport protocol loss detection and recovery mechanisms. We evaluate the performance of our solution by means of extensive simulations over different type of wireless networks and for different applications. For LTE and Wifi networks, our results illustrate significant gains of up to 60% and 25% savings in the completion time for bulk transfer and web browsing, respectively.

Quick UDP Internet Connections (QUIC) is an experimental transport protocol designed to primarily reduce connection establishment and transport latency, as well as to improve security standards with default end-to-end encryption in HTTPbased applications. QUIC is a multiplexed and secure transport protocol fostered by Google and its design emerged from the urgent need of innovation in the transport layer, mainly due to difficulties extending TCP and deploying new protocols. While still under standardisation, a non-negligble fraction of the Internet's traffic, more than 7% of a European Tier1-ISP, is already running over QUIC and it constitutes more than 30% of Google's egress traffic [1].

The demand for mobile communication is continuously increasing, and mobile devices are now the communication device of choice for many people. To guarantee connectivity and performance, mobile devices are typically equipped with multiple interfaces. To this end, exploiting multiple available interfaces is also a crucial aspect of the upcoming 5G standard for reducing costs, easing network management, and providing a good user experience. Multi-path protocols, such as multi-path TCP (MPTCP), can be used to provide performance optimization through load-balancing and resilience to coverage drops and link failures, however, they do not automatically guarantee better performance. For instance, low-latency communication has been proven hard to achieve when a device has network interfaces with asymmetric capacity and delay (e.g., LTE and WLAN). For multi-path communication, the data scheduler is vital to provide low latency, since it decides over which network interface to send individual data segments. In this paper, we focus on the MPTCP scheduler with the goal of providing a good user experience for latency-sensitive applications when interface quality is asymmetric. After an initial assessment of existing scheduling algorithms, we present two novel scheduling techniques: the block estimation (BLEST) scheduler and the shortest transmission time first (STTF) scheduler. BLEST and STTF are compared with existing schedulers in both emulated and real-world environments and are shown to reduce web object transmission times with up to 51% and provide 45% faster communication for interactive applications, compared with MPTCP's default scheduler.

One of the main goals of multipath TCP (MPTCP) is to achieve higher throughput than regular TCP by utilizing multiple paths simultaneously. When these paths share a common bottleneck, MPTCP tries not to be more aggressive than a regular TCP flow. This is achieved by MPTCP's coupled congestion control mechanism that couples the increase factor of MPTCP's subflows in congestion avoidance. However, slow-start remains unchanged and behaves uncoupled for each subflow, affecting MPTCP and concurrent traffic at the bottleneck. We propose LISA, a simple algorithm for coupling MPTCP subflows in slow-start, and investigate the trade-off that this coupling entails. Our evaluations show that coupling in slow-start not only provides gains for MPTCP but also for a concurrent TCP at the bottleneck.

Multipath TCP (MPTCP) enables the simultaneous use of multiple links for bandwidth aggregation, better resource utilization and improved reliability. Its coupled congestion control intends to reap the increased bandwidth of multiple links, while avoiding being more aggressive than regular TCP flows on every used link. We argue that this leads to a very conservative behavior when paths do not share a bottleneck. Therefore, in this paper, we first quantify the penalty of the coupled congestion control for links that do not share a bottleneck. Then, in order to overcome this penalty, we design and implement a practical shared bottleneck detection (SBD) algorithm for MPTCP, namely MPTCP-SBD. Through extensive emulations, we show that MPTCP-SBD outperforms all currently deployed MPTCP coupled congestion controls by accurately detecting bottlenecks. For the non-shared bottleneck scenario, we observe throughput gains of up to 40% with two subflows and the gains increase significantly as the number of subflows increase, reaching more than 100% for five subflows. Furthermore, for the shared bottleneck scenario, we show that MPTCP-SBD remains fair to TCP. We complement the emulation results with real-network experiments justifying its safeness for deployment.

Multi-path transfer protocols such as Concurrent Multi-Path Transfer for SCTP and Multi-Path TCP (MPTCP), are becoming increasingly popular, due to widespread deployment of smartphones with multi-homing support. Although the idea of using multiple interfaces simultaneously to improve application throughput is tempting, does transmission over multiple interfaces always provide benefits especially in realistic setup? In this paper, we first show that multi-path transfer might actually have a negative impact in real-world scenarios with mobile broadband and wireless LAN networks. We then introduce our Dynamic Relative Path Scoring (DRePaS) algorithm that continuously evaluates the contribution of paths to the overall performance and dynamically influences the scheduling decisions to make best use of the paths for the overall system performance. We show that DRePaS outperforms the current MPTCP implementation in terms of throughput and application delay, especially when the links are heterogeneous.

Today, most of the smart phones are equipped with two network interfaces: Mobile Broadband (MBB) and Wireless Local Area Network (WLAN). Multi-path transport protocols provide increased throughput or reliability, by utilizing these interfaces simultaneously. However, multi-path transmission over networks with very different QoS characteristics is a challenge. In this paper, we studied Multi-Path TCP (MPTCP) in heterogeneous networks, specifically MBB networks and WLAN. We first investigate the effect of bufferbloat in MBB on MPTCP performance. Then, we propose a bufferbloat mitigation algorithm: Multi-Path Transport Bufferbloat Mitigation (MPT-BM). Using our algorithm, we conduct experiments in real operational networks. The experimental results show that MPT-BM outperforms the current MPTCP implementation by increasing the application goodput quality and decreasing MPTCP's buffer delay, jitter and buffer space requirements.

Practical shared bottleneck detection has proved to be a difficult problem. We present a novel passive approach using efficient estimates of time and frequency domain summary statistics. The approach is not CPU nor network intensive, and has numerous potential applications in the Internet. Simulations and tests over the Internet and 3G cellular network show its efficacy in grouping flows correctly.

We present Nornet Edge (NNE), a dedicated infrastructure for measurements and experimentation in mobile broadband networks. NNE is unprecedented in size, consisting of more than 400 measurement nodes geographically distributed all over Norway. Each measurement node is a Linux-based embedded computer, and is connected to multiple mobile broadband providers. In addition, NNE includes an extensive backend system for deploying and managing experiments and collecting data. NNE makes it possible to run long-term measurement experiments to assess and compare quality and performance across different network operators on a national scale. Particular focus is put on allowing experiments to run in parallel on multiple network connections, and on collecting rich context information related to the experiments. In this paper we give a detailed presentation of NNE, and describe three different measurement experiments that illustrate how the infrastructure can be used. We also provide a roadmap for further development of NNE.