Stateful multicast protocols manage multicast group memberships by maintaining state information about active groups and their members. They have seen limited adoption in the modern internet due to lack of scalability, simplicity, and flexibility. Although stateless multicast protocols, like BIER, eliminate extensive state management, they still face complex tree computation and limited scalability for concurrent requests. In this paper, we propose Hawkeye, a stateless multicast mechanism with deep reinforcement learning (DRL) for real-time responses to dynamic multicast requests with near-optimal multicast TE performance. This mechanism is suited for Software-Defined Networking (SDN) environment where the controller has a global view of the network and supports flexible configuration of network resources for traffic engineering. For real-time responses to multicast requests, we leverage DRL enhanced by a temporal convolutional network (TCN) to model the sequential feature of dynamic group membership, and thus are able to build multicast trees proactively for upcoming requests. We develop a novel source aggregation mechanism to facilitate the convergence of the DRL agent under high volume of multicast requests. Moreover, to improve the practicality and robustness of Hawkeye, we design incremental deployment and single failure handling mechanisms, which take advantages of source aggregation and fit well with multicast routing. Evaluation with real-world topologies and multicast requests demonstrates that Hawkeye responds effectively to dynamic multicast requests. Itoffers rapid routing decisions, e.g., making routing decisions in under 5ms on a tested topology, and reduces path latency variation by up to 89.5%, with less than a 10% increase in bandwidth consumption compared to the offline theoretical minimum.

Abstract This paper proposes a distributed multimedia delivery mobile network for video streaming in 3rd generation (3G) mobile communications. The joint design of layered coding (LC) and multiple description coding (MDC) is employed to address the bandwidth fluctuations and packet loss problems in the wireless network and to further enhance the error resilience tools in MPEG‐4. A new Internet protocol (IP) differentiated services (DiffServ) video marking algorithm is presented to support an unequal error protection of the LC components. Both intra‐RAN (radio access network) handoff and inter‐RAN handoff procedures are discussed, which provide path diversity to combat streaming video outage due to handoff in the universal mobile telecommunications system (UMTS). Computer simulation results demonstrate that: (1) the newly proposed IP DiffServ video marking algorithm is more suitable for video streaming in an IP mobile network as compared with the previously proposed algorithm, and (2) the proposed handoff procedures have better performance in terms of handoff latency, end‐to‐end delay and handoff scalability than that in UMTS. Copyright © 2005 John Wiley & Sons, Ltd.