Bike Sharing Systems (BSS) represent a sustainable and efficient urban transportation solution. A major challenge in BSS is repositioning bikes to avoid shortage events when users encounter empty or full bike lockers. Existing algorithms unrealistically rely on precise demand forecasts and tend to overlook substantial operational costs associated with reallocations. This paper introduces a novel Cost-aware Adaptive Bike Repositioning Agent (CABRA), which harnesses advanced deep reinforcement learning techniques in dock-based BSS. By analyzing demand patterns, CABRA learns adaptive repositioning strategies aimed at reducing shortages and enhancing truck route planning efficiency, significantly lowering operational costs. We perform an extensive experimental evaluation of CABRA utilizing real-world data from Dublin, London, Paris, and New York. The reported results show that CABRA achieves operational efficiency that outperforms or matches very challenging baselines, obtaining a significant cost reduction. Its performance on the largest city comprising 1765 docking stations highlights the efficiency and scalability of the proposed solution even when applied to BSS with a great number of docking stations.

Open Radio Access Network (O-RAN) is an emerging paradigm proposed for enhancing the 5G network infrastructure. O-RAN promotes open vendor-neutral interfaces and virtualized network functions that enable the decoupling of network components and their optimization through intelligent controllers. The decomposition of base station functions enables better resource usage, but also opens new technical challenges concerning their efficient orchestration and allocation. In this paper, we propose Proactive Resource Orchestrator based on Reinforcement Learning (PRORL), a novel solution for the efficient and dynamic allocation of resources in O-RAN infrastructures. We frame the problem as a Markov Decision Process and solve it using Deep Reinforcement Learning; one relevant feature of PRORL is that it learns demand patterns from experience for proactive resource allocation. We extensively evaluate our proposal by using both synthetic and real-world data, showing that we can significantly outperform the existing algorithms, which are typically based on the analysis of static demands. More specifically, we achieve an improvement of 90% over greedy baselines and deal with complex trade-offs in terms of competing objectives such as demand satisfaction, resource utilization, and the inherent cost associated with allocating resources.

Distributed workload queues are nowadays widely used due to their significant advantages in terms of decoupling, resilience, and scaling. Task allocation to worker nodes in distributed queue systems is typically simplistic (e.g., Least Recently Used) or uses hand-crafted heuristics that require task-specific information (e.g., task resource demands or expected time of execution). When such task information is not available and worker node capabilities are not homogeneous, the existing placement strategies may lead to unnecessarily large execution timings and usage costs. In this work, we formulate the task allocation problem in theMarkov Decision Processframework, in which an agent assigns tasks to an available resource, and receives a numerical reward signal upon task completion. Our adaptive and learning-based task allocation solution, Reinforcement Learning based Queues (RLQ), is implemented and integrated with the popular Celery task queuing system for Python. We compareRLQagainst traditional solutions using both synthetic and real workload traces. On average, using synthetic workloads,RLQreduces the execution cost by approximately 70%, the execution time by a factor of at least 3×, and the waiting time by almost 7×. Using real traces, we observe an improvement of about 20% for execution cost, around 70% improvement for execution time, and a reduction of approximately 20× in waiting time. We also compareRLQwith a strategy inspired by E-PVM, a state-of-the-art solution used in Google's Borg cluster manager, showing we are able to outperform it in five out of six scenarios.