In this paper, we design a resource block (RB) oriented power pool (PP) for semi-grant-free non-orthogonal multiple access (SGF-NOMA) in the presence of residual errors resulting from imperfect successive interference cancellation (SIC). In the proposed method, the BS allocates one orthogonal RB to each grant-based (GB) user, and determines the acceptable received power from grant-free (GF) users and calculates a threshold against this RB for broadcasting. Each GF user as an agent, tries to find the optimal transmit power and RB without affecting the quality-of-service (QoS) and ongoing transmission of the GB user. To this end, we formulate the transmit power and RB allocation problem as a stochastic Markov game to design the desired PPs and maximize the long-term system throughput. The problem is then solved using multi-agent (MA) deep reinforcement learning algorithms, such as double deep Q networks (DDQN) and Dueling DDQN due to their enhanced capabilities in value estimation and policy learning, with the latter performing optimally in environments characterized by extensive states and action spaces. The agents (GF users) undertake actions, specifically adjusting power levels and selecting RBs, in pursuit of maximizing cumulative rewards (throughput). Simulation results indicate computational scalability and minimal signaling overhead of the proposed algorithm with notable gains in system throughput compared to existing SGF-NOMA systems. We examine the effect of SIC error levels on sum rate and user transmit power, revealing a decrease in sum rate and an increase in user transmit power as QoS requirements and error variance escalate. We demonstrate that PPs can benefit new (untrained) users joining the network and outperform conventional SGF-NOMA without PPs in spectral efficiency.

The performance of a coherent delay-locked tracking scheme for direct-sequence/spread-spectrum systems using half-sine or triangular chip waveforms for early and late despreading sequences is analyzed. The effect of band-limiting on the received signals is considered. Mean time to lose lock (MTLL) and root mean square (rms) tracking error of the delay-locked loop (DLL) are compared with that of a conventional DLL which uses rectangular chip despreading waveforms. Linear and nonlinear (based on the renewal process approach) analyses are employed to evaluate the performance of the DLL. Results show that the use of either the half-sine or triangular chip waveform reduces the rms tracking error and increases the MTLL considerably when the early-late spacing is approximately between 0.7-1.3 chip times. The results apply in particular to the commonly used DLL using one chip early-late spacing. Computer simulation for band-limited signals confirms the analytical results. The use of these despreading chip waveforms also reduces tracking offset in multipath environments.