The performance of nonlinear cancellation schemes is limited by the accuracy of tentative decisions. This correspondence analyzes the performance of combined trellis coded modulation and nonlinear cancellation. A scheme is proposed to make use of the redundancy of the code. It is shown that performance close to optimum can be achieved with this scheme.>

An orthogonalized input-output characterization of nonlinear bandpass quadrature amplitude modulation systems with memory is developed. The orthogonal expansion is used with a nonlinear canceller structure to counteract the effect of nonlinear distortion introduced by high-power amplifiers at the transmitter. It is shown through simulations that when the transmitted symbols are known at the canceller, relatively simple structures can eliminate the effect of the nonlinearity. Even when the transmitted symbols are not known at the canceller, the improvement in performance with the nonlinear canceller, with respect to a linear receiver, is significant.>