In this paper, we deal with the problem of tracking control for a class of uncertain nonlinear systems in strictfeedback form subject to completely unknown system nonlinearities, hard constraints on full states, and unknown time-varying bounded disturbances. Integral barrier Lyapunov functionals are constructed to handle the unknown affine control gains (g(·)) with state constraints simultaneously. This removes the need on the knowledge of control gains for control design and avoids the conservative step of transforming original state constraints into new bounds on tracking errors. Neural networks (NNs) are used to approximate the unknown continuous packaged functions. To enhance the robustness, adapting parameters are developed to compensate the unknown bounds on NNs approximations and external disturbances. Design parameters-dependent feasibility conditions are formulated as sufficient conditions for the existence of feasible design parameters to guarantee the state constraints, and an offline constrained optimization step is proposed to obtain the optimal design parameters prior to the implementation of the proposed control. It is proved that the proposed control can guarantee the semiglobal uniform ultimate boundedness of all signals in closed-loop system, all states are ensured to remain in the predefined constrained state space, and tracking error converges to an adjustable neighborhood of the origin by choosing appropriate design parameters. Simulations are performed to validate the proposed control.