With the rapid development of 5G mobile communication and intelligent vehicles, efficient and reliable vehicle-to-vehicle communication is recognized as one of the key technologies for the next generation of wireless networks in the future. Due to the rapid changes in the wireless channel due to the high mobility of vehicles, the traditional resource allocation technology is no longer suitable for the current vehicle network. This paper proposes a joint resource allocation method for the internet of vehicles communication based on the proximal policy optimization algorithm. In this paper, a joint optimization scheme of discrete and continuous resources suitable for the internet of vehicles communication is designed to effectively meet the strict requirements of vehicle-mounted communication. Simulation results show that the proposed allocation method can maximize the system capacity and satisfy the delay constraints of vehicle-to-vehicle communication.