Remote driving, an emergent technology enabling remote operation of vehicles, presents a significant challenge due to the necessity of transmitting substantial volumes of image data from the vehicle to a central server. This requirement outpaces the capacity of traditional communication methods, emphasizing the need for efficient data communication. We propose a framework using semantic communication, specifically through a semantic segmentation-based method, which reduces the communication cost by transmitting meaningful semantic information rather than bit-wise data. Addressing the challenge of inconsistencies across knowledge bases in semantic communication, we present a blockchain-based, edge-assisted knowledge base management system. This system leverages edge nodes to manage multiple, geographically and contextually diverse knowledge bases while ensuring security through blockchain's tamper-resistant nature. Furthermore, blockchain sharding is employed to manage different knowledge bases for varying tasks, thereby enhancing the blockchain's throughput. Experimental results showed a great reduction in latency by sharding and an increase in model accuracy, confirming our framework's effectiveness.