Achieving real-time and accuracy on embedded platforms has always been the pursuit of road segmentation methods. To this end, they have proposed many lightweight networks. However, they ignore the fact that roads are “stuff” (background or environmental elements) rather than “things” (specific identifiable objects), which inspires us to explore the feasibility of representing roads with low-level instead of high-level features. Surprisingly, we find that the primary stage of mainstream network models is sufficient to represent most pixels of the road for segmentation. Motivated by this, we propose a Low-level Feature Dominated Road Segmentation network (LFD-RoadSeg). Specifically, LFD-RoadSeg employs a bilateral structure. The spatial detail branch is firstly designed to extract low-level feature representation for the road by the first stage of ResNet-18. To suppress texture-less regions mistaken as the road in the low-level feature, the context semantic branch is then designed to extract the context feature in a fast manner. To this end, in the second branch, we asymmetrically downsample the input image and design an aggregation module to achieve comparable receptive fields to the third stage of ResNet-18 but with less time consumption. Finally, to segment the road from the low-level feature, a selective fusion module is proposed to calculate pixel-wise attention between the low-level representation and context feature, and suppress the non-road low-level response by this attention. On KITTI-Road, LFD-RoadSeg achieves a maximum F1-measure (MaxF) of 95.21% and an average precision of 93.71%, while reaching 238 FPS on a single TITAN Xp and 54 FPS on a Jetson TX2, all with a compact model size of just 936k parameters. The source code is available at https://github.com/zhouhuan-hust/LFD-RoadSeg.

In this paper, we address the problem of detecting 3D ob-jects from multi-view images. Current query-based methods rely on global 3D position embeddings (PE) to learn the ge-ometric correspondence between images and 3D space. We claim that directly interacting 2D image features with global 3D PE could increase the difficulty of learning view trans-formation due to the variation of camera extrinsics. Thus we propose a novel method based on CAmera view Position Embedding, called CAPE. We form the 3D position embed-dings under the local camera-view coordinate system instead of the global coordinate system, such that 3D position em-bedding is free of encoding camera extrinsic parameters. Furthermore, we extend our CAPE to temporal modeling by exploiting the object queries of previous frames and encoding the ego motion for boosting 3D object detection. CAPE achieves the state-of-the-art performance (61.0% NDS and 52.5% mAP) among all LiDAR-free methods on nuScenes dataset. Codes and models are available.11Codes of Paddle3D and PyTorch Implementation.

Monocular road segmentation is a fundamental component of autonomous driving. High accuracy has always been a focus of the community for this task. However, the exploration of high-speed methods is still lacking. This limits the prevalence of the monocular road segmentation method. In this paper, an efficient encoder-decoder network is proposed for segmenting the road from a single image. Specifically, to achieve high-speed inference, we leverage a shallow encoder for feature extraction and design a lightweight decoder for feature resolution recovery. To avoid the accuracy drop caused by network simplification, we introduce an efficient asymmetric dilated block to improve the ability of features to distinguish drivable/nondrivable roads to maintain the performance without excess computation. Experiments on three datasets verify the effectiveness of our method. On KITTI-Road, our approach ranks second among all monocular methods and even achieves a competitive performance compared to multimodal methods, with an inference speed over 135 FPS on a single TITAN Xp, which is at least 20 times faster than the state-of-the-art monocular method. Furthermore, our approach can be deployed on the embedded platform Jetson TX2 and achieves a speed of over 80 FPS. Codes will be available athttps://github.com/gongshichina/FastRoadSeg.