Pedestrian Detection

May, 2019

In this research, we presented a novel method for pedestrian detection and distance estimation using RGB-D data. We use Mask R-CNN for instance-level pedestrian segmentation, and the Semiglobal Matching algorithm for computing depth information from a pair of infrared images captured by an Intel RealSense D435 stereo vision depth camera. The resulting depth map is post-processed to mitigate erroneous or missing depth values and the distance to each pedestrian is estimated using the depth values covered by the predicted mask. Our method is evaluated on, and performs well across, a wide spectrum of outdoor lighting conditions and is able to detect and estimate the distance of pedestrians within 5m with an average accuracy of 87.7%.