Unified Density-Aware Image Dehazing and Object Detection in Real-World Hazy Scenes
Zhengxi Zhang (Nanjing University of Science & Technology), Liang Zhao (Nanjing University of Science & Technology), Yunan Liu (Nanjing University of Science & Technology), Shanshan Zhang (Max Planck Institute for Informatics)*, Jian Yang (Nanjing University of Science and Technology)
Keywords: Deep Learning for Computer Vision
Abstract:
It is an important yet challenging task to detect objects on hazy images in real-world applications. The major challenge comes from low visual quality and large haze density variations. In this work, we aim to jointly solve the image dehazing and the object detection tasks in real hazy scenarios by using haze density as prior knowledge. Our proposed Unified Dehazing and Detection (UDnD) framework consists of three parts: a residual-aware haze density classifier, a density-aware dehazing network, and a density-aware object detector. First, the classifier exploits the residuals of hazy images to accurately predict density levels, which provide rich domain knowledge for the subsequent two tasks. Then, we design respectively a High-Resolution Dehazing Network (HRDN) and a Faster R-CNN-based multi-domain object detector to leverage the extracted density information and tackle hazy object detection. Experiments demonstrate that UDnD performs favorably against other methods for object detection in real-world hazy scenes. Also, HRDN achieves better results than state-of-the-art dehazing methods in terms of PSNR and SSIM. Hence, HRDN can conduct haze removal effectively, based on which UDnD is able to provide high-quality detection results.