CS-MCNet:A Video Compressive Sensing Reconstruction Network with Interpretable Motion Compensation
Bowen Huang (Fudan University)*, Jinjia Zhou (Hosei University), Xiao Yan (Fudan University), Ming'e Jing (Fudan University), Rentao Wan (Fudan University), Yibo Fan (Fudan University)
Keywords: Low-level Vision, Image Processing
Abstract:
In this paper, a deep neural network with interpretable motion compensation called CS-MCNet is proposed to realize high-quality and real-time decoding of video compressive sensing. Firstly, explicit multi-hypothesis motion compensation is applied in our network to extract correlation information of adjacent frames, which improves the recover performance. And then, a residual module further narrows down the gap between reconstruction result and original signal. The overall architecture is interpretable by using algorithm unrolling, Which brings the benefits of being able to transfer prior knowledge about the conventional algorithms. As a result, a PSNR of 22dB can be achieved at 64x compression rate, which is about 4% to 9% better than state-of-the-art methods. In addition, due to the feed-forward architecture, the reconstruction can be processed by our network in real time and up to three orders of magnitude faster than traditional iterative methods.
SlidesLive
Similar Papers
Lossless Image Compression Using a Multi-Scale Progressive Statistical Model
Honglei Zhang (Nokia Technologies)*, Francesco Cricri (Nokia Technologies), Hamed R. Tavakoli (Nokia Technologies), Nannan Zou (Tampere University), Emre Aksu (Nokia Technologies), Miska M. Hannuksela (Nokia Technologies)

Fast and Differentiable Message Passing on Pairwise Markov Random Fields
Zhiwei Xu (Australian National University)*, Thalaiyasingam Ajanthan (ANU), RICHARD HARTLEY (Australian National University, Australia)

HPGCNN: Hierarchical Parallel Group Convolutional Neural Networks for Point Clouds Processing
Jisheng Dang (Lanzhou Jiaotong University), Jun Yang (School of Electronic and Information Engineering, Lanzhou Jiaotong University)*
