Wavelet-Based Network For High Dynamic Range Imaging

by   Tianhong Dai, et al.

High dynamic range (HDR) imaging from multiple low dynamic range (LDR) images has been suffering from ghosting artifacts caused by scene and objects motion. Existing methods, such as optical flow based and end-to-end deep learning based solutions, are error-prone either in detail restoration or ghosting artifacts removal. Comprehensive empirical evidence shows that ghosting artifacts caused by large foreground motion are mainly low-frequency signals and the details are mainly high-frequency signals. In this work, we propose a novel frequency-guided end-to-end deep neural network (FHDRNet) to conduct HDR fusion in the frequency domain, and Discrete Wavelet Transform (DWT) is used to decompose inputs into different frequency bands. The low-frequency signals are used to avoid specific ghosting artifacts, while the high-frequency signals are used for preserving details. Using a U-Net as the backbone, we propose two novel modules: merging module and frequency-guided upsampling module. The merging module applies the attention mechanism to the low-frequency components to deal with the ghost caused by large foreground motion. The frequency-guided upsampling module reconstructs details from multiple frequency-specific components with rich details. In addition, a new RAW dataset is created for training and evaluating multi-frame HDR imaging algorithms in the RAW domain. Extensive experiments are conducted on public datasets and our RAW dataset, showing that the proposed FHDRNet achieves state-of-the-art performance.


page 1

page 2

page 3

page 6

page 7

page 8

page 9

page 10


Attention-guided Network for Ghost-free High Dynamic Range Imaging

Ghosting artifacts caused by moving objects or misalignments is a key ch...

CAMP-Net: Context-Aware Multi-Prior Network for Accelerated MRI Reconstruction

Despite promising advances in deep learning-based MRI reconstruction met...

Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning

Most deraining works focus on rain streaks removal but they cannot deal ...

WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields

Neural Radiance Field (NeRF) has shown impressive performance in novel v...

Deep High Dynamic Range Imaging with Large Foreground Motions

This paper proposes the first non-flow-based deep framework for high dyn...

End-to-End Deep HDR Imaging with Large Foreground Motions

This paper proposes the first end-to-end deep framework for high dynamic...

Alignment-free HDR Deghosting with Semantics Consistent Transformer

High dynamic range (HDR) imaging aims to retrieve information from multi...

Please sign up or login with your details

Forgot password? Click here to reset