Title
Transform Your Smartphone into a DSLR Camera: Learning the ISP in the Wild
Abstract
We propose a trainable Image Signal Processing (ISP) framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image. During inference, we predict the target color image by designing a color prediction network with efficient Global Context Transformer modules. The latter effectively leverage global information to learn consistent color and tone mappings. We further propose a robust masked aligned loss to identify and discard regions with inaccurate motion estimation during training. Lastly, we introduce the ISP in the Wild (ISPW) dataset, consisting of weakly paired phone RAW and DSLR sRGB images. We extensively evaluate our method, setting a new state-of-the-art on two datasets. The code is available at https://github.com/4rdhendu/TransformPhone2DSLR .
Year
DOI
Venue
2022
10.1007/978-3-031-20068-7_36
Computer Vision – ECCV 2022
Keywords
DocType
ISSN
Color conditional ISP, Efficient global attention, Learning in the wild, Mate30Canon dataset
Conference
0302-9743
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Ardhendu Shekhar Tripathi111.36
Danelljan Martin2134449.35
Samarth Shukla300.34
Radu Timofte41880118.45
Luc Van Gool503.38