��� Correlation-based Joint Acquisition and Demosaicing of Visible and Near-infrared Images
English only
IVRG - Images and Visual Representation Group
EPFL > I&C > IVRG > Zahra Sadeghipoor
Supplem. Material & Downloads
Software & Demos
Jobs & Internships
Panorama Livecam

Correlation-based Joint Acquisition and Demosaicing of Visible and Near-infrared Images

Zahra Sadeghipoor, Yue M. Lu, and Sabine Süsstrunk

IEEE International Conference on Image Processing, 2011


Joint processing of visible (RGB) and near-infrared (NIR) images has recently found some appealing applications, which make joint capturing a pair of visible and NIR images an important problem. In this paper, we propose a new method to design color filter arrays (CFA) and demosaicing matrices for acquiring NIR and visible images using a single sensor. The proposed method modifies the optimum CFA algorithm proposed in [1] by taking advantage of the NIR/visible correlation in the design process. Simulation results show that by applying the proposed method, the quality of demosaiced NIR and visible images is increased by about 1 dB in peak signal-to-noise ratio over the results of the optimum CFA algorithm. It is also shown that better visual quality can be obtained using the proposed algorithm.

[1] Yue M. Lu, Clément Fredembach, Martin Vetterli, and Sabine Süsstrunk, "Designing color filter arrays for the joint capture of visible and near-infrared images," In Proc. of IEEE International Conference on Image Processing, 2009.

Results (on the 25 test images)

In each row from left to right:
1. The original visible image
2. The visible image demosaiced by the optimum CFA algorithm
3. The visible image demosaiced by the proposed algorithm
4. The original NIR image
5. The NIR image demosaiced by the optimum CFA algorithm
6. The NIR image demosaiced by the proposed algorithm
(Click on the images to see the full resolution)

Original visible Optimum CFA (visible) Proposed algorithm (visible) Original NIR Optimum CFA (NIR) Proposed algorithm (NIR)
Org/1vOrg.tiff Opt/1vOpt.tiff My/1vMy.tiff Org/1nOrg.tiff Opt/1nOpt.tiff My/1nMy.tiff
Org/2vOrg.tiff Opt/2vOpt.tiff My/2vMy.tiff Org/2nOrg.tiff Opt/2nOpt.tiff My/2nMy.tiff
Org/3vOrg.tiff Opt/3vOpt.tiff My/3vMy.tiff Org/3nOrg.tiff Opt/3nOpt.tiff My/3nMy.tiff
Org/4vOrg.tiff Opt/4vOpt.tiff My/4vMy.tiff Org/4nOrg.tiff Opt/4nOpt.tiff My/4nMy.tiff
Org/5vOrg.tiff Opt/5vOpt.tiff My/5vMy.tiff Org/5nOrg.tiff Opt/5nOpt.tiff My/5nMy.tiff
Org/6vOrg.tiff Opt/6vOpt.tiff My/6vMy.tiff Org/6nOrg.tiff Opt/6nOpt.tiff My/6nMy.tiff
Org/7vOrg.tiff Opt/7vOpt.tiff My/7vMy.tiff Org/7nOrg.tiff Opt/7nOpt.tiff My/7nMy.tiff
Org/8vOrg.tiff Opt/8vOpt.tiff My/8vMy.tiff Org/8nOrg.tiff Opt/8nOpt.tiff My/8nMy.tiff
Org/9vOrg.tiff Opt/9vOpt.tiff My/9vMy.tiff Org/9nOrg.tiff Opt/9nOpt.tiff My/9nMy.tiff
Org/10vOrg.tiff Opt/10vOpt.tiff My/10vMy.tiff Org/10nOrg.tiff Opt/10nOpt.tiff My/10nMy.tiff
Org/11vOrg.tiff Opt/11vOpt.tiff My/11vMy.tiff Org/11nOrg.tiff Opt/11nOpt.tiff My/11nMy.tiff
Org/12vOrg.tiff Opt/12vOpt.tiff My/12vMy.tiff Org/12nOrg.tiff Opt/12nOpt.tiff My/12nMy.tiff
Org/13vOrg.tiff Opt/13vOpt.tiff My/13vMy.tiff Org/13nOrg.tiff Opt/13nOpt.tiff My/13nMy.tiff
Org/14vOrg.tiff Opt/14vOpt.tiff My/14vMy.tiff Org/14nOrg.tiff Opt/14nOpt.tiff My/14nMy.tiff
Org/15vOrg.tiff Opt/15vOpt.tiff My/15vMy.tiff Org/15nOrg.tiff Opt/15nOpt.tiff My/15nMy.tiff
Org/16vOrg.tiff Opt/16vOpt.tiff My/16vMy.tiff Org/16nOrg.tiff Opt/16nOpt.tiff My/16nMy.tiff
Org/17vOrg.tiff Opt/17vOpt.tiff My/17vMy.tiff Org/17nOrg.tiff Opt/17nOpt.tiff My/17nMy.tiff
Org/18vOrg.tiff Opt/18vOpt.tiff My/18vMy.tiff Org/18nOrg.tiff Opt/18nOpt.tiff My/18nMy.tiff
Org/19vOrg.tiff Opt/19vOpt.tiff My/19vMy.tiff Org/19nOrg.tiff Opt/19nOpt.tiff My/19nMy.tiff
Org/20vOrg.tiff Opt/20vOpt.tiff My/20vMy.tiff Org/20nOrg.tiff Opt/20nOpt.tiff My/20nMy.tiff
Org/21vOrg.tiff Opt/21vOpt.tiff My/21vMy.tiff Org/21nOrg.tiff Opt/21nOpt.tiff My/21nMy.tiff
Org/22vOrg.tiff Opt/22vOpt.tiff My/22vMy.tiff Org/22nOrg.tiff Opt/22nOpt.tiff My/22nMy.tiff
Org/23vOrg.tiff Opt/23vOpt.tiff My/23vMy.tiff Org/23nOrg.tiff Opt/23nOpt.tiff My/23nMy.tiff
Org/24vOrg.tiff Opt/24vOpt.tiff My/24vMy.tiff Org/24nOrg.tiff Opt/24nOpt.tiff My/24nMy.tiff
Org/25vOrg.tiff Opt/25vOpt.tiff My/25vMy.tiff Org/25nOrg.tiff Opt/25nOpt.tiff My/25nMy.tiff

Last update : Monday, 27-May-2019 15:01:35 UTC
Comments/feedback to : webmaster [dot] lcav [at] epfl [dot] ch