Enhance video taken with only starlight by using a physics-based noise model

Enhance video taken with only starlight by using a physics-based noise model

Dancing under the stars: video denoising in starlight
arXiv paper abstract https://arxiv.org/abs/2204.04210v1
arXiv PDF paper https://arxiv.org/pdf/2204.04210v1.pdf

Imaging in low light is extremely challenging due to low photon counts.

… demonstrate photorealistic video under starlight (no moon present, <0.001 lux) for the first time.

To enable this, … develop a GAN-tuned physics-based noise model to more accurately represent camera noise at the lowest light levels.

Using this noise model, … train a video denoiser using a combination of simulated noisy video clips and real noisy still images.

… capture a 5–10 fps video dataset with significant motion at approximately 0.6–0.7 millilux with no active illumination.

… achieve improved video quality at the lowest light levels, demonstrating photorealistic video denoising in starlight for the first time.

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Ryan Hutton on Unsplash

--

--

AI News Clips by Morris Lee: News to help your R&D

A computer vision consultant in artificial intelligence and related hitech technologies 37+ years. Am innovator with 66+ patents and ready to help a firm's R&D.